Jul 06 12:20:48.749751 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 12:20:48.749765 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 12:20:48.749774 ip-10-0-129-248 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 12:20:48.750126 ip-10-0-129-248 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 12:20:58.813898 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 12:20:58.813914 ip-10-0-129-248 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 15b899a021c7415db7dcef1d2804f311 --
Jul 06 12:22:48.185648 ip-10-0-129-248 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 12:22:48.593409 ip-10-0-129-248 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:48.593409 ip-10-0-129-248 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 12:22:48.593409 ip-10-0-129-248 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:48.593409 ip-10-0-129-248 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 12:22:48.593409 ip-10-0-129-248 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:48.594140 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.593494    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 12:22:48.600243 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600216    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.600243 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600239    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.600243 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600243    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.600243 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600246    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.600243 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600251    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600257    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600263    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600266    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600269    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600272    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600275    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600278    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600282    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600284    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600287    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600290    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600293    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600296    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600299    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600301    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600304    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600307    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600310    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600313    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.600499 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600315    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600318    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600328    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600331    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600333    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600337    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600340    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600342    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600345    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600348    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600350    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600353    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600356    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600361    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600364    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600367    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600386    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600389    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600393    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600396    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.601015 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600399    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600401    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600405    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600407    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600410    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600413    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600416    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600419    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600422    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600424    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600428    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600430    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600433    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600435    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600438    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600442    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600445    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600448    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600450    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600453    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.601549 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600456    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600460    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600464    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600467    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600470    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600474    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600477    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600480    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600483    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600486    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600488    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600491    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600494    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600496    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600499    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600503    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600506    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600508    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600511    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600515    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.602077 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600517    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600520    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600523    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600526    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600529    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600531    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600534    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600536    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600539    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600541    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600544    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600547    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600549    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600552    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.600554    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602249    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602258    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602263    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602268    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.602610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602271    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602274    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602277    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602280    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602283    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602286    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602289    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602291    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602294    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602297    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602300    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602303    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602306    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602310    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602313    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602317    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602320    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602323    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602326    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602328    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.603100 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602331    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602335    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602338    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602341    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602344    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602346    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602349    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602352    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602354    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602357    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602360    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602363    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602365    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602368    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602371    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602373    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602376    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602378    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602396    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602399    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.603641 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602402    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602405    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602408    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602410    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602413    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602416    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602420    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602425    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602428    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602431    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602434    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602437    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602440    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602442    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602445    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602448    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602451    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602454    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602456    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602459    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.604179 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602462    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602464    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602467    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602471    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602473    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602476    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602478    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602481    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602484    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602486    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602489    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602495    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602499    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602502    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602505    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602508    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602510    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602513    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602516    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.604726 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602520    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602524    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602528    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602531    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602534    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602537    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602540    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602543    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602547    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602549    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602552    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602555    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602557    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602560    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602562    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602565    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602986    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602991    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602994    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.605234 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.602997    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603000    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603002    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603005    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603008    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603011    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603015    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603019    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603023    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603026    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603028    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603032    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603035    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603038    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603042    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603045    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603047    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603050    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603053    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.605768 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603056    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603059    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603061    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603064    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603066    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603069    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603072    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603074    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603077    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603080    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603083    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603085    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603089    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603092    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603096    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603099    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603102    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603105    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603108    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603111    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.606260 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603113    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603116    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603119    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603122    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603125    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603127    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603130    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603134    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603137    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603140    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603142    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603145    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603148    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603150    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603153    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603156    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603158    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603161    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603164    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603166    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.606849 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603169    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603172    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603174    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603179    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603182    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603185    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603188    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603192    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603194    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603197    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603200    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603202    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603205    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603208    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603210    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603214    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603217    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603220    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603223    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.607419 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603226    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603229    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603232    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603235    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603238    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603240    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603243    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603246    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603249    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603251    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603254    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603257    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603260    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603262    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603265    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603268    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603270    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.603273    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603351    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603358    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603365    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 12:22:48.607911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603370    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603374    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603378    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603403    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603410    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603416    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603421    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603427    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603431    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603435    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603438    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603441    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603445    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603450    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603453    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603458    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603461    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603465    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603468    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603472    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603476    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603479    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603483    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 12:22:48.608511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603486    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603489    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603492    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603496    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603499    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603502    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603510    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603514    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603517    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603520    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603523    2570 flags.go:64] FLAG: --enable-server="true"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603526    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603530    2570 flags.go:64] FLAG: --event-burst="100"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603536    2570 flags.go:64] FLAG: --event-qps="50"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603539    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603542    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603546    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603550    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603553    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603556    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603560    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603563    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603566    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603570    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603573    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 12:22:48.609104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603576    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603579    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603582    2570 flags.go:64] FLAG: --feature-gates=""
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603586    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603589    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603592    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603595    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603598    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603602    2570 flags.go:64] FLAG: --help="false"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603605    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603608    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603611    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603614    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603619    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603623    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603626    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603629    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603632    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603636    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603639    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603644    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603647    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603650    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603654    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 12:22:48.609838 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603657    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603661    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603664    2570 flags.go:64] FLAG: --lock-file=""
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603667    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603670    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603674    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603679    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603683    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603686    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603689    2570 flags.go:64] FLAG: --logging-format="text"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603692    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603696    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603699    2570 flags.go:64] FLAG: --manifest-url=""
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603702    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603707    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603710    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603715    2570 flags.go:64] FLAG: --max-pods="110"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603718    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603721    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603724    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603728    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603733    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603736    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603739    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603748    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 12:22:48.610514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603751    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603755    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603758    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603762    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603768    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603772    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603775    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603778    2570 flags.go:64] FLAG: --port="10250"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603782    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603785    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00a3ce8f338dbc308"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603789    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603792    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603795    2570 flags.go:64] FLAG: --register-node="true"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603798    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603802    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603806    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603809    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603812    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603816    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603819    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603822    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603825    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603828    2570 flags.go:64] FLAG: --runonce="false"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603831    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603835    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 12:22:48.611197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603838    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603841    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603844    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603848    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603851    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603854    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603858    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603861    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603864    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603867    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603870    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603875    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603878    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603884    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603887    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603890    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603895    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603898    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603901    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603904    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603906    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603910    2570 flags.go:64] FLAG: --v="2"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603914    2570 flags.go:64] FLAG: --version="false"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603919    2570 flags.go:64] FLAG: --vmodule=""
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603923    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 12:22:48.612253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.603927    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604054    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604058    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604060    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604064    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604066    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604069    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604072    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604075    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604078    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604083    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604086    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604088    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604091    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604094    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604097    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604099    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604102    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604107    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604110    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.613495 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604113    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604116    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604119    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604121    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604124    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604126    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604129    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604134    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604137    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604140    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604144    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604147    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604150    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604153    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604156    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604159    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604162    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604164    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604167    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604170    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.614432 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604172    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604175    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604180    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604183    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604186    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604189    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604191    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604194    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604197    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604200    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604205    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604207    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604210    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604213    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604216    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604218    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604223    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604226    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604229    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.615355 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604232    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604235    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604238    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604241    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604244    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604247    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604251    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604253    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604256    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604258    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604261    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604264    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604267    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604270    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604273    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604277    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604280    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604282    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604285    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.615968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604288    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604290    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604294    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604298    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604303    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604306    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604309    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604312    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604314    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604317    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604320    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604323    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604325    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604328    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604331    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604334    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604337    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604339    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604342    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.616712 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604345    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604348    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.604351    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.605003    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.613817    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.613841    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.613870    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.613879    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.613974    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.613983    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.613989    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.613994    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.613999    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614006    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.617308 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614012    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614018    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614024    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614028    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614034    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614038    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614045    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614049    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614054    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614058    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614063    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614068    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614075    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614082    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614086    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614091    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614096    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614101    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614108    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614113    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.617714 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614117    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614123    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614127    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614132    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614137    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614141    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614147    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614151    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614156    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614160    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614165    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614169    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614174    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614178    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614184    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614188    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614193    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614198    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614203    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614207    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.618610 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614211    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614216    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614221    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614225    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614230    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614234    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614239    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614245    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614249    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614254    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614259    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614268    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614276    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614281    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614287    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614293    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614298    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614303    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614307    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614312    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.619245 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614317    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614322    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614326    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614330    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614335    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614340    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614344    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614349    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614353    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614358    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614362    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614367    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614371    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614376    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614403    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614409    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614413    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614418    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614423    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614427    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.619961 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614431    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614435    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614440    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614444    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614449    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614454    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614458    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614463    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614468    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614472    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614477    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614482    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614487    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.614496    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614697    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:48.620552 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614705    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614711    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614716    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614721    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614725    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614730    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614734    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614739    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614743    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614747    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614752    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614757    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614761    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614767    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614771    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614776    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614781    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614785    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614791    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614795    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:48.620968 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614800    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614804    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614810    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614814    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614818    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614823    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614828    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614832    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614837    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614841    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614846    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614851    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614856    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614860    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614864    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614869    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614874    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614878    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614882    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614887    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:48.621725 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614891    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614896    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614900    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614905    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614909    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614913    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614918    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614922    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614929    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614936    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614941    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614946    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614950    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614955    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614960    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614967    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614972    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614978    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614982    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:48.622291 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614987    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614991    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.614996    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615000    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615006    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615011    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615015    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615020    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615025    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615029    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615034    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615047    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615052    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615057    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615063    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615071    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615077    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615081    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615086    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615090    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:48.622866 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615095    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615099    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615103    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615108    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615113    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615121    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615126    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615132    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615136    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615142    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615146    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615151    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615156    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615160    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615164    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615169    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615174    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615178    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:48.623448 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:48.615182    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.615192    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.615371    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.619565    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.621379    2570 server.go:1019] "Starting client certificate rotation"
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.621508    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:22:48.623991 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.621541    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:22:48.624487 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.624469    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:22:48.630243 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.630219    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:22:48.643326 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.643292    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 06 12:22:48.645982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.645963    2570 log.go:25] "Validated CRI v1 image API"
Jul 06 12:22:48.646911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.646896    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 12:22:48.653103 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.653081    2570 fs.go:135] Filesystem UUIDs: map[2d3fac91-8763-4407-9dea-d19170a9dd86:/dev/nvme0n1p3 6d726fc8-c787-4ceb-9a9f-f7518b966988:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 06 12:22:48.653197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.653101    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 12:22:48.657748 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.657626    2570 manager.go:216] Machine: {Timestamp:2026-07-06 12:22:48.657088596 +0000 UTC m=+0.352793239 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102487 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24bb916559c69e067facf4f1b13c9c SystemUUID:ec24bb91-6559-c69e-067f-acf4f1b13c9c BootID:15b899a0-21c7-415d-b7dc-ef1d2804f311 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:14:7e:7f:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:14:7e:7f:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:f9:10:d9:4b:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 12:22:48.657748 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.657736    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 12:22:48.657900 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.657826    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 12:22:48.660041 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.660025    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:22:48.661279 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.661243    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 12:22:48.661457 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.661283    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 12:22:48.662125 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.662114    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 12:22:48.662166 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.662127    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 12:22:48.662166 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.662158    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:22:48.662971 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.662956    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:22:48.665324 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.665313    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 12:22:48.669794 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.669780    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:22:48.669958 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.669947    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 12:22:48.670009 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.669984    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 12:22:48.670055 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670009    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 12:22:48.670055 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670034    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 12:22:48.670055 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670048    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 06 12:22:48.670185 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670061    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 12:22:48.670564 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670550    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:22:48.670610 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.670571    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:22:48.673052 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.673023    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 12:22:48.675690 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.675674    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 12:22:48.675760 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.675718    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 12:22:48.677318 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677301    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 12:22:48.677318 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677319    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677326    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677333    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677342    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677348    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677357    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677362    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677370    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677376    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677401    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 12:22:48.677514 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.677408    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 12:22:48.678302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.678290    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 12:22:48.678302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.678300    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 12:22:48.680772 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.680747    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 12:22:48.680772 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.680752    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 12:22:48.680891 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.680779    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 12:22:48.681828 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.681815    2570 server.go:1268] "Started kubelet"
Jul 06 12:22:48.681990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.681905    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 12:22:48.682791 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.681905    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 12:22:48.682882 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.682820    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 12:22:48.683262 ip-10-0-129-248 systemd[1]: Started Kubernetes Kubelet.
Jul 06 12:22:48.685044 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.685025    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 12:22:48.685933 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.685916    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 12:22:48.688575 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.688546    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 12:22:48.699930 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.699912    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8h2tc"
Jul 06 12:22:48.702112 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.702084    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 12:22:48.702112 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.702087    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 12:22:48.702260 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.701082    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-248.ec2.internal.18bfb2cc75d21bf6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-248.ec2.internal,UID:ip-10-0-129-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-248.ec2.internal,},FirstTimestamp:2026-07-06 12:22:48.681782262 +0000 UTC m=+0.377486953,LastTimestamp:2026-07-06 12:22:48.681782262 +0000 UTC m=+0.377486953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-248.ec2.internal,}"
Jul 06 12:22:48.702367 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.702284    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:48.703257 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703239    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 12:22:48.703257 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703239    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 12:22:48.703432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703268    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 12:22:48.703484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703436    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 12:22:48.703484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703447    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 12:22:48.703484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703462    2570 factory.go:153] Registering CRI-O factory
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703477    2570 factory.go:223] Registration of the crio container factory successfully
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703544    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703555    2570 factory.go:55] Registering systemd factory
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703563    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703586    2570 factory.go:103] Registering Raw factory
Jul 06 12:22:48.703627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.703602    2570 manager.go:1196] Started watching for new ooms in manager
Jul 06 12:22:48.704350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.704265    2570 manager.go:349] Starting recovery of all containers
Jul 06 12:22:48.708252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.708225    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8h2tc"
Jul 06 12:22:48.710787 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.710728    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 12:22:48.714370 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.714349    2570 manager.go:354] Recovery completed
Jul 06 12:22:48.714642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.714623    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:48.717563 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.717528    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-248.ec2.internal\" not found" node="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.719060 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.719036    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.720898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.720870    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.720987 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.720904    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.720987 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.720918    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.721957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.721941    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 12:22:48.721957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.721956    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 12:22:48.722070 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.721962    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.722070 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.721977    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:22:48.722744 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.722730    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.722831 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.722761    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.722831 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.722775    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.723484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.723465    2570 policy_none.go:49] "None policy: Start"
Jul 06 12:22:48.723484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.723487    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 12:22:48.723614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.723502    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 12:22:48.724622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.724607    2570 policy_none.go:47] "Start"
Jul 06 12:22:48.766054 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.765923    2570 manager.go:337] "Starting Device Plugin manager"
Jul 06 12:22:48.766146 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.766079    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 12:22:48.766146 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766093    2570 server.go:87] "Starting device plugin registration server"
Jul 06 12:22:48.766356 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766342    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 12:22:48.766446 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766374    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 12:22:48.766499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766452    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 12:22:48.766597 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766545    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 12:22:48.766597 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.766560    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 12:22:48.767154 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.767127    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 12:22:48.767256 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.767189    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:48.807907 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.807849    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 12:22:48.808722 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.807910    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 12:22:48.808722 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.807930    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 12:22:48.808722 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.807962    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 12:22:48.810689 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.810668    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:48.866912 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.866878    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.868110 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.868092    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.868192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.868125    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.868192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.868139    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.868192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.868165    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.877879 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.877858    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.877989 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.877882    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-248.ec2.internal\": node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:48.900415 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.900390    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:48.908165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.908139    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"]
Jul 06 12:22:48.908219 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.908207    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.909077 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.909061    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.909160 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.909090    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.909160 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.909100    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.910493 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.910481    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.910630 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.910613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.910690 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.910655    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.911195 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911178    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.911270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911205    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.911270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911221    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.911270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911232    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.911270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911249    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.911270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.911262    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.913208 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.913194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.913293 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.913218    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:48.913912 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.913892    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:48.913997 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.913926    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:48.913997 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:48.913942    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:48.936103 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.936084    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-248.ec2.internal\" not found" node="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:48.941055 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:48.941036    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-248.ec2.internal\" not found" node="ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.000587 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.000552    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.102594 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.102523    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.104949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.104933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.105004 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.104957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/574c7dd2fe0232ed5ac86b87d67e74b7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"574c7dd2fe0232ed5ac86b87d67e74b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.105004 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.104980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.204914 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.204865    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.206135 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.206181 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.206181 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/574c7dd2fe0232ed5ac86b87d67e74b7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"574c7dd2fe0232ed5ac86b87d67e74b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.206249 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206215    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.206249 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206221    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25373cbf82a4aba048f77db79b4eb056-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"25373cbf82a4aba048f77db79b4eb056\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.206313 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.206268    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/574c7dd2fe0232ed5ac86b87d67e74b7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"574c7dd2fe0232ed5ac86b87d67e74b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.243072 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.243026    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.246552 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.246531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:49.305003 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.304965    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.406052 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.405984    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.506486 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.506455    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.607574 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.607536    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.620181 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.620150    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 12:22:49.620355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.620320    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:22:49.620434 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.620358    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:22:49.708648 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.708578    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.710916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.710884    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 12:17:49 +0000 UTC" deadline="2027-12-31 11:39:27.769805202 +0000 UTC"
Jul 06 12:22:49.710916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.710915    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13031h16m38.058893633s"
Jul 06 12:22:49.809432 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.809389    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.839553 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:49.839515    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25373cbf82a4aba048f77db79b4eb056.slice/crio-7b8caa4da3dffe307db8af4fd8d406148f4d5e9bfdd50a1e86b0fea306bfcae3 WatchSource:0}: Error finding container 7b8caa4da3dffe307db8af4fd8d406148f4d5e9bfdd50a1e86b0fea306bfcae3: Status 404 returned error can't find the container with id 7b8caa4da3dffe307db8af4fd8d406148f4d5e9bfdd50a1e86b0fea306bfcae3
Jul 06 12:22:49.839865 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:49.839849    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574c7dd2fe0232ed5ac86b87d67e74b7.slice/crio-22903cd44a7696e04f0a2ecc0a6ca645459af5175b334ba5bd285aed63ab2923 WatchSource:0}: Error finding container 22903cd44a7696e04f0a2ecc0a6ca645459af5175b334ba5bd285aed63ab2923: Status 404 returned error can't find the container with id 22903cd44a7696e04f0a2ecc0a6ca645459af5175b334ba5bd285aed63ab2923
Jul 06 12:22:49.845565 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.845549    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:22:49.910084 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:49.910046    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Jul 06 12:22:49.970812 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:49.970742    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:50.003336 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.003274    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:50.016413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.016383    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:22:50.018296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.018278    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Jul 06 12:22:50.028127 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.028107    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:22:50.036528 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.036509    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:50.568114 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.568074    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:50.672790 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.672754    2570 apiserver.go:52] "Watching apiserver"
Jul 06 12:22:50.681916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.681880    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 12:22:50.682376 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.682344    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tmf54","kube-system/konnectivity-agent-pgxxq","kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg","openshift-image-registry/node-ca-mslb8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal","openshift-multus/multus-additional-cni-plugins-h8gtb","openshift-multus/multus-dl7bs","openshift-cluster-node-tuning-operator/tuned-lpm7k","openshift-dns/node-resolver-gqkrs","openshift-multus/network-metrics-daemon-4kjc4","openshift-network-diagnostics/network-check-target-8smbn","openshift-network-operator/iptables-alerter-hvfkg","openshift-ovn-kubernetes/ovnkube-node-4c9zm"]
Jul 06 12:22:50.684095 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.684066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.686476 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.686449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.686858 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.686733    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.687732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.687081    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z5q99\""
Jul 06 12:22:50.687732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.687123    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.687732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.687376    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 12:22:50.687732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.687415    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 12:22:50.687732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.687673    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 12:22:50.688034 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.688015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.689282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.689261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.691290 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.690637    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.691290 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.690806    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.691290 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.691122    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.691520 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.691477    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jdd9q\""
Jul 06 12:22:50.691755 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.691737    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 12:22:50.692256 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.692232    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.693988 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.693957    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.695793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.695737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.695793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.695772    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 12:22:50.695951 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.695746    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 12:22:50.696851 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.696291    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:22:50.696851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.696650    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 12:22:50.697188 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.697168    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 12:22:50.698235 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.698210    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 12:22:50.700450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.700026    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701628    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dl5wz\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701655    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701667    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701681    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701693    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701779    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fzt9w\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701860    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701931    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.701966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702227    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9wb5\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702467    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lxntt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702681    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702843    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702896    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702953    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.703058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702966    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ssp9g\""
Jul 06 12:22:50.703895 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.702898    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.704315 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.704296    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 12:22:50.705146 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.705124    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dx277\""
Jul 06 12:22:50.705874 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.705854    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 12:22:50.707541 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.707479    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 12:22:50.707654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.707587    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2mm8\""
Jul 06 12:22:50.709616 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.709594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.709724 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.709683    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:22:50.710132 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.710109    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 12:22:50.712047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.712028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:50.712143 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.712104    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:22:50.716213 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-run\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716309 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716227    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-etc-selinux\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.716309 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e660f6ad-0357-4bcc-bec3-81f3c3a53865-serviceca\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.716431 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-modprobe-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716431 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-k8s-cni-cncf-io\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.716431 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-etc-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.716431 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-config\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716435    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b0c17c-7475-4f10-8ed8-045b11381fe4-agent-certs\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b0c17c-7475-4f10-8ed8-045b11381fe4-konnectivity-ca\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716485    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-socket-dir-parent\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716577    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-hostroot\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgbt\" (UniqueName: \"kubernetes.io/projected/8fb822e6-1871-4a32-a722-b1e505f9c252-kube-api-access-jzgbt\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-netns\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ktc\" (UniqueName: \"kubernetes.io/projected/127220d7-daa6-4a56-8dd2-cc0c7003ca33-kube-api-access-l9ktc\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-tuned\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-tmp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-dbus\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fb822e6-1871-4a32-a722-b1e505f9c252-hosts-file\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-kubernetes\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.716922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-iptables-alerter-script\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-sys-fs\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.716991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-cni-binary-copy\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-etc-kubernetes\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-systemd-units\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717068    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-ovn\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-env-overrides\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6mz\" (UniqueName: \"kubernetes.io/projected/8f028b3d-cec6-495a-824b-992286d19624-kube-api-access-zr6mz\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-socket-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-device-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysconfig\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-sys\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-log-socket\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb822e6-1871-4a32-a722-b1e505f9c252-tmp-dir\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-var-lib-kubelet\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.717489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-kubelet\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717508    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-conf\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-host\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717569    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cnibin\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh78\" (UniqueName: \"kubernetes.io/projected/f934459a-a37f-4d23-b84b-1b6867a54ac6-kube-api-access-9wh78\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-netns\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f028b3d-cec6-495a-824b-992286d19624-ovn-node-metrics-cert\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-registration-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-kubelet-config\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-kubelet\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-systemd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-var-lib-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-cnibin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.718299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-systemd\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.717977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-slash\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-node-log\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-bin\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-script-lib\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcck\" (UniqueName: \"kubernetes.io/projected/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-kube-api-access-xmcck\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwsll\" (UniqueName: \"kubernetes.io/projected/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kube-api-access-wwsll\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-os-release\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-bin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-netd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-host-slash\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-daemon-config\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-multus-certs\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-lib-modules\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qgp\" (UniqueName: \"kubernetes.io/projected/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-kube-api-access-h4qgp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7stz\" (UniqueName: \"kubernetes.io/projected/e660f6ad-0357-4bcc-bec3-81f3c3a53865-kube-api-access-s7stz\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.719121 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-system-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-multus\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-conf-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-system-cni-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-os-release\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnmp\" (UniqueName: \"kubernetes.io/projected/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-kube-api-access-vfnmp\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e660f6ad-0357-4bcc-bec3-81f3c3a53865-host\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.719905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.718727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.721825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.721800    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:22:50.751699 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.751253    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpndx"
Jul 06 12:22:50.763279 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.763252    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpndx"
Jul 06 12:22:50.805011 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.804979    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 12:22:50.813144 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.813083    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"25373cbf82a4aba048f77db79b4eb056","Type":"ContainerStarted","Data":"7b8caa4da3dffe307db8af4fd8d406148f4d5e9bfdd50a1e86b0fea306bfcae3"}
Jul 06 12:22:50.814513 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.814479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" event={"ID":"574c7dd2fe0232ed5ac86b87d67e74b7","Type":"ContainerStarted","Data":"22903cd44a7696e04f0a2ecc0a6ca645459af5175b334ba5bd285aed63ab2923"}
Jul 06 12:22:50.819835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-kubelet\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.819835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-systemd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.819835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-var-lib-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-cnibin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819856    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-kubelet\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-systemd\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-slash\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-node-log\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819920    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-var-lib-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819931    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-systemd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-bin\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819982    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-systemd\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-script-lib\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820019    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-cnibin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820028    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-node-log\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcck\" (UniqueName: \"kubernetes.io/projected/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-kube-api-access-xmcck\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.820062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.819998    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-slash\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820077    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-bin\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820159    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwsll\" (UniqueName: \"kubernetes.io/projected/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kube-api-access-wwsll\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-os-release\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-bin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-netd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820244    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-host-slash\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-daemon-config\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-multus-certs\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820341    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-host-slash\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820385    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-multus-certs\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-lib-modules\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qgp\" (UniqueName: \"kubernetes.io/projected/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-kube-api-access-h4qgp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7stz\" (UniqueName: \"kubernetes.io/projected/e660f6ad-0357-4bcc-bec3-81f3c3a53865-kube-api-access-s7stz\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820288    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-bin\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-system-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-multus\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-conf-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.820801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820389    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-cni-netd\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820570    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820409    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-os-release\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820491    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-lib-modules\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-system-cni-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820725    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-system-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820756    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-script-lib\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820767    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-system-cni-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820768    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-var-lib-cni-multus\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820895    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-os-release\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820901    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-conf-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821020    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-daemon-config\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.820620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-os-release\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnmp\" (UniqueName: \"kubernetes.io/projected/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-kube-api-access-vfnmp\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.821368    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e660f6ad-0357-4bcc-bec3-81f3c3a53865-host\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.821544 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.821451    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:22:51.321428551 +0000 UTC m=+3.017133198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821466    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e660f6ad-0357-4bcc-bec3-81f3c3a53865-host\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821471    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-run\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821508    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-etc-selinux\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e660f6ad-0357-4bcc-bec3-81f3c3a53865-serviceca\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-modprobe-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-k8s-cni-cncf-io\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-etc-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-config\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b0c17c-7475-4f10-8ed8-045b11381fe4-agent-certs\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b0c17c-7475-4f10-8ed8-045b11381fe4-konnectivity-ca\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821800    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-modprobe-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-socket-dir-parent\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.822229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-hostroot\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgbt\" (UniqueName: \"kubernetes.io/projected/8fb822e6-1871-4a32-a722-b1e505f9c252-kube-api-access-jzgbt\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-netns\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ktc\" (UniqueName: \"kubernetes.io/projected/127220d7-daa6-4a56-8dd2-cc0c7003ca33-kube-api-access-l9ktc\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.821996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-tuned\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-tmp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822048    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-dbus\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fb822e6-1871-4a32-a722-b1e505f9c252-hosts-file\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-kubernetes\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-iptables-alerter-script\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822212    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b0c17c-7475-4f10-8ed8-045b11381fe4-konnectivity-ca\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-sys-fs\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.823082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-cni-binary-copy\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822272    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-k8s-cni-cncf-io\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-etc-kubernetes\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-systemd-units\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-ovn\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822342    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-netns\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-env-overrides\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6mz\" (UniqueName: \"kubernetes.io/projected/8f028b3d-cec6-495a-824b-992286d19624-kube-api-access-zr6mz\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822414    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-run\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822463    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-socket-dir-parent\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822475    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-etc-openvswitch\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822501    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-hostroot\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822313    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-etc-kubernetes\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-etc-selinux\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822554    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-run-ovn\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.822561    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822591    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-sys-fs\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822554    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fb822e6-1871-4a32-a722-b1e505f9c252-hosts-file\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.823999 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.822617    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:51.322598354 +0000 UTC m=+3.018302999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822598    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-kubernetes\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822653    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822654    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-socket-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822748    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-dbus\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822751    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-d\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-socket-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-device-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822801    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822868    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysconfig\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.823709    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822912    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e660f6ad-0357-4bcc-bec3-81f3c3a53865-serviceca\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.823908    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f934459a-a37f-4d23-b84b-1b6867a54ac6-cni-binary-copy\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.823980    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-env-overrides\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824234    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-iptables-alerter-script\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824402    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-systemd-units\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f028b3d-cec6-495a-824b-992286d19624-ovnkube-config\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824545    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-device-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.824872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.822828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysconfig\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824629    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824665    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-sys\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-log-socket\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb822e6-1871-4a32-a722-b1e505f9c252-tmp-dir\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824793    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-sys\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824800    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-var-lib-kubelet\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-kubelet\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824861    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-var-lib-kubelet\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.824979    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-multus-cni-dir\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825102    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-conf\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825121    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb822e6-1871-4a32-a722-b1e505f9c252-tmp-dir\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825138    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-host\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cnibin\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh78\" (UniqueName: \"kubernetes.io/projected/f934459a-a37f-4d23-b84b-1b6867a54ac6-kube-api-access-9wh78\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825220    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-host\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.825782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825251    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cnibin\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-netns\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825309    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-log-socket\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f028b3d-cec6-495a-824b-992286d19624-ovn-node-metrics-cert\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-registration-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-kubelet-config\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.826027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.826638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.825269    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.827026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.826682    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.827026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.826769    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95b43b4-b8c3-4160-8bc9-0f9198017d57-registration-dir\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.827026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.826833    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ebed58a-1507-4958-9ab0-3d4d060ac15e-kubelet-config\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:50.827209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.827188    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f934459a-a37f-4d23-b84b-1b6867a54ac6-host-run-netns\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.827209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.827194    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.827653 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.827511    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-sysctl-conf\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.827734 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.827670    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f028b3d-cec6-495a-824b-992286d19624-host-kubelet\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.829824 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.828227    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b0c17c-7475-4f10-8ed8-045b11381fe4-agent-certs\") pod \"konnectivity-agent-pgxxq\" (UID: \"06b0c17c-7475-4f10-8ed8-045b11381fe4\") " pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:50.830373 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.829950    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-etc-tuned\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.830373 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.830362    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f028b3d-cec6-495a-824b-992286d19624-ovn-node-metrics-cert\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.831844 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.831434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-tmp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.833626 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.833598    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcck\" (UniqueName: \"kubernetes.io/projected/a3bcc3a5-7169-41c8-b42f-5e9f909ad53b-kube-api-access-xmcck\") pod \"iptables-alerter-hvfkg\" (UID: \"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b\") " pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:50.835313 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.834941    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwsll\" (UniqueName: \"kubernetes.io/projected/d95b43b4-b8c3-4160-8bc9-0f9198017d57-kube-api-access-wwsll\") pod \"aws-ebs-csi-driver-node-54jsg\" (UID: \"d95b43b4-b8c3-4160-8bc9-0f9198017d57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:50.835847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.835794    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgbt\" (UniqueName: \"kubernetes.io/projected/8fb822e6-1871-4a32-a722-b1e505f9c252-kube-api-access-jzgbt\") pod \"node-resolver-gqkrs\" (UID: \"8fb822e6-1871-4a32-a722-b1e505f9c252\") " pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:50.837283 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.837254    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnmp\" (UniqueName: \"kubernetes.io/projected/13c4f86f-d5d4-43c8-84f5-18cbda5348dc-kube-api-access-vfnmp\") pod \"multus-additional-cni-plugins-h8gtb\" (UID: \"13c4f86f-d5d4-43c8-84f5-18cbda5348dc\") " pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:50.837396 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.837260    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7stz\" (UniqueName: \"kubernetes.io/projected/e660f6ad-0357-4bcc-bec3-81f3c3a53865-kube-api-access-s7stz\") pod \"node-ca-mslb8\" (UID: \"e660f6ad-0357-4bcc-bec3-81f3c3a53865\") " pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:50.838124 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.838100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh78\" (UniqueName: \"kubernetes.io/projected/f934459a-a37f-4d23-b84b-1b6867a54ac6-kube-api-access-9wh78\") pod \"multus-dl7bs\" (UID: \"f934459a-a37f-4d23-b84b-1b6867a54ac6\") " pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:50.838404 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.838367    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qgp\" (UniqueName: \"kubernetes.io/projected/951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07-kube-api-access-h4qgp\") pod \"tuned-lpm7k\" (UID: \"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07\") " pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:50.839165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.839136    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6mz\" (UniqueName: \"kubernetes.io/projected/8f028b3d-cec6-495a-824b-992286d19624-kube-api-access-zr6mz\") pod \"ovnkube-node-4c9zm\" (UID: \"8f028b3d-cec6-495a-824b-992286d19624\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:50.839298 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.839277    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ktc\" (UniqueName: \"kubernetes.io/projected/127220d7-daa6-4a56-8dd2-cc0c7003ca33-kube-api-access-l9ktc\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:50.927298 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.927262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:50.934996 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.934970    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:50.934996 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.934998    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:50.935221 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.935008    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:50.935221 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:50.935079    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:51.435060505 +0000 UTC m=+3.130765133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:50.999461 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:50.999426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h8gtb"
Jul 06 12:22:51.015681 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.015652    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvfkg"
Jul 06 12:22:51.027623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.027594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:22:51.033843 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.033819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg"
Jul 06 12:22:51.042608 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.042585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mslb8"
Jul 06 12:22:51.051419 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.051396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dl7bs"
Jul 06 12:22:51.062243 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.062222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lpm7k"
Jul 06 12:22:51.069831 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.069811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:22:51.076463 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.076446    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqkrs"
Jul 06 12:22:51.112699 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.112674    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:51.330715 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.330615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:51.330715 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.330673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:51.330960 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.330815    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:51.330960 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.330882    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:52.330863331 +0000 UTC m=+4.026567961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:51.330960 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.330816    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:51.331120 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.330978    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:22:52.330956671 +0000 UTC m=+4.026661300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:51.532156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.532109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:51.532353 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.532302    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:51.532353 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.532350    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:51.532484 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.532367    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:51.532484 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.532443    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:52.532422783 +0000 UTC m=+4.228127434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:51.766456 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.766351    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:17:51 +0000 UTC" deadline="2028-01-18 22:01:35.979662534 +0000 UTC"
Jul 06 12:22:51.766456 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.766396    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13473h38m44.213271802s"
Jul 06 12:22:51.808805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:51.808768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:51.809001 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:51.808888    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:22:51.995513 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:51.995487    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf934459a_a37f_4d23_b84b_1b6867a54ac6.slice/crio-a5408d4544fb797d258d202214c90053aeb06b3b6a66b2ada75eadefde61b617 WatchSource:0}: Error finding container a5408d4544fb797d258d202214c90053aeb06b3b6a66b2ada75eadefde61b617: Status 404 returned error can't find the container with id a5408d4544fb797d258d202214c90053aeb06b3b6a66b2ada75eadefde61b617
Jul 06 12:22:51.997109 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:51.997037    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bcc3a5_7169_41c8_b42f_5e9f909ad53b.slice/crio-1046299b3312bafadb4ea51fef3a41c21120009423a0deb8b93c477cbe5c2506 WatchSource:0}: Error finding container 1046299b3312bafadb4ea51fef3a41c21120009423a0deb8b93c477cbe5c2506: Status 404 returned error can't find the container with id 1046299b3312bafadb4ea51fef3a41c21120009423a0deb8b93c477cbe5c2506
Jul 06 12:22:51.998229 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:51.998204    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode660f6ad_0357_4bcc_bec3_81f3c3a53865.slice/crio-bf0431b20703085e99c52e5c90b294f4dfee8bdce40005d99f0e86de80a93b39 WatchSource:0}: Error finding container bf0431b20703085e99c52e5c90b294f4dfee8bdce40005d99f0e86de80a93b39: Status 404 returned error can't find the container with id bf0431b20703085e99c52e5c90b294f4dfee8bdce40005d99f0e86de80a93b39
Jul 06 12:22:52.011611 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:52.011580    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c4f86f_d5d4_43c8_84f5_18cbda5348dc.slice/crio-f0870a44d894e15d7ad61d99a25cef30b0659d1d26816646327f9a09ccef7355 WatchSource:0}: Error finding container f0870a44d894e15d7ad61d99a25cef30b0659d1d26816646327f9a09ccef7355: Status 404 returned error can't find the container with id f0870a44d894e15d7ad61d99a25cef30b0659d1d26816646327f9a09ccef7355
Jul 06 12:22:52.011828 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:22:52.011800    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951f2af3_cc24_4d6a_a0c3_cb15aeaf0e07.slice/crio-c8b43af6c048ec68da62dc6cad8396a8141152db9697193e637119747c43f15b WatchSource:0}: Error finding container c8b43af6c048ec68da62dc6cad8396a8141152db9697193e637119747c43f15b: Status 404 returned error can't find the container with id c8b43af6c048ec68da62dc6cad8396a8141152db9697193e637119747c43f15b
Jul 06 12:22:52.339370 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.339180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:52.339483 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.339330    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:52.339483 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.339432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:52.339483 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.339464    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:54.33944679 +0000 UTC m=+6.035151419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:52.339605 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.339522    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:52.339605 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.339571    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:22:54.339556598 +0000 UTC m=+6.035261241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:52.546455 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.540742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:52.546455 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.540959    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:52.546455 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.540981    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:52.546455 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.540995    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:52.546455 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.541065    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:54.541044888 +0000 UTC m=+6.236749518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:52.767051 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.766987    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:17:51 +0000 UTC" deadline="2028-03-17 21:31:32.003078762 +0000 UTC"
Jul 06 12:22:52.767051 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.767049    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14889h8m39.236034612s"
Jul 06 12:22:52.813747 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.813672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:52.813902 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.813826    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:22:52.814283 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.814258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:52.814396 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:52.814364    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:22:52.846052 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.845962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqkrs" event={"ID":"8fb822e6-1871-4a32-a722-b1e505f9c252","Type":"ContainerStarted","Data":"50112bc316f12fb65f6fb2e3ebdfc8e4daf26d7ae4ef151481022b84042cd0e3"}
Jul 06 12:22:52.847746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.847664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerStarted","Data":"f0870a44d894e15d7ad61d99a25cef30b0659d1d26816646327f9a09ccef7355"}
Jul 06 12:22:52.853295 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.853170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"e188a7ae7401051b28dd76e93f0d6a2db5330caa1c642017403399066fc12a09"}
Jul 06 12:22:52.860892 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.860856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgxxq" event={"ID":"06b0c17c-7475-4f10-8ed8-045b11381fe4","Type":"ContainerStarted","Data":"9851ed2660f7e3e078f8e3af78af5d254742edd6945bf888b84d29ce710a8fcd"}
Jul 06 12:22:52.865884 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.865795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mslb8" event={"ID":"e660f6ad-0357-4bcc-bec3-81f3c3a53865","Type":"ContainerStarted","Data":"bf0431b20703085e99c52e5c90b294f4dfee8bdce40005d99f0e86de80a93b39"}
Jul 06 12:22:52.882015 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.881936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvfkg" event={"ID":"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b","Type":"ContainerStarted","Data":"1046299b3312bafadb4ea51fef3a41c21120009423a0deb8b93c477cbe5c2506"}
Jul 06 12:22:52.887151 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.887115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dl7bs" event={"ID":"f934459a-a37f-4d23-b84b-1b6867a54ac6","Type":"ContainerStarted","Data":"a5408d4544fb797d258d202214c90053aeb06b3b6a66b2ada75eadefde61b617"}
Jul 06 12:22:52.904186 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.904149    2570 generic.go:356] "Generic (PLEG): container finished" podID="25373cbf82a4aba048f77db79b4eb056" containerID="73ceb4622e57a9698846896885c56ec33198ecce9ea892a573af65a0100325c1" exitCode=0
Jul 06 12:22:52.904381 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.904237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"25373cbf82a4aba048f77db79b4eb056","Type":"ContainerDied","Data":"73ceb4622e57a9698846896885c56ec33198ecce9ea892a573af65a0100325c1"}
Jul 06 12:22:52.923982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.923940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" event={"ID":"574c7dd2fe0232ed5ac86b87d67e74b7","Type":"ContainerStarted","Data":"f43f19791e46fd3fa217403bd07bf07de5363b8dbb8aabac0f4363ebe0f961ca"}
Jul 06 12:22:52.936105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.936071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lpm7k" event={"ID":"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07","Type":"ContainerStarted","Data":"c8b43af6c048ec68da62dc6cad8396a8141152db9697193e637119747c43f15b"}
Jul 06 12:22:52.939286 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:52.939235    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg" event={"ID":"d95b43b4-b8c3-4160-8bc9-0f9198017d57","Type":"ContainerStarted","Data":"314332452cb7f603bb2cf4c59679952f315133ba773d7d9f2ef525014256b575"}
Jul 06 12:22:53.809265 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:53.808760    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:53.809265 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:53.808893    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:22:53.971277 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:53.970777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"25373cbf82a4aba048f77db79b4eb056","Type":"ContainerStarted","Data":"81f56c59c8d558113e39c583506517dc82944d363ea47a4b7b059807328aa17e"}
Jul 06 12:22:53.990794 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:53.990693    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" podStartSLOduration=3.990673235 podStartE2EDuration="3.990673235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:52.946600146 +0000 UTC m=+4.642304811" watchObservedRunningTime="2026-07-06 12:22:53.990673235 +0000 UTC m=+5.686377883"
Jul 06 12:22:53.991081 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:53.991043    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" podStartSLOduration=3.991033448 podStartE2EDuration="3.991033448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:53.989905429 +0000 UTC m=+5.685610083" watchObservedRunningTime="2026-07-06 12:22:53.991033448 +0000 UTC m=+5.686738095"
Jul 06 12:22:54.359700 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:54.359658    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:54.359889 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:54.359727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:54.359956 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.359890    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:54.359956 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.359954    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:58.359935542 +0000 UTC m=+10.055640174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:54.360428 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.360406    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:54.360534 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.360464    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:22:58.360446958 +0000 UTC m=+10.056151586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:54.561272 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:54.561230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:54.561490 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.561420    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:54.561490 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.561441    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:54.561490 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.561453    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:54.561656 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.561517    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:58.561496926 +0000 UTC m=+10.257201571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:54.810211 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:54.809477    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:54.810211 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.809632    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:22:54.810211 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:54.810001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:54.810211 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:54.810097    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:22:55.809198 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:55.809166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:55.809435 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:55.809293    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:22:56.809042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:56.809010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:56.809483 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:56.809157    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:22:56.809483 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:56.809251    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:56.809483 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:56.809409    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:22:57.808158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:57.808095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:57.808365 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:57.808229    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:22:58.391957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:58.391911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:58.392435 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:58.391970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:58.392435 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.392113    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:58.392435 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.392168    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.392151196 +0000 UTC m=+18.087855824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:58.392435 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.392423    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:58.392664 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.392473    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.392458289 +0000 UTC m=+18.088162928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:58.593902 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:58.593853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:58.594091 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.594055    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:58.594091 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.594084    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:58.594215 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.594099    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:58.594215 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.594160    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.594141714 +0000 UTC m=+18.289846361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:58.809179 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:58.809102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:22:58.809350 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.809231    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:22:58.809350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:58.809326    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:22:58.809459 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:58.809404    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:22:59.808832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:22:59.808796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:22:59.809702 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:22:59.808942    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:00.808818 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:00.808479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:00.808818 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:00.808479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:00.808818 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:00.808645    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:00.808818 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:00.808750    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:01.808591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:01.808541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:01.808794 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:01.808681    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:02.808598 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:02.808565    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:02.808992 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:02.808701    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:02.808992 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:02.808762    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:02.808992 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:02.808873    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:03.808540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:03.808507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:03.808727 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:03.808615    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:04.808540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:04.808513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:04.808717 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:04.808640    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:04.808781 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:04.808723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:04.809090 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:04.808827    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:05.809028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:05.808991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:05.809504 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:05.809135    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:06.457399 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:06.457358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:06.457589 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:06.457420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:06.457589 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.457513    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:06.457589 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.457519    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:06.457589 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.457563    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:22.457543954 +0000 UTC m=+34.153248582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:06.457811 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.457633    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:23:22.457619168 +0000 UTC m=+34.153323803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:06.658564 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:06.658536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:06.658755 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.658735    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:23:06.658826 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.658762    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:23:06.658826 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.658775    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:06.658925 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.658834    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:22.658815585 +0000 UTC m=+34.354520216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:06.808892 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:06.808808    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:06.809050 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:06.808821    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:06.809050 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.808928    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:06.809050 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:06.808970    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:07.808921 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:07.808884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:07.809078 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:07.809021    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:08.809861 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:08.809822    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:08.810408 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:08.809913    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:08.810408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:08.809994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:08.810408 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:08.810075    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:09.808236 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:09.808199    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:09.808419 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:09.808355    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:10.809569 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:10.809103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:10.809569 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:10.809236    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:10.810036 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:10.809686    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:10.810036 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:10.809773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:11.012800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.012508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgxxq" event={"ID":"06b0c17c-7475-4f10-8ed8-045b11381fe4","Type":"ContainerStarted","Data":"3a3bf1d8991c89e499b6e341fef0c3ef4cf61c8926b41c5d972c39b24f0726a2"}
Jul 06 12:23:11.014323 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.014273    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mslb8" event={"ID":"e660f6ad-0357-4bcc-bec3-81f3c3a53865","Type":"ContainerStarted","Data":"c566c1ecd37c409add8e2016a32ae1b7d664096b0f44d3416f8813d04b978e12"}
Jul 06 12:23:11.015619 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.015591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dl7bs" event={"ID":"f934459a-a37f-4d23-b84b-1b6867a54ac6","Type":"ContainerStarted","Data":"2e0d8e8a56ee849b129d8753e9c3d41a2b3a5f3c045d2f126709dd402a49c3a1"}
Jul 06 12:23:11.017496 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.017436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lpm7k" event={"ID":"951f2af3-cc24-4d6a-a0c3-cb15aeaf0e07","Type":"ContainerStarted","Data":"5132678232f38873b9b7687217b22b7f2db3cd8222784196d2472a5be6aacf9d"}
Jul 06 12:23:11.019260 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.019232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg" event={"ID":"d95b43b4-b8c3-4160-8bc9-0f9198017d57","Type":"ContainerStarted","Data":"ccbf5f65088e7f41b4a236f5abfcd6a7854f07f36de6a10add3bac4a013e34e8"}
Jul 06 12:23:11.020875 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.020846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqkrs" event={"ID":"8fb822e6-1871-4a32-a722-b1e505f9c252","Type":"ContainerStarted","Data":"df34805c41599151a7b5018b929d5ce80659be9396f86adf748f7e3debf92b6a"}
Jul 06 12:23:11.022351 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.022294    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="9725de234870172615630058d69b158a62f416ddd63e29ca7f8ce58c9d87f39f" exitCode=0
Jul 06 12:23:11.022419 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.022405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"9725de234870172615630058d69b158a62f416ddd63e29ca7f8ce58c9d87f39f"}
Jul 06 12:23:11.024909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.024886    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"adc9006ffff8fdca147b0eddea633bb978059ebd41e24544b58de23073eca571"}
Jul 06 12:23:11.024995 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.024964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"751fcb1509b7f35100f5cd512df1a5c027d8c93894de3c49bb64dc9b5836e0ce"}
Jul 06 12:23:11.091743 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.091663    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mslb8" podStartSLOduration=3.373320015 podStartE2EDuration="22.091639486s" totalImagesPullingTime="18.718319471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:11.050028465 +0000 UTC m=+22.745733114" watchObservedRunningTime="2026-07-06 12:23:11.091639486 +0000 UTC m=+22.787344137"
Jul 06 12:23:11.166279 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.166234    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dl7bs" podStartSLOduration=3.383670692 podStartE2EDuration="22.166218027s" totalImagesPullingTime="18.782547335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:11.135859582 +0000 UTC m=+22.831564244" watchObservedRunningTime="2026-07-06 12:23:11.166218027 +0000 UTC m=+22.861922679"
Jul 06 12:23:11.205579 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.205535    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lpm7k" podStartSLOduration=3.47215438 podStartE2EDuration="22.205517805s" totalImagesPullingTime="18.733363425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:11.205207199 +0000 UTC m=+22.900911847" watchObservedRunningTime="2026-07-06 12:23:11.205517805 +0000 UTC m=+22.901222454"
Jul 06 12:23:11.205703 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.205660    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gqkrs" podStartSLOduration=3.495911891 podStartE2EDuration="22.205652549s" totalImagesPullingTime="18.709740658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:11.166841765 +0000 UTC m=+22.862546414" watchObservedRunningTime="2026-07-06 12:23:11.205652549 +0000 UTC m=+22.901357198"
Jul 06 12:23:11.241840 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.241799    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pgxxq" podStartSLOduration=7.362645023 podStartE2EDuration="22.241783003s" totalImagesPullingTime="14.87913798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:11.241663933 +0000 UTC m=+22.937368594" watchObservedRunningTime="2026-07-06 12:23:11.241783003 +0000 UTC m=+22.937487651"
Jul 06 12:23:11.808518 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:11.808486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:11.808667 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:11.808588    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:12.031118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.031081    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"c9fff09cbc3f64132b2aa07dba667b279adcaf1a3d4984416df0b39b9eb3c1e2"}
Jul 06 12:23:12.031909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.031175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"2a5eb1ea077a5641f67d31707e594ccff59d7a6c8dca6ab66e7e2373e62ff7e0"}
Jul 06 12:23:12.031909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.031230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"ecd15d85639ac67a88140b297344ffaca32cc0017b94c7d0d027d8925b96b5e9"}
Jul 06 12:23:12.031909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.031277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"aae01b34f612ac8b6a811de7e3b824f8fddc720d4420cb994c8374002ef50a43"}
Jul 06 12:23:12.102149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.102063    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 12:23:12.779908 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.779808    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:23:12.102083112Z","UUID":"cc40e19c-9267-416f-9f1d-6b6cdebefba2","Handler":null,"Name":"","Endpoint":""}
Jul 06 12:23:12.782375 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.782352    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 12:23:12.782521 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.782395    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 12:23:12.808649 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.808572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:12.808836 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:12.808714    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:12.808912 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:12.808835    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:12.808969 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:12.808949    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:13.025492 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.025445    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:23:13.026206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.026184    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:23:13.035220 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.035154    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvfkg" event={"ID":"a3bcc3a5-7169-41c8-b42f-5e9f909ad53b","Type":"ContainerStarted","Data":"99029510b11c0946443f6cfe7eb0c485bfb515fb3518e3513033f1b5e1e74dbd"}
Jul 06 12:23:13.036986 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.036961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg" event={"ID":"d95b43b4-b8c3-4160-8bc9-0f9198017d57","Type":"ContainerStarted","Data":"10d9fa5b4c0f44c529e43c620b144e7c465b1d81ae1c2ced755e322a5db9b49e"}
Jul 06 12:23:13.037236 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.037223    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:23:13.037627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.037615    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pgxxq"
Jul 06 12:23:13.072164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.072106    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hvfkg" podStartSLOduration=5.352445411 podStartE2EDuration="24.072085378s" totalImagesPullingTime="18.719639967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:13.071689033 +0000 UTC m=+24.767393682" watchObservedRunningTime="2026-07-06 12:23:13.072085378 +0000 UTC m=+24.767790029"
Jul 06 12:23:13.808769 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:13.808730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:13.808938 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:13.808861    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:14.045426 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:14.045340    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"bae83fe29f75d71cf676fb430c4ae58e7b6aa3667e6a3ebcd21a44eb281d76c7"}
Jul 06 12:23:14.047664 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:14.047637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg" event={"ID":"d95b43b4-b8c3-4160-8bc9-0f9198017d57","Type":"ContainerStarted","Data":"5231c88adef7ebfb5d3f3c6d05d0b1cc2d7e4fb41d04c30eef6d8dffed283581"}
Jul 06 12:23:14.069575 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:14.069531    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-54jsg" podStartSLOduration=4.252314778 podStartE2EDuration="25.069516992s" totalImagesPullingTime="20.817202214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:14.069062341 +0000 UTC m=+25.764766999" watchObservedRunningTime="2026-07-06 12:23:14.069516992 +0000 UTC m=+25.765221641"
Jul 06 12:23:14.808609 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:14.808387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:14.808836 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:14.808429    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:14.808836 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:14.808734    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:14.808836 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:14.808791    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:15.808976 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:15.808939    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:15.809576 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:15.809072    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:16.808614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:16.808266    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:16.808761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:16.808288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:16.808761 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:16.808671    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:16.808761 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:16.808694    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:17.055467 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.055435    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="1b35b54810cb5d66a2ea8924bd38922d7d44f9b075ccaac182594da70da87faf" exitCode=0
Jul 06 12:23:17.056345 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.055519    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"1b35b54810cb5d66a2ea8924bd38922d7d44f9b075ccaac182594da70da87faf"}
Jul 06 12:23:17.061858 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.061830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" event={"ID":"8f028b3d-cec6-495a-824b-992286d19624","Type":"ContainerStarted","Data":"6f72db99abc5f8a6c64f6b6629b34fd62459db73ded545fc61de84ab2317568b"}
Jul 06 12:23:17.062101 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.062072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:17.062225 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.062150    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:17.077289 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.077265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:17.077459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.077413    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:17.808164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:17.808129    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:17.808414 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:17.808254    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:18.064758 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.064690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:18.808881 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.808842    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:18.809064 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:18.808951    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:18.809064 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.809052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:18.809192 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:18.809169    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:18.906400 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.906348    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm" podStartSLOduration=11.132222786 podStartE2EDuration="29.906327388s" totalImagesPullingTime="18.774104602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:17.147745529 +0000 UTC m=+28.843450175" watchObservedRunningTime="2026-07-06 12:23:18.906327388 +0000 UTC m=+30.602032028"
Jul 06 12:23:18.906576 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.906541    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8smbn"]
Jul 06 12:23:18.910339 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.910296    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmf54"]
Jul 06 12:23:18.910458 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.910412    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:18.910508 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:18.910491    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:18.923823 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:18.923744    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kjc4"]
Jul 06 12:23:19.068792 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:19.068760    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="e960fbb59199156a429a3f72e56ba17c4d6ffca9ee2b9827cdae2a7bb33ab47d" exitCode=0
Jul 06 12:23:19.069224 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:19.068868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:19.069224 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:19.068869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"e960fbb59199156a429a3f72e56ba17c4d6ffca9ee2b9827cdae2a7bb33ab47d"}
Jul 06 12:23:19.069224 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:19.068994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:19.069224 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:19.069132    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:19.069513 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:19.069489    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:20.809412 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:20.809167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:20.809964 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:20.809167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:20.809964 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:20.809428    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:20.809964 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:20.809177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:20.809964 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:20.809524    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:20.809964 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:20.809565    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:21.074995 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:21.074920    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="96f8f59e6a38c8d04d81b1f087ac3cb1af4f910bdb2fa574527e81f53c29db89" exitCode=0
Jul 06 12:23:21.074995 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:21.074981    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"96f8f59e6a38c8d04d81b1f087ac3cb1af4f910bdb2fa574527e81f53c29db89"}
Jul 06 12:23:22.470110 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.470061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:22.470625 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.470127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:22.470625 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.470256    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:22.470625 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.470292    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:22.470625 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.470335    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.470303061 +0000 UTC m=+66.166007701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:22.470625 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.470366    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret podName:3ebed58a-1507-4958-9ab0-3d4d060ac15e nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.470349375 +0000 UTC m=+66.166054011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret") pod "global-pull-secret-syncer-tmf54" (UID: "3ebed58a-1507-4958-9ab0-3d4d060ac15e") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:22.671801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.671770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:22.671974 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.671915    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:23:22.671974 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.671930    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:23:22.671974 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.671941    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ng7ch for pod openshift-network-diagnostics/network-check-target-8smbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:22.672101 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.671998    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch podName:be1b8c2e-8207-452d-bc0f-56b1d250a863 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.671980141 +0000 UTC m=+66.367684767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng7ch" (UniqueName: "kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch") pod "network-check-target-8smbn" (UID: "be1b8c2e-8207-452d-bc0f-56b1d250a863") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:22.815041 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.814503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:22.815041 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.814640    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kjc4" podUID="127220d7-daa6-4a56-8dd2-cc0c7003ca33"
Jul 06 12:23:22.815041 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.814993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:22.815300 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.815080    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smbn" podUID="be1b8c2e-8207-452d-bc0f-56b1d250a863"
Jul 06 12:23:22.815300 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:22.815126    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:22.815300 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:22.815182    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmf54" podUID="3ebed58a-1507-4958-9ab0-3d4d060ac15e"
Jul 06 12:23:23.612427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.612346    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeReady"
Jul 06 12:23:23.612971 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.612478    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 12:23:23.661577 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.661546    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wqrhw"]
Jul 06 12:23:23.663404 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.663385    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.666475 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.666457    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 12:23:23.667079 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.667065    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gt55k\""
Jul 06 12:23:23.667924 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.667909    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 12:23:23.673680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.673660    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gmwlr"]
Jul 06 12:23:23.675571 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.675549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.676455 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.676436    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqrhw"]
Jul 06 12:23:23.678405 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.678387    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 12:23:23.678647 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.678632    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 12:23:23.678704 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.678632    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ll78r\""
Jul 06 12:23:23.678704 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.678691    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 12:23:23.691961 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.691926    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gmwlr"]
Jul 06 12:23:23.781238 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrhpt\" (UniqueName: \"kubernetes.io/projected/9cc99336-1ed4-4704-9dd0-b8e68f207e31-kube-api-access-hrhpt\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.781441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.781441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qplr\" (UniqueName: \"kubernetes.io/projected/13e78e7a-1991-4f70-ad83-e9281b51a7a9-kube-api-access-9qplr\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.781601 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc99336-1ed4-4704-9dd0-b8e68f207e31-cert\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.781669 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13e78e7a-1991-4f70-ad83-e9281b51a7a9-config-volume\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.781669 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.781641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e78e7a-1991-4f70-ad83-e9281b51a7a9-tmp-dir\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.882973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc99336-1ed4-4704-9dd0-b8e68f207e31-cert\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.883067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13e78e7a-1991-4f70-ad83-e9281b51a7a9-config-volume\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e78e7a-1991-4f70-ad83-e9281b51a7a9-tmp-dir\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrhpt\" (UniqueName: \"kubernetes.io/projected/9cc99336-1ed4-4704-9dd0-b8e68f207e31-kube-api-access-hrhpt\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.883282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qplr\" (UniqueName: \"kubernetes.io/projected/13e78e7a-1991-4f70-ad83-e9281b51a7a9-kube-api-access-9qplr\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883509 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:23.883381    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:23.883509 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:23.883448    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:24.383426788 +0000 UTC m=+36.079131421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:23.883687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883667    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13e78e7a-1991-4f70-ad83-e9281b51a7a9-config-volume\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.883894 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.883868    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e78e7a-1991-4f70-ad83-e9281b51a7a9-tmp-dir\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.887674 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.887654    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc99336-1ed4-4704-9dd0-b8e68f207e31-cert\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.894390 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.894366    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qplr\" (UniqueName: \"kubernetes.io/projected/13e78e7a-1991-4f70-ad83-e9281b51a7a9-kube-api-access-9qplr\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:23.894520 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.894499    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrhpt\" (UniqueName: \"kubernetes.io/projected/9cc99336-1ed4-4704-9dd0-b8e68f207e31-kube-api-access-hrhpt\") pod \"ingress-canary-gmwlr\" (UID: \"9cc99336-1ed4-4704-9dd0-b8e68f207e31\") " pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:23.984049 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:23.984011    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gmwlr"
Jul 06 12:23:24.387224 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.387191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:24.387414 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:24.387340    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:24.387414 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:24.387407    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:25.387390042 +0000 UTC m=+37.083094674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:24.812534 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.812461    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:24.812534 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.812506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:24.813118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.812566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:24.816200 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.816180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:23:24.817183 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.817163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5tqd\""
Jul 06 12:23:24.817502 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.817484    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:23:24.817591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.817562    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljjwj\""
Jul 06 12:23:24.817591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.817485    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:23:24.817591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:24.817488    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:23:25.394803 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:25.394773    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:25.394975 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:25.394915    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:25.395029 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:25.394975    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:27.394961576 +0000 UTC m=+39.090666202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:25.603251 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:25.603105    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gmwlr"]
Jul 06 12:23:25.606301 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:25.606274    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc99336_1ed4_4704_9dd0_b8e68f207e31.slice/crio-1eec4237c406a1780dd90cfc512128cc7d675eeef50c6401e48f50f3eb813049 WatchSource:0}: Error finding container 1eec4237c406a1780dd90cfc512128cc7d675eeef50c6401e48f50f3eb813049: Status 404 returned error can't find the container with id 1eec4237c406a1780dd90cfc512128cc7d675eeef50c6401e48f50f3eb813049
Jul 06 12:23:26.090384 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:26.090287    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="c357f4af49482684c51653035ec5cc8295a433e449e0d1d5d3ace2b77cf33a06" exitCode=0
Jul 06 12:23:26.090384 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:26.090346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"c357f4af49482684c51653035ec5cc8295a433e449e0d1d5d3ace2b77cf33a06"}
Jul 06 12:23:26.091848 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:26.091825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gmwlr" event={"ID":"9cc99336-1ed4-4704-9dd0-b8e68f207e31","Type":"ContainerStarted","Data":"1eec4237c406a1780dd90cfc512128cc7d675eeef50c6401e48f50f3eb813049"}
Jul 06 12:23:27.097395 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:27.097364    2570 generic.go:356] "Generic (PLEG): container finished" podID="13c4f86f-d5d4-43c8-84f5-18cbda5348dc" containerID="80de7deaa3fbc1ca75669ccb363305a2d36838f81b06244bb171500786676d66" exitCode=0
Jul 06 12:23:27.097801 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:27.097430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerDied","Data":"80de7deaa3fbc1ca75669ccb363305a2d36838f81b06244bb171500786676d66"}
Jul 06 12:23:27.410877 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:27.410782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:27.411039 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:27.410958    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:27.411039 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:27.411022    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:31.411006829 +0000 UTC m=+43.106711455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:28.101567 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:28.101478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gmwlr" event={"ID":"9cc99336-1ed4-4704-9dd0-b8e68f207e31","Type":"ContainerStarted","Data":"75b1f1d8a8717df5a67f583d238dad8d55b87e9d74aeb58aaa9f3d4a290f5810"}
Jul 06 12:23:28.108237 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:28.108197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" event={"ID":"13c4f86f-d5d4-43c8-84f5-18cbda5348dc","Type":"ContainerStarted","Data":"044dbb69adbe3006acb122b8c6a1b51dc28ca22747a883ca8632744ee5af489d"}
Jul 06 12:23:28.120018 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:28.119967    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gmwlr" podStartSLOduration=2.986565813 podStartE2EDuration="5.119954322s" totalImagesPullingTime="2.133388509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:28.119279373 +0000 UTC m=+39.814984022" watchObservedRunningTime="2026-07-06 12:23:28.119954322 +0000 UTC m=+39.815658970"
Jul 06 12:23:28.156045 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:28.156001    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h8gtb" podStartSLOduration=8.614633489 podStartE2EDuration="39.155985651s" totalImagesPullingTime="30.541352162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:28.153971461 +0000 UTC m=+39.849676110" watchObservedRunningTime="2026-07-06 12:23:28.155985651 +0000 UTC m=+39.851690294"
Jul 06 12:23:31.439069 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:31.439029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:31.439486 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:31.439177    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:31.439486 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:31.439241    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:39.439225868 +0000 UTC m=+51.134930498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:39.494292 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:39.494256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:39.494756 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:39.494406    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:39.494756 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:39.494463    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:55.494447164 +0000 UTC m=+67.190151796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:48.160867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.160834    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"]
Jul 06 12:23:48.163212 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.163195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"
Jul 06 12:23:48.168810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.168787    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"]
Jul 06 12:23:48.169451 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.169301    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.169451 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.169323    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.169451 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.169341    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-69g2q\""
Jul 06 12:23:48.170727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.170707    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.173651 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.173634    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 12:23:48.173735 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.173720    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.173834 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.173822    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wz995\""
Jul 06 12:23:48.174486 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.174470    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.174563 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.174512    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 12:23:48.181668 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.181652    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"]
Jul 06 12:23:48.196818 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.196797    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"]
Jul 06 12:23:48.276322 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.276249    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d5b4bc6b7-f2r4j"]
Jul 06 12:23:48.278128 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.278111    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.279591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.279561    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-lc7wz"]
Jul 06 12:23:48.281094 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.281080    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"]
Jul 06 12:23:48.281206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.281185    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.281263 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.281210    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.281796 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.281776    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 12:23:48.281898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.281802    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.282810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.282794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.283303 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.283287    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pbhzn\""
Jul 06 12:23:48.283402 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.283288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 12:23:48.283466 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.283340    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 12:23:48.288258 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.288241    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 12:23:48.288554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.288541    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 12:23:48.289117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.289098    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 12:23:48.289399 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.289385    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.289485 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.289388    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.289485 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.289391    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-26wgd\""
Jul 06 12:23:48.295347 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.295297    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 12:23:48.295347 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.295329    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.295726 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.295708    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qvqbh\""
Jul 06 12:23:48.298416 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.298396    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 12:23:48.301103 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.301086    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.310240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.310223    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-lc7wz"]
Jul 06 12:23:48.311603 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.311249    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"]
Jul 06 12:23:48.312152 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.312131    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5b4bc6b7-f2r4j"]
Jul 06 12:23:48.353233 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.353204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/168d96e6-f819-410d-a101-e632745625f0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.353403 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.353258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79xbk\" (UniqueName: \"kubernetes.io/projected/2b6adfc0-15c1-4879-a78c-f2fd1609b687-kube-api-access-79xbk\") pod \"volume-data-source-validator-5d456fdbcd-srbrk\" (UID: \"2b6adfc0-15c1-4879-a78c-f2fd1609b687\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"
Jul 06 12:23:48.353403 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.353280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/168d96e6-f819-410d-a101-e632745625f0-config\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.353403 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.353367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbft9\" (UniqueName: \"kubernetes.io/projected/168d96e6-f819-410d-a101-e632745625f0-kube-api-access-fbft9\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.453793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.453793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbft9\" (UniqueName: \"kubernetes.io/projected/168d96e6-f819-410d-a101-e632745625f0-kube-api-access-fbft9\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.453793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-default-certificate\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-tmp\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdrj\" (UniqueName: \"kubernetes.io/projected/1d7b9836-fa87-4812-9c59-e060a24f5ccf-kube-api-access-8mdrj\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6qw\" (UniqueName: \"kubernetes.io/projected/92f67bdd-acee-4b32-bc7d-101d0516aec8-kube-api-access-bx6qw\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.453998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-snapshots\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7b9836-fa87-4812-9c59-e060a24f5ccf-serving-cert\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/168d96e6-f819-410d-a101-e632745625f0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79xbk\" (UniqueName: \"kubernetes.io/projected/2b6adfc0-15c1-4879-a78c-f2fd1609b687-kube-api-access-79xbk\") pod \"volume-data-source-validator-5d456fdbcd-srbrk\" (UID: \"2b6adfc0-15c1-4879-a78c-f2fd1609b687\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-stats-auth\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6pj6\" (UniqueName: \"kubernetes.io/projected/334bea9f-de75-4f79-a6b9-364f5f7158cd-kube-api-access-v6pj6\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/168d96e6-f819-410d-a101-e632745625f0-config\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.454447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.454907 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.454887    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/168d96e6-f819-410d-a101-e632745625f0-config\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.457957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.457939    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/168d96e6-f819-410d-a101-e632745625f0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.466537 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.466518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbft9\" (UniqueName: \"kubernetes.io/projected/168d96e6-f819-410d-a101-e632745625f0-kube-api-access-fbft9\") pod \"service-ca-operator-5d46d9ffd4-qstdn\" (UID: \"168d96e6-f819-410d-a101-e632745625f0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.477365 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.477344    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79xbk\" (UniqueName: \"kubernetes.io/projected/2b6adfc0-15c1-4879-a78c-f2fd1609b687-kube-api-access-79xbk\") pod \"volume-data-source-validator-5d456fdbcd-srbrk\" (UID: \"2b6adfc0-15c1-4879-a78c-f2fd1609b687\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"
Jul 06 12:23:48.479149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.479130    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.554981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7b9836-fa87-4812-9c59-e060a24f5ccf-serving-cert\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-stats-auth\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6pj6\" (UniqueName: \"kubernetes.io/projected/334bea9f-de75-4f79-a6b9-364f5f7158cd-kube-api-access-v6pj6\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-default-certificate\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-tmp\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdrj\" (UniqueName: \"kubernetes.io/projected/1d7b9836-fa87-4812-9c59-e060a24f5ccf-kube-api-access-8mdrj\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6qw\" (UniqueName: \"kubernetes.io/projected/92f67bdd-acee-4b32-bc7d-101d0516aec8-kube-api-access-bx6qw\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.555438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-snapshots\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.557340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.556140    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-snapshots\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.558072 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.557776    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.558072 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.557997    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d7b9836-fa87-4812-9c59-e060a24f5ccf-tmp\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.559015 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:48.558912    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:49.058890358 +0000 UTC m=+60.754594989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:23:48.559015 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:48.558929    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:23:48.559015 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:48.558974    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:49.058963657 +0000 UTC m=+60.754668291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:23:48.559015 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:48.558974    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:23:48.559523 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.558969    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d7b9836-fa87-4812-9c59-e060a24f5ccf-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.559523 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:48.559041    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:49.059024635 +0000 UTC m=+60.754729277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:23:48.562414 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.562387    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-stats-auth\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.562761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.562740    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7b9836-fa87-4812-9c59-e060a24f5ccf-serving-cert\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.562837 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.562824    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-default-certificate\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.571767 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.571683    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6pj6\" (UniqueName: \"kubernetes.io/projected/334bea9f-de75-4f79-a6b9-364f5f7158cd-kube-api-access-v6pj6\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:48.580741 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.580716    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6qw\" (UniqueName: \"kubernetes.io/projected/92f67bdd-acee-4b32-bc7d-101d0516aec8-kube-api-access-bx6qw\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:48.580847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.580740    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdrj\" (UniqueName: \"kubernetes.io/projected/1d7b9836-fa87-4812-9c59-e060a24f5ccf-kube-api-access-8mdrj\") pod \"insights-operator-5c847dcfc4-lc7wz\" (UID: \"1d7b9836-fa87-4812-9c59-e060a24f5ccf\") " pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.595885 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.595862    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz"
Jul 06 12:23:48.626196 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.626042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn"]
Jul 06 12:23:48.628847 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:48.628817    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168d96e6_f819_410d_a101_e632745625f0.slice/crio-1bf259e30cef220f3c30c0abb89585f47c9928c543abc1a772eb1511755ce2b7 WatchSource:0}: Error finding container 1bf259e30cef220f3c30c0abb89585f47c9928c543abc1a772eb1511755ce2b7: Status 404 returned error can't find the container with id 1bf259e30cef220f3c30c0abb89585f47c9928c543abc1a772eb1511755ce2b7
Jul 06 12:23:48.757501 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.757478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-lc7wz"]
Jul 06 12:23:48.759189 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:48.759160    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7b9836_fa87_4812_9c59_e060a24f5ccf.slice/crio-89a5f7c3a7d3db4a5360f7a413c9c4170bd3273bb38f0bbf0c256b686a97b34c WatchSource:0}: Error finding container 89a5f7c3a7d3db4a5360f7a413c9c4170bd3273bb38f0bbf0c256b686a97b34c: Status 404 returned error can't find the container with id 89a5f7c3a7d3db4a5360f7a413c9c4170bd3273bb38f0bbf0c256b686a97b34c
Jul 06 12:23:48.775582 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.775560    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-69g2q\""
Jul 06 12:23:48.783094 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.783077    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"
Jul 06 12:23:48.923705 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:48.923674    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk"]
Jul 06 12:23:48.926535 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:48.926510    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6adfc0_15c1_4879_a78c_f2fd1609b687.slice/crio-7cac276703f99836e000f04fb897d129da4f558ba02c2021761a2a8f4fbbe75c WatchSource:0}: Error finding container 7cac276703f99836e000f04fb897d129da4f558ba02c2021761a2a8f4fbbe75c: Status 404 returned error can't find the container with id 7cac276703f99836e000f04fb897d129da4f558ba02c2021761a2a8f4fbbe75c
Jul 06 12:23:49.062291 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.062194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:49.062291 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.062242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.062298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:49.062352    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:49.062416    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:50.062400007 +0000 UTC m=+61.758104634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:49.062430    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:50.062424546 +0000 UTC m=+61.758129173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:49.062467    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:23:49.062502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:49.062507    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:50.062494158 +0000 UTC m=+61.758198784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:23:49.088989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.088967    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c9zm"
Jul 06 12:23:49.159714 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.159680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn" event={"ID":"168d96e6-f819-410d-a101-e632745625f0","Type":"ContainerStarted","Data":"1bf259e30cef220f3c30c0abb89585f47c9928c543abc1a772eb1511755ce2b7"}
Jul 06 12:23:49.160893 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.160865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk" event={"ID":"2b6adfc0-15c1-4879-a78c-f2fd1609b687","Type":"ContainerStarted","Data":"7cac276703f99836e000f04fb897d129da4f558ba02c2021761a2a8f4fbbe75c"}
Jul 06 12:23:49.162095 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:49.162068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz" event={"ID":"1d7b9836-fa87-4812-9c59-e060a24f5ccf","Type":"ContainerStarted","Data":"89a5f7c3a7d3db4a5360f7a413c9c4170bd3273bb38f0bbf0c256b686a97b34c"}
Jul 06 12:23:50.070423 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:50.070391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:50.070611 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:50.070438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:50.070611 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:50.070558    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:52.070537558 +0000 UTC m=+63.766242208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:23:50.070611 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:50.070560    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:23:50.070611 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:50.070605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:50.070785 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:50.070620    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:52.070605268 +0000 UTC m=+63.766309895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:23:50.070785 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:50.070671    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:23:50.070785 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:50.070709    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:52.070698303 +0000 UTC m=+63.766402934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:23:52.087334 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.087289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.087382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.087402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.087468    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.087511    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.087498322 +0000 UTC m=+67.783202949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.087536    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.087519005 +0000 UTC m=+67.783223635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.087537    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:23:52.087757 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.087597    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.087582595 +0000 UTC m=+67.783287222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:23:52.170907 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.170866    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk" event={"ID":"2b6adfc0-15c1-4879-a78c-f2fd1609b687","Type":"ContainerStarted","Data":"bf394adb0d213f367fb8099c28ce581db31c44e039528c97c547838a7be5e5bb"}
Jul 06 12:23:52.172439 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.172406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz" event={"ID":"1d7b9836-fa87-4812-9c59-e060a24f5ccf","Type":"ContainerStarted","Data":"d9ce431a7b04898f9b78e8bc7d538c8257a030003a15953eaf530502af6b7e0a"}
Jul 06 12:23:52.173800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.173775    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn" event={"ID":"168d96e6-f819-410d-a101-e632745625f0","Type":"ContainerStarted","Data":"4f2305182cb3ae8d43edc38eb38c0a998cfa33d7295d40fdeb9c6822743795e9"}
Jul 06 12:23:52.189831 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.189787    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-srbrk" podStartSLOduration=1.685599801 podStartE2EDuration="4.189768453s" totalImagesPullingTime="2.504168652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:52.189354891 +0000 UTC m=+63.885059539" watchObservedRunningTime="2026-07-06 12:23:52.189768453 +0000 UTC m=+63.885473102"
Jul 06 12:23:52.208472 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.208408    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn" podStartSLOduration=1.398689169 podStartE2EDuration="4.208386713s" totalImagesPullingTime="2.809697544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:52.206981134 +0000 UTC m=+63.902685782" watchObservedRunningTime="2026-07-06 12:23:52.208386713 +0000 UTC m=+63.904091363"
Jul 06 12:23:52.227953 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.227893    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz" podStartSLOduration=1.547840174 podStartE2EDuration="4.227877846s" totalImagesPullingTime="2.680037672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:52.226399763 +0000 UTC m=+63.922104412" watchObservedRunningTime="2026-07-06 12:23:52.227877846 +0000 UTC m=+63.923582497"
Jul 06 12:23:52.470196 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.470122    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9r8g8"]
Jul 06 12:23:52.472446 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.472422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.475488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.475467    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 12:23:52.475595 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.475467    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zwn2\""
Jul 06 12:23:52.475595 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.475579    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 12:23:52.491122 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.491093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.491258 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.491133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17687b5e-4402-4fc1-ba6f-ab7363b87466-data-volume\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.491258 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.491172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17687b5e-4402-4fc1-ba6f-ab7363b87466-crio-socket\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.491366 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.491304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.491409 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.491393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78fr\" (UniqueName: \"kubernetes.io/projected/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-api-access-l78fr\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.496022 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.496002    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9r8g8"]
Jul 06 12:23:52.591723 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.591723 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17687b5e-4402-4fc1-ba6f-ab7363b87466-data-volume\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.591927 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591749    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17687b5e-4402-4fc1-ba6f-ab7363b87466-crio-socket\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.591927 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.591816    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:52.591927 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.591885    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:53.091868329 +0000 UTC m=+64.787572975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:52.591927 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591899    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17687b5e-4402-4fc1-ba6f-ab7363b87466-crio-socket\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.591927 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.592158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.591953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78fr\" (UniqueName: \"kubernetes.io/projected/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-api-access-l78fr\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.592158 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.591992    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:52.592158 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:52.592038    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:53.092025518 +0000 UTC m=+64.787730145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:52.592158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.592046    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17687b5e-4402-4fc1-ba6f-ab7363b87466-data-volume\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:52.600711 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:52.600689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78fr\" (UniqueName: \"kubernetes.io/projected/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-api-access-l78fr\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:53.096968 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:53.096933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:53.097388 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:53.097042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:53.097388 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:53.097060    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:53.097388 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:53.097133    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:53.097388 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:53.097143    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.097125254 +0000 UTC m=+65.792829881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:53.097388 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:53.097172    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.097160973 +0000 UTC m=+65.792865600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:54.105638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.105603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:54.106190 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.105658    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:54.106190 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.105726    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:54.106190 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.105749    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:54.106190 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.105807    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.105791167 +0000 UTC m=+67.801495815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:54.106190 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.105824    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.105816308 +0000 UTC m=+67.801520936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:54.433063 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.432988    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqkrs_8fb822e6-1871-4a32-a722-b1e505f9c252/dns-node-resolver/0.log"
Jul 06 12:23:54.508876 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.508847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:54.509027 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.508888    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:23:54.511426 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.511405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:23:54.511502 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.511473    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:23:54.519526 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.519508    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 12:23:54.519628 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:54.519560    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs podName:127220d7-daa6-4a56-8dd2-cc0c7003ca33 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:58.519543987 +0000 UTC m=+130.215248614 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs") pod "network-metrics-daemon-4kjc4" (UID: "127220d7-daa6-4a56-8dd2-cc0c7003ca33") : secret "metrics-daemon-secret" not found
Jul 06 12:23:54.521488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.521468    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ebed58a-1507-4958-9ab0-3d4d060ac15e-original-pull-secret\") pod \"global-pull-secret-syncer-tmf54\" (UID: \"3ebed58a-1507-4958-9ab0-3d4d060ac15e\") " pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:54.537772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.537753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmf54"
Jul 06 12:23:54.656149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.656087    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmf54"]
Jul 06 12:23:54.659934 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:54.659903    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebed58a_1507_4958_9ab0_3d4d060ac15e.slice/crio-5bcfaad1216a4385b435c87d146679b8a1c4f415ce3f2f4f30489b50a709eb67 WatchSource:0}: Error finding container 5bcfaad1216a4385b435c87d146679b8a1c4f415ce3f2f4f30489b50a709eb67: Status 404 returned error can't find the container with id 5bcfaad1216a4385b435c87d146679b8a1c4f415ce3f2f4f30489b50a709eb67
Jul 06 12:23:54.710043 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.709981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:54.712523 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.712507    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:23:54.722731 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.722707    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:23:54.732999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.732973    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng7ch\" (UniqueName: \"kubernetes.io/projected/be1b8c2e-8207-452d-bc0f-56b1d250a863-kube-api-access-ng7ch\") pod \"network-check-target-8smbn\" (UID: \"be1b8c2e-8207-452d-bc0f-56b1d250a863\") " pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:54.825793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.825763    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljjwj\""
Jul 06 12:23:54.834585 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.834552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:23:54.964092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:54.964027    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8smbn"]
Jul 06 12:23:54.967065 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:23:54.967043    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1b8c2e_8207_452d_bc0f_56b1d250a863.slice/crio-198c2362644dc58180f446fb110ea5a7438a6d51268a978f486578509f0684ae WatchSource:0}: Error finding container 198c2362644dc58180f446fb110ea5a7438a6d51268a978f486578509f0684ae: Status 404 returned error can't find the container with id 198c2362644dc58180f446fb110ea5a7438a6d51268a978f486578509f0684ae
Jul 06 12:23:55.183104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:55.183068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmf54" event={"ID":"3ebed58a-1507-4958-9ab0-3d4d060ac15e","Type":"ContainerStarted","Data":"5bcfaad1216a4385b435c87d146679b8a1c4f415ce3f2f4f30489b50a709eb67"}
Jul 06 12:23:55.184464 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:55.184431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8smbn" event={"ID":"be1b8c2e-8207-452d-bc0f-56b1d250a863","Type":"ContainerStarted","Data":"198c2362644dc58180f446fb110ea5a7438a6d51268a978f486578509f0684ae"}
Jul 06 12:23:55.434932 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:55.434903    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mslb8_e660f6ad-0357-4bcc-bec3-81f3c3a53865/node-ca/0.log"
Jul 06 12:23:55.516985 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:55.516948    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:23:55.517160 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:55.517145    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:55.517235 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:55.517220    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls podName:13e78e7a-1991-4f70-ad83-e9281b51a7a9 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:27.517201521 +0000 UTC m=+99.212906151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls") pod "dns-default-wqrhw" (UID: "13e78e7a-1991-4f70-ad83-e9281b51a7a9") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:56.038716 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.038675    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gmwlr_9cc99336-1ed4-4704-9dd0-b8e68f207e31/serve-healthcheck-canary/0.log"
Jul 06 12:23:56.122227 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.122198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:56.122427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.122269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:56.122427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.122300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:23:56.122427 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122339    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:56.122427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.122366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:23:56.122427 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122404    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:00.122384315 +0000 UTC m=+71.818088963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:23:56.122432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122453    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122492    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:04.122480737 +0000 UTC m=+75.818185366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122544    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:24:04.122535675 +0000 UTC m=+75.818240302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122592    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122658    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:24:04.122640873 +0000 UTC m=+75.818345524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122679    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:56.122751 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:23:56.122718    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:00.122706941 +0000 UTC m=+71.818411571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:00.160797 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.160735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:00.160797 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.160814    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:00.161241 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:00.160884    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:24:00.161241 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:00.160886    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:00.161241 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:00.160935    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:08.160920988 +0000 UTC m=+79.856625615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : configmap "kube-rbac-proxy" not found
Jul 06 12:24:00.161241 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:00.160948    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:08.160941641 +0000 UTC m=+79.856646268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:00.199641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.199605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmf54" event={"ID":"3ebed58a-1507-4958-9ab0-3d4d060ac15e","Type":"ContainerStarted","Data":"bf17e3a629cd6370db48f9bbdb765a0e6717db9962e744e20700079f5dd1c70e"}
Jul 06 12:24:00.201016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.200994    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8smbn" event={"ID":"be1b8c2e-8207-452d-bc0f-56b1d250a863","Type":"ContainerStarted","Data":"e03388963c7035e5ccae907d0a76b9ce9c6f64cab0cfd1b1ebb0ec1f46ceb5bb"}
Jul 06 12:24:00.201135 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.201109    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:24:00.227832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.227782    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tmf54" podStartSLOduration=66.372400603 podStartE2EDuration="1m11.227761153s" totalImagesPullingTime="4.85536055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:00.22646517 +0000 UTC m=+71.922169819" watchObservedRunningTime="2026-07-06 12:24:00.227761153 +0000 UTC m=+71.923465802"
Jul 06 12:24:00.259359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:00.259280    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8smbn" podStartSLOduration=66.711194765 podStartE2EDuration="1m11.259262853s" totalImagesPullingTime="4.548068088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:00.258739604 +0000 UTC m=+71.954444250" watchObservedRunningTime="2026-07-06 12:24:00.259262853 +0000 UTC m=+71.954967541"
Jul 06 12:24:04.196471 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:04.196421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:04.196471 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:04.196474    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:04.196563    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:04.196574    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:24:20.196557276 +0000 UTC m=+91.892261903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : configmap references non-existent config key: service-ca.crt
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:04.196652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:04.196714    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs podName:334bea9f-de75-4f79-a6b9-364f5f7158cd nodeName:}" failed. No retries permitted until 2026-07-06 12:24:20.196696145 +0000 UTC m=+91.892400773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs") pod "router-default-6d5b4bc6b7-f2r4j" (UID: "334bea9f-de75-4f79-a6b9-364f5f7158cd") : secret "router-metrics-certs-default" not found
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:04.196732    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:24:04.196901 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:04.196764    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls podName:92f67bdd-acee-4b32-bc7d-101d0516aec8 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:20.196753559 +0000 UTC m=+91.892458185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8lmn5" (UID: "92f67bdd-acee-4b32-bc7d-101d0516aec8") : secret "samples-operator-tls" not found
Jul 06 12:24:08.230448 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:08.230414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:08.230856 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:08.230460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:08.230856 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:08.230567    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:08.230856 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:08.230628    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls podName:17687b5e-4402-4fc1-ba6f-ab7363b87466 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:24.230614626 +0000 UTC m=+95.926319253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9r8g8" (UID: "17687b5e-4402-4fc1-ba6f-ab7363b87466") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:08.230994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:08.230972    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17687b5e-4402-4fc1-ba6f-ab7363b87466-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:16.812532 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.812429    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"]
Jul 06 12:24:16.816897 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.816877    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:16.820093 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.820073    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 12:24:16.823189 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.822939    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 12:24:16.823947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.823928    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 12:24:16.824059 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.823932    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 12:24:16.844254 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.844232    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"]
Jul 06 12:24:16.904169 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.904132    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:16.904169 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.904168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67zf\" (UniqueName: \"kubernetes.io/projected/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-kube-api-access-b67zf\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:16.904411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.904195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-tmp\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:16.918419 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.918394    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6795764c4f-b2gld"]
Jul 06 12:24:16.921426 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.921406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:16.927196 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.927173    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mnq4l\""
Jul 06 12:24:16.928299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.927799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 12:24:16.928299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.927872    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 12:24:16.931327 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.930199    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 12:24:16.942417 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.942393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 12:24:16.942928 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:16.942909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6795764c4f-b2gld"]
Jul 06 12:24:17.005078 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-trusted-ca\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-certificates\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005105    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-bound-sa-token\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knw2r\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-kube-api-access-knw2r\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67zf\" (UniqueName: \"kubernetes.io/projected/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-kube-api-access-b67zf\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005303    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-tls\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-tmp\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0683c445-9879-4c79-9934-4b839d7a0cd1-ca-trust-extracted\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005421 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-installation-pull-secrets\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005668 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005426    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-image-registry-private-configuration\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.005746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.005730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-tmp\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.007668 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.007646    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.021363 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.021336    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67zf\" (UniqueName: \"kubernetes.io/projected/d19522fb-83ab-4950-8e36-7ff9d5e6c1e8-kube-api-access-b67zf\") pod \"klusterlet-addon-workmgr-c877b684-fkx27\" (UID: \"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.105914 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-installation-pull-secrets\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.105914 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-image-registry-private-configuration\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.105914 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105899    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-trusted-ca\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105926    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-certificates\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-bound-sa-token\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.105976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knw2r\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-kube-api-access-knw2r\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.106124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-tls\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106437 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.106219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0683c445-9879-4c79-9934-4b839d7a0cd1-ca-trust-extracted\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106648 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.106625    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0683c445-9879-4c79-9934-4b839d7a0cd1-ca-trust-extracted\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.106850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.106829    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-certificates\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.107086 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.107066    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0683c445-9879-4c79-9934-4b839d7a0cd1-trusted-ca\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.108332 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.108291    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-installation-pull-secrets\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.108429 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.108364    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0683c445-9879-4c79-9934-4b839d7a0cd1-image-registry-private-configuration\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.108488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.108471    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-registry-tls\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.126416 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.126396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:17.135948 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.135925    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knw2r\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-kube-api-access-knw2r\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.148184 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.148153    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0683c445-9879-4c79-9934-4b839d7a0cd1-bound-sa-token\") pod \"image-registry-6795764c4f-b2gld\" (UID: \"0683c445-9879-4c79-9934-4b839d7a0cd1\") " pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.232096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.232053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:17.272507 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.272472    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"]
Jul 06 12:24:17.276489 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:17.276453    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19522fb_83ab_4950_8e36_7ff9d5e6c1e8.slice/crio-012d082b26aab330ca0767e5e6affe9e28fdbb597c44c376d9193e041901094e WatchSource:0}: Error finding container 012d082b26aab330ca0767e5e6affe9e28fdbb597c44c376d9193e041901094e: Status 404 returned error can't find the container with id 012d082b26aab330ca0767e5e6affe9e28fdbb597c44c376d9193e041901094e
Jul 06 12:24:17.407279 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:17.407200    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6795764c4f-b2gld"]
Jul 06 12:24:17.411721 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:17.411693    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0683c445_9879_4c79_9934_4b839d7a0cd1.slice/crio-129279a58fda5e84a094abea99d579a36390e8a29ca5de2f5a7735bcc2f5ef04 WatchSource:0}: Error finding container 129279a58fda5e84a094abea99d579a36390e8a29ca5de2f5a7735bcc2f5ef04: Status 404 returned error can't find the container with id 129279a58fda5e84a094abea99d579a36390e8a29ca5de2f5a7735bcc2f5ef04
Jul 06 12:24:18.255821 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:18.255781    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6795764c4f-b2gld" event={"ID":"0683c445-9879-4c79-9934-4b839d7a0cd1","Type":"ContainerStarted","Data":"b914101c352f8d089b9a0ed88d1c51e8bd5f4594b36a9c33c12d0ef49d2cad1e"}
Jul 06 12:24:18.256295 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:18.255844    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6795764c4f-b2gld" event={"ID":"0683c445-9879-4c79-9934-4b839d7a0cd1","Type":"ContainerStarted","Data":"129279a58fda5e84a094abea99d579a36390e8a29ca5de2f5a7735bcc2f5ef04"}
Jul 06 12:24:18.256295 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:18.256141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:18.256995 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:18.256945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27" event={"ID":"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8","Type":"ContainerStarted","Data":"012d082b26aab330ca0767e5e6affe9e28fdbb597c44c376d9193e041901094e"}
Jul 06 12:24:18.313075 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:18.313015    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6795764c4f-b2gld" podStartSLOduration=2.3129951269999998 podStartE2EDuration="2.312995127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:18.311264229 +0000 UTC m=+90.006968904" watchObservedRunningTime="2026-07-06 12:24:18.312995127 +0000 UTC m=+90.008699776"
Jul 06 12:24:20.235891 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.235852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:20.236397 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.235902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:20.236397 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.235958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:24:20.236767 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.236711    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/334bea9f-de75-4f79-a6b9-364f5f7158cd-service-ca-bundle\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:20.238495 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.238471    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/334bea9f-de75-4f79-a6b9-364f5f7158cd-metrics-certs\") pod \"router-default-6d5b4bc6b7-f2r4j\" (UID: \"334bea9f-de75-4f79-a6b9-364f5f7158cd\") " pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:20.238675 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.238649    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f67bdd-acee-4b32-bc7d-101d0516aec8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8lmn5\" (UID: \"92f67bdd-acee-4b32-bc7d-101d0516aec8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:24:20.390702 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.390674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pbhzn\""
Jul 06 12:24:20.398040 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.397991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:20.404062 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.404038    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qvqbh\""
Jul 06 12:24:20.411562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.411538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"
Jul 06 12:24:20.889511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.889485    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5b4bc6b7-f2r4j"]
Jul 06 12:24:20.892360 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:20.892333    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334bea9f_de75_4f79_a6b9_364f5f7158cd.slice/crio-bc2c18999f08ac2bb7af883d62cda76b5a493b0b9caa30c49aa69edc71387c19 WatchSource:0}: Error finding container bc2c18999f08ac2bb7af883d62cda76b5a493b0b9caa30c49aa69edc71387c19: Status 404 returned error can't find the container with id bc2c18999f08ac2bb7af883d62cda76b5a493b0b9caa30c49aa69edc71387c19
Jul 06 12:24:20.901167 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:20.901144    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5"]
Jul 06 12:24:21.268465 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.268426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27" event={"ID":"d19522fb-83ab-4950-8e36-7ff9d5e6c1e8","Type":"ContainerStarted","Data":"9dfffadbaf7e450dd7f7ea37d01ef11ecf55daac061e450abab623b5d681c693"}
Jul 06 12:24:21.268945 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.268483    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:21.269690 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.269665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5" event={"ID":"92f67bdd-acee-4b32-bc7d-101d0516aec8","Type":"ContainerStarted","Data":"f409399f52db77ce5ad0a5fdb254ac04e96b524d8688413176ece4793a9864a2"}
Jul 06 12:24:21.270608 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.270588    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27"
Jul 06 12:24:21.271141 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.271125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j" event={"ID":"334bea9f-de75-4f79-a6b9-364f5f7158cd","Type":"ContainerStarted","Data":"9ef9f537430faa8a3feb0113f4041c3bdc807e73312c4e33468594b89da7b37d"}
Jul 06 12:24:21.271215 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.271152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j" event={"ID":"334bea9f-de75-4f79-a6b9-364f5f7158cd","Type":"ContainerStarted","Data":"bc2c18999f08ac2bb7af883d62cda76b5a493b0b9caa30c49aa69edc71387c19"}
Jul 06 12:24:21.286746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.286708    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c877b684-fkx27" podStartSLOduration=1.730350297 podStartE2EDuration="5.286695187s" totalImagesPullingTime="3.55634489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:21.285823725 +0000 UTC m=+92.981528375" watchObservedRunningTime="2026-07-06 12:24:21.286695187 +0000 UTC m=+92.982399863"
Jul 06 12:24:21.328120 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.328084    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j" podStartSLOduration=33.328071247 podStartE2EDuration="33.328071247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:21.326643988 +0000 UTC m=+93.022348637" watchObservedRunningTime="2026-07-06 12:24:21.328071247 +0000 UTC m=+93.023775895"
Jul 06 12:24:21.399086 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.399055    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:21.401547 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:21.401526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:22.274917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:22.274875    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:22.275977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:22.275959    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d5b4bc6b7-f2r4j"
Jul 06 12:24:23.279549 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:23.279514    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5" event={"ID":"92f67bdd-acee-4b32-bc7d-101d0516aec8","Type":"ContainerStarted","Data":"1a9d58f816b0257a1097f47b57e5dbc7099ea651755fd12849eb9642bfa070e5"}
Jul 06 12:24:23.280012 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:23.279576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5" event={"ID":"92f67bdd-acee-4b32-bc7d-101d0516aec8","Type":"ContainerStarted","Data":"9ab71d49035c73e1f19046aa4d06e7cc70f0e4c0ebbc8cc1faf664315fde8090"}
Jul 06 12:24:23.308216 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:23.308166    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8lmn5" podStartSLOduration=33.357622259 podStartE2EDuration="35.308149291s" totalImagesPullingTime="1.950527032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:23.307380079 +0000 UTC m=+95.003084725" watchObservedRunningTime="2026-07-06 12:24:23.308149291 +0000 UTC m=+95.003853941"
Jul 06 12:24:24.270431 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:24.270378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:24.272729 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:24.272708    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17687b5e-4402-4fc1-ba6f-ab7363b87466-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9r8g8\" (UID: \"17687b5e-4402-4fc1-ba6f-ab7363b87466\") " pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:24.281277 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:24.281258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9r8g8"
Jul 06 12:24:24.411466 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:24.411426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9r8g8"]
Jul 06 12:24:24.414198 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:24.414166    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17687b5e_4402_4fc1_ba6f_ab7363b87466.slice/crio-ef5d2647702238a8622c841bfe2772ec85a21c6e8b468dff36c6dd5062f88a3a WatchSource:0}: Error finding container ef5d2647702238a8622c841bfe2772ec85a21c6e8b468dff36c6dd5062f88a3a: Status 404 returned error can't find the container with id ef5d2647702238a8622c841bfe2772ec85a21c6e8b468dff36c6dd5062f88a3a
Jul 06 12:24:25.289444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:25.289406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9r8g8" event={"ID":"17687b5e-4402-4fc1-ba6f-ab7363b87466","Type":"ContainerStarted","Data":"ef5d2647702238a8622c841bfe2772ec85a21c6e8b468dff36c6dd5062f88a3a"}
Jul 06 12:24:27.597219 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:27.597181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:24:27.599952 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:27.599922    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e78e7a-1991-4f70-ad83-e9281b51a7a9-metrics-tls\") pod \"dns-default-wqrhw\" (UID: \"13e78e7a-1991-4f70-ad83-e9281b51a7a9\") " pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:24:27.876499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:27.876397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gt55k\""
Jul 06 12:24:27.882627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:27.882599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:24:28.258592 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:28.258567    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqrhw"]
Jul 06 12:24:28.262426 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:28.262395    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e78e7a_1991_4f70_ad83_e9281b51a7a9.slice/crio-e429dfad1b9d073ad4d0f8993ac777cb569b55b03954de563088c5a2df737bbc WatchSource:0}: Error finding container e429dfad1b9d073ad4d0f8993ac777cb569b55b03954de563088c5a2df737bbc: Status 404 returned error can't find the container with id e429dfad1b9d073ad4d0f8993ac777cb569b55b03954de563088c5a2df737bbc
Jul 06 12:24:28.301915 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:28.301884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9r8g8" event={"ID":"17687b5e-4402-4fc1-ba6f-ab7363b87466","Type":"ContainerStarted","Data":"2cf117cc067cac59ab569c444c737b3dac7d93a2aa7b7654063e1877bf350fa2"}
Jul 06 12:24:28.302867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:28.302847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrhw" event={"ID":"13e78e7a-1991-4f70-ad83-e9281b51a7a9","Type":"ContainerStarted","Data":"e429dfad1b9d073ad4d0f8993ac777cb569b55b03954de563088c5a2df737bbc"}
Jul 06 12:24:29.308861 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:29.308822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9r8g8" event={"ID":"17687b5e-4402-4fc1-ba6f-ab7363b87466","Type":"ContainerStarted","Data":"82a77f66b8062c2cef3c8d4874e8a5bca1debbb07651dace76cd4de86383e261"}
Jul 06 12:24:31.207938 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:31.207910    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8smbn"
Jul 06 12:24:32.321471 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.321433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrhw" event={"ID":"13e78e7a-1991-4f70-ad83-e9281b51a7a9","Type":"ContainerStarted","Data":"bb55223df984f5834e3537ea6277692eef6cdb2007733e5d1be0404849134c84"}
Jul 06 12:24:32.321973 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.321529    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:24:32.321973 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.321556    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrhw" event={"ID":"13e78e7a-1991-4f70-ad83-e9281b51a7a9","Type":"ContainerStarted","Data":"849c8f2d029180d2c03c569ff4f83604eedaa1b949ac7b6c7f7bb7eeaa7cbb50"}
Jul 06 12:24:32.323511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.323488    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9r8g8" event={"ID":"17687b5e-4402-4fc1-ba6f-ab7363b87466","Type":"ContainerStarted","Data":"ce3b696b5f5d344c0497b18654acd34701d9bab5cc52716dfa6f2bbde25ed3f5"}
Jul 06 12:24:32.348694 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.348646    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wqrhw" podStartSLOduration=66.142731867 podStartE2EDuration="1m9.348629661s" totalImagesPullingTime="3.205897794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:32.348055248 +0000 UTC m=+104.043759898" watchObservedRunningTime="2026-07-06 12:24:32.348629661 +0000 UTC m=+104.044334288"
Jul 06 12:24:32.369353 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.369277    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9r8g8" podStartSLOduration=33.468093805 podStartE2EDuration="40.369264784s" totalImagesPullingTime="6.901170979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:23:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:32.368654003 +0000 UTC m=+104.064358653" watchObservedRunningTime="2026-07-06 12:24:32.369264784 +0000 UTC m=+104.064969432"
Jul 06 12:24:32.556348 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.556302    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"]
Jul 06 12:24:32.577709 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.577636    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fsnjb"]
Jul 06 12:24:32.577955 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.577934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.583840 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.583814    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x5scv\""
Jul 06 12:24:32.584322 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.584292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 12:24:32.584440 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.584420    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 12:24:32.584524 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.584507    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 12:24:32.584728 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.584715    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 12:24:32.584810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.584795    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 12:24:32.603804 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.603768    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"]
Jul 06 12:24:32.603977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.603836    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"]
Jul 06 12:24:32.603977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.603892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.610141 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.610111    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 12:24:32.611104 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.611084    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 12:24:32.611185 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.611110    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 12:24:32.614852 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.614835    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9jcmc\""
Jul 06 12:24:32.627883 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.627860    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"]
Jul 06 12:24:32.628042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.627995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.634087 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.633842    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 12:24:32.634087 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.633968    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 12:24:32.634240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.634091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hss5l\""
Jul 06 12:24:32.634633 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.634619    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 12:24:32.740882 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.740841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.740882 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.740884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-wtmp\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.740944    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-metrics-client-ca\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.740979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcnbw\" (UniqueName: \"kubernetes.io/projected/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-api-access-hcnbw\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19979d37-f374-4a9a-b878-4df95dda2391-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psl9b\" (UniqueName: \"kubernetes.io/projected/15c2587a-108f-437b-a493-1da3fe656275-kube-api-access-psl9b\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-root\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-textfile\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741217    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqxq\" (UniqueName: \"kubernetes.io/projected/19979d37-f374-4a9a-b878-4df95dda2391-kube-api-access-7mqxq\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741362    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a38573a3-9470-4e29-afe0-c1e2649ca17d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.741641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-accelerators-collector-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741423    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-sys\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.741641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.741452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.842226 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-metrics-client-ca\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842226 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842226 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcnbw\" (UniqueName: \"kubernetes.io/projected/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-api-access-hcnbw\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.842542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19979d37-f374-4a9a-b878-4df95dda2391-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.842542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psl9b\" (UniqueName: \"kubernetes.io/projected/15c2587a-108f-437b-a493-1da3fe656275-kube-api-access-psl9b\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-root\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-textfile\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842760 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.842760 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.842760 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqxq\" (UniqueName: \"kubernetes.io/projected/19979d37-f374-4a9a-b878-4df95dda2391-kube-api-access-7mqxq\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842833    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-metrics-client-ca\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a38573a3-9470-4e29-afe0-c1e2649ca17d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842894    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-root\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.842917 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-accelerators-collector-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.843287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-sys\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.843287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.843287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.843287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.843005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-wtmp\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.843287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.843166    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-wtmp\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.843553 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.843459    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19979d37-f374-4a9a-b878-4df95dda2391-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.842900    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-textfile\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.843889    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.843981    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a38573a3-9470-4e29-afe0-c1e2649ca17d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:32.843983    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:32.844053    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls podName:19979d37-f374-4a9a-b878-4df95dda2391 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:33.344034903 +0000 UTC m=+105.039739542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-wkc89" (UID: "19979d37-f374-4a9a-b878-4df95dda2391") : secret "openshift-state-metrics-tls" not found
Jul 06 12:24:32.844350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.844272    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c2587a-108f-437b-a493-1da3fe656275-sys\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.844722 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.844489    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-accelerators-collector-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.844722 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.844564    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38573a3-9470-4e29-afe0-c1e2649ca17d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.844924 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:32.844890    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 12:24:32.845027 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:24:32.844951    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls podName:15c2587a-108f-437b-a493-1da3fe656275 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:33.344935381 +0000 UTC m=+105.040640011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls") pod "node-exporter-fsnjb" (UID: "15c2587a-108f-437b-a493-1da3fe656275") : secret "node-exporter-tls" not found
Jul 06 12:24:32.845954 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.845787    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.846596 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.846572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.846696 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.846667    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.847744 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.847721    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.856675 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.856646    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psl9b\" (UniqueName: \"kubernetes.io/projected/15c2587a-108f-437b-a493-1da3fe656275-kube-api-access-psl9b\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:32.857793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.857774    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqxq\" (UniqueName: \"kubernetes.io/projected/19979d37-f374-4a9a-b878-4df95dda2391-kube-api-access-7mqxq\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:32.858058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.857969    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcnbw\" (UniqueName: \"kubernetes.io/projected/a38573a3-9470-4e29-afe0-c1e2649ca17d-kube-api-access-hcnbw\") pod \"kube-state-metrics-7c9dbb8b7d-62tdj\" (UID: \"a38573a3-9470-4e29-afe0-c1e2649ca17d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:32.936951 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:32.936912    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"
Jul 06 12:24:33.104652 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.104573    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj"]
Jul 06 12:24:33.108000 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:33.107974    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38573a3_9470_4e29_afe0_c1e2649ca17d.slice/crio-23eb84522c88983422edeb36e2d0d04d6fe31cb667a05b532f56c29efcb590b6 WatchSource:0}: Error finding container 23eb84522c88983422edeb36e2d0d04d6fe31cb667a05b532f56c29efcb590b6: Status 404 returned error can't find the container with id 23eb84522c88983422edeb36e2d0d04d6fe31cb667a05b532f56c29efcb590b6
Jul 06 12:24:33.332100 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.332060    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj" event={"ID":"a38573a3-9470-4e29-afe0-c1e2649ca17d","Type":"ContainerStarted","Data":"23eb84522c88983422edeb36e2d0d04d6fe31cb667a05b532f56c29efcb590b6"}
Jul 06 12:24:33.347914 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.347885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:33.348042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.347924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:33.350529 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.350500    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19979d37-f374-4a9a-b878-4df95dda2391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-wkc89\" (UID: \"19979d37-f374-4a9a-b878-4df95dda2391\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:33.350640 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.350501    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c2587a-108f-437b-a493-1da3fe656275-node-exporter-tls\") pod \"node-exporter-fsnjb\" (UID: \"15c2587a-108f-437b-a493-1da3fe656275\") " pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:33.486713 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.486684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"
Jul 06 12:24:33.512905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.512867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fsnjb"
Jul 06 12:24:33.551033 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:33.551008    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c2587a_108f_437b_a493_1da3fe656275.slice/crio-7e802fe0799a0f2a0c003d2173b17591ca1a885f4702ee83ba8d2668c3a46c32 WatchSource:0}: Error finding container 7e802fe0799a0f2a0c003d2173b17591ca1a885f4702ee83ba8d2668c3a46c32: Status 404 returned error can't find the container with id 7e802fe0799a0f2a0c003d2173b17591ca1a885f4702ee83ba8d2668c3a46c32
Jul 06 12:24:33.677921 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:33.677776    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89"]
Jul 06 12:24:33.680790 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:33.680756    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19979d37_f374_4a9a_b878_4df95dda2391.slice/crio-2c8198cbdc299ae7e059aec95fb995d49b08a28372ba97d0319f4da1a8984b45 WatchSource:0}: Error finding container 2c8198cbdc299ae7e059aec95fb995d49b08a28372ba97d0319f4da1a8984b45: Status 404 returned error can't find the container with id 2c8198cbdc299ae7e059aec95fb995d49b08a28372ba97d0319f4da1a8984b45
Jul 06 12:24:34.337693 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:34.337655    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fsnjb" event={"ID":"15c2587a-108f-437b-a493-1da3fe656275","Type":"ContainerStarted","Data":"7e802fe0799a0f2a0c003d2173b17591ca1a885f4702ee83ba8d2668c3a46c32"}
Jul 06 12:24:34.339658 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:34.339625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89" event={"ID":"19979d37-f374-4a9a-b878-4df95dda2391","Type":"ContainerStarted","Data":"ce985fbed2f1a0319bd3c110ce15f02bf1300717f8c4badb5350dfbf215d8d33"}
Jul 06 12:24:34.339790 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:34.339681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89" event={"ID":"19979d37-f374-4a9a-b878-4df95dda2391","Type":"ContainerStarted","Data":"494622f31245df107a4458dd24fc331d80d907c7e01c7c400c143ac91246a39a"}
Jul 06 12:24:34.339790 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:34.339705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89" event={"ID":"19979d37-f374-4a9a-b878-4df95dda2391","Type":"ContainerStarted","Data":"2c8198cbdc299ae7e059aec95fb995d49b08a28372ba97d0319f4da1a8984b45"}
Jul 06 12:24:35.346886 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.346848    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj" event={"ID":"a38573a3-9470-4e29-afe0-c1e2649ca17d","Type":"ContainerStarted","Data":"95dac01b674d3b2c9e9a12eabb4e218dfdaead8cbee8debc8354b1c86d4b1240"}
Jul 06 12:24:35.347409 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.346917    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj" event={"ID":"a38573a3-9470-4e29-afe0-c1e2649ca17d","Type":"ContainerStarted","Data":"d2d20b60da66d7c43824b2849fa94e4e8c23ff62e70653cc824b22641877a732"}
Jul 06 12:24:35.347409 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.346944    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj" event={"ID":"a38573a3-9470-4e29-afe0-c1e2649ca17d","Type":"ContainerStarted","Data":"f2459b97764c373a2242e45ba96c29f0469210a8dec52081fde8dee47313c186"}
Jul 06 12:24:35.348453 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.348430    2570 generic.go:356] "Generic (PLEG): container finished" podID="15c2587a-108f-437b-a493-1da3fe656275" containerID="273fef01c22338f1ab2395ba39f40099fcb90f954aa03a46452a22c4f19914ed" exitCode=0
Jul 06 12:24:35.348685 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.348633    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fsnjb" event={"ID":"15c2587a-108f-437b-a493-1da3fe656275","Type":"ContainerDied","Data":"273fef01c22338f1ab2395ba39f40099fcb90f954aa03a46452a22c4f19914ed"}
Jul 06 12:24:35.378638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:35.378580    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-62tdj" podStartSLOduration=1.48634636 podStartE2EDuration="3.378555522s" totalImagesPullingTime="1.892209162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:35.377446732 +0000 UTC m=+107.073151383" watchObservedRunningTime="2026-07-06 12:24:35.378555522 +0000 UTC m=+107.074260189"
Jul 06 12:24:36.358359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.358293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fsnjb" event={"ID":"15c2587a-108f-437b-a493-1da3fe656275","Type":"ContainerStarted","Data":"34eb7cf5f4f340098fb50dc05bc84d86f052e49e7ef42a41cd14b16e7f01fa11"}
Jul 06 12:24:36.358830 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.358415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fsnjb" event={"ID":"15c2587a-108f-437b-a493-1da3fe656275","Type":"ContainerStarted","Data":"f5fcf9d7650eac09807e0cee11d2e86c1dd9ad819f28f8ef05f90afc67fe10d9"}
Jul 06 12:24:36.360301 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.360279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89" event={"ID":"19979d37-f374-4a9a-b878-4df95dda2391","Type":"ContainerStarted","Data":"da8a72e694a4c0dc7a3a118273b8ae9bdd9a3769761842197c762afb25ac7252"}
Jul 06 12:24:36.384346 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.384275    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fsnjb" podStartSLOduration=2.839941487 podStartE2EDuration="4.384260156s" totalImagesPullingTime="1.45043954s" totalInitContainerRuntime="93.879129ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:36.382431576 +0000 UTC m=+108.078136224" watchObservedRunningTime="2026-07-06 12:24:36.384260156 +0000 UTC m=+108.079964836"
Jul 06 12:24:36.413958 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.413898    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-wkc89" podStartSLOduration=2.707790326 podStartE2EDuration="4.413881762s" totalImagesPullingTime="1.706091436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:36.413475768 +0000 UTC m=+108.109180418" watchObservedRunningTime="2026-07-06 12:24:36.413881762 +0000 UTC m=+108.109586411"
Jul 06 12:24:36.946655 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.946622    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86c9469585-dgskc"]
Jul 06 12:24:36.948848 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.948831    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.951678 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.951655    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 12:24:36.951780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.951685    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 12:24:36.952738 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.952722    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 12:24:36.952823 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.952810    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-23lgvqt0nc10d\""
Jul 06 12:24:36.952915 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.952901    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kqnj9\""
Jul 06 12:24:36.952958 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.952927    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 12:24:36.961719 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.961695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86c9469585-dgskc"]
Jul 06 12:24:36.981221 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-client-certs\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981221 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981227    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-metrics-server-audit-profiles\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-tls\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/388288da-26e1-4506-86db-6186f8d65d22-audit-log\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981374    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-client-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:36.981444 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:36.981417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcg45\" (UniqueName: \"kubernetes.io/projected/388288da-26e1-4506-86db-6186f8d65d22-kube-api-access-fcg45\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-tls\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082496 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082496 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/388288da-26e1-4506-86db-6186f8d65d22-audit-log\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082496 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-client-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082496 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcg45\" (UniqueName: \"kubernetes.io/projected/388288da-26e1-4506-86db-6186f8d65d22-kube-api-access-fcg45\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082714 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-client-certs\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082771 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-metrics-server-audit-profiles\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.082850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.082823    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/388288da-26e1-4506-86db-6186f8d65d22-audit-log\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.083206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.083183    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.083591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.083572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/388288da-26e1-4506-86db-6186f8d65d22-metrics-server-audit-profiles\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.085012 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.084988    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-client-certs\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.085408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.085386    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-client-ca-bundle\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.085475 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.085436    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/388288da-26e1-4506-86db-6186f8d65d22-secret-metrics-server-tls\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.092457 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.092438    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcg45\" (UniqueName: \"kubernetes.io/projected/388288da-26e1-4506-86db-6186f8d65d22-kube-api-access-fcg45\") pod \"metrics-server-86c9469585-dgskc\" (UID: \"388288da-26e1-4506-86db-6186f8d65d22\") " pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.236973 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.236928    2570 patch_prober.go:28] interesting pod/image-registry-6795764c4f-b2gld container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 12:24:37.237143 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.236979    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6795764c4f-b2gld" podUID="0683c445-9879-4c79-9934-4b839d7a0cd1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:24:37.258455 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.258428    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:37.390241 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:37.390212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86c9469585-dgskc"]
Jul 06 12:24:37.393229 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:37.393202    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388288da_26e1_4506_86db_6186f8d65d22.slice/crio-e4672ed1df88a85f9385b8205e324d8e85082ca886459f54916dcf764582fe22 WatchSource:0}: Error finding container e4672ed1df88a85f9385b8205e324d8e85082ca886459f54916dcf764582fe22: Status 404 returned error can't find the container with id e4672ed1df88a85f9385b8205e324d8e85082ca886459f54916dcf764582fe22
Jul 06 12:24:38.374205 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:38.374155    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86c9469585-dgskc" event={"ID":"388288da-26e1-4506-86db-6186f8d65d22","Type":"ContainerStarted","Data":"e4672ed1df88a85f9385b8205e324d8e85082ca886459f54916dcf764582fe22"}
Jul 06 12:24:39.264795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:39.264769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6795764c4f-b2gld"
Jul 06 12:24:39.379359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:39.379326    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86c9469585-dgskc" event={"ID":"388288da-26e1-4506-86db-6186f8d65d22","Type":"ContainerStarted","Data":"a24df042092c3373fe58c0898af2b9af10321357fe23829ae3f6623c7a48a393"}
Jul 06 12:24:39.404105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:39.404059    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86c9469585-dgskc" podStartSLOduration=2.023841952 podStartE2EDuration="3.404043022s" totalImagesPullingTime="1.38020107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:39.401806014 +0000 UTC m=+111.097510663" watchObservedRunningTime="2026-07-06 12:24:39.404043022 +0000 UTC m=+111.099747671"
Jul 06 12:24:42.334832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:42.334799    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wqrhw"
Jul 06 12:24:43.117468 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.117434    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:24:43.120788 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.120770    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.130989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.130970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 12:24:43.131732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.131719    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66m4t\""
Jul 06 12:24:43.131906 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.131888    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 12:24:43.131944 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.131933    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 12:24:43.131982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.131931    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 12:24:43.131982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.131931    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 12:24:43.132114 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.132101    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 12:24:43.132201 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.132188    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 12:24:43.133423 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.133486 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.133486 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78m5m\" (UniqueName: \"kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.133587 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.133637 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.133677 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.133646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.147946 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.147921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:24:43.234362 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.234540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.234540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78m5m\" (UniqueName: \"kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.234540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.234540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.234540 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.234477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.235078 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.235056    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.235164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.235100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.235164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.235149    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.236782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.236762    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.236949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.236930    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.247952 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.247923    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78m5m\" (UniqueName: \"kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m\") pod \"console-74f896c75d-kp469\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") " pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.429828 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.429733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:43.580113 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:43.580073    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:24:43.584147 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:43.584121    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0190c73_344d_4c0b_9863_a0f28d74730d.slice/crio-7e11935ff20486712ce9b6b94949061b5e7de54ff1ac1f31e6901e88001a3acf WatchSource:0}: Error finding container 7e11935ff20486712ce9b6b94949061b5e7de54ff1ac1f31e6901e88001a3acf: Status 404 returned error can't find the container with id 7e11935ff20486712ce9b6b94949061b5e7de54ff1ac1f31e6901e88001a3acf
Jul 06 12:24:44.398445 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:44.398410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f896c75d-kp469" event={"ID":"a0190c73-344d-4c0b-9863-a0f28d74730d","Type":"ContainerStarted","Data":"7e11935ff20486712ce9b6b94949061b5e7de54ff1ac1f31e6901e88001a3acf"}
Jul 06 12:24:47.411940 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:47.411907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f896c75d-kp469" event={"ID":"a0190c73-344d-4c0b-9863-a0f28d74730d","Type":"ContainerStarted","Data":"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"}
Jul 06 12:24:47.465994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:47.465942    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f896c75d-kp469" podStartSLOduration=1.16055898 podStartE2EDuration="4.465925345s" totalImagesPullingTime="3.305366365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:47.464490209 +0000 UTC m=+119.160194870" watchObservedRunningTime="2026-07-06 12:24:47.465925345 +0000 UTC m=+119.161629994"
Jul 06 12:24:51.764749 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.764716    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:24:51.817219 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.817183    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:24:51.817405 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.817277    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.826810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.826788    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 12:24:51.914045 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914045 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflhs\" (UniqueName: \"kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:51.914505 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:51.914361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.015835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015749    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.015835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gflhs\" (UniqueName: \"kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.015835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015826    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.015999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.016609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016776 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.016698    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016776 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.016743    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.016850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.016830    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.018198 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.018172    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.018614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.018597    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.028460 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.028441    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflhs\" (UniqueName: \"kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs\") pod \"console-69576b8f44-27clc\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") " pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.126571 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.126541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:24:52.346693 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.346618    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:24:52.349696 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:52.349672    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4101d46_a7bb_44d4_b283_32035757c2fa.slice/crio-7aebe6b8cdf1a30def0ebad484c15f18b8282b8f9b86ade29ca4f8a3873070aa WatchSource:0}: Error finding container 7aebe6b8cdf1a30def0ebad484c15f18b8282b8f9b86ade29ca4f8a3873070aa: Status 404 returned error can't find the container with id 7aebe6b8cdf1a30def0ebad484c15f18b8282b8f9b86ade29ca4f8a3873070aa
Jul 06 12:24:52.430596 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:52.430561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69576b8f44-27clc" event={"ID":"d4101d46-a7bb-44d4-b283-32035757c2fa","Type":"ContainerStarted","Data":"7aebe6b8cdf1a30def0ebad484c15f18b8282b8f9b86ade29ca4f8a3873070aa"}
Jul 06 12:24:53.430190 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.430156    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:53.430642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.430215    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:53.435599 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.435575    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:53.436562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.436531    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69576b8f44-27clc" event={"ID":"d4101d46-a7bb-44d4-b283-32035757c2fa","Type":"ContainerStarted","Data":"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"}
Jul 06 12:24:53.440252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.440232    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:24:53.502045 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:53.501998    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69576b8f44-27clc" podStartSLOduration=2.501983832 podStartE2EDuration="2.501983832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:53.501966039 +0000 UTC m=+125.197670718" watchObservedRunningTime="2026-07-06 12:24:53.501983832 +0000 UTC m=+125.197688480"
Jul 06 12:24:57.258965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:57.258931    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:57.259441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:57.259000    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:24:58.574137 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:58.574098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:24:58.576428 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:58.576407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/127220d7-daa6-4a56-8dd2-cc0c7003ca33-metrics-certs\") pod \"network-metrics-daemon-4kjc4\" (UID: \"127220d7-daa6-4a56-8dd2-cc0c7003ca33\") " pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:24:58.734973 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:58.734942    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5tqd\""
Jul 06 12:24:58.742510 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:58.742492    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kjc4"
Jul 06 12:24:58.882220 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:58.882179    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kjc4"]
Jul 06 12:24:58.885270 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:24:58.885231    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127220d7_daa6_4a56_8dd2_cc0c7003ca33.slice/crio-0acfda5cbbff0d0c72aa6c9c8a12921094760fac48de32f466d2121c38863e03 WatchSource:0}: Error finding container 0acfda5cbbff0d0c72aa6c9c8a12921094760fac48de32f466d2121c38863e03: Status 404 returned error can't find the container with id 0acfda5cbbff0d0c72aa6c9c8a12921094760fac48de32f466d2121c38863e03
Jul 06 12:24:59.461187 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:24:59.461152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kjc4" event={"ID":"127220d7-daa6-4a56-8dd2-cc0c7003ca33","Type":"ContainerStarted","Data":"0acfda5cbbff0d0c72aa6c9c8a12921094760fac48de32f466d2121c38863e03"}
Jul 06 12:25:01.470176 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:01.470137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kjc4" event={"ID":"127220d7-daa6-4a56-8dd2-cc0c7003ca33","Type":"ContainerStarted","Data":"7bad6639413b9e265d29da81cdd28bca28ed5cbd0250148182507076e773c30e"}
Jul 06 12:25:01.470574 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:01.470198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kjc4" event={"ID":"127220d7-daa6-4a56-8dd2-cc0c7003ca33","Type":"ContainerStarted","Data":"c39536f28cff0e4bc7d495f60d25ff1f9a6f710fe68a344a4fb9dc9d5f2e7d7c"}
Jul 06 12:25:01.499288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:01.499233    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4kjc4" podStartSLOduration=130.883731318 podStartE2EDuration="2m12.499216354s" totalImagesPullingTime="1.615485036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:25:01.498340032 +0000 UTC m=+133.194044683" watchObservedRunningTime="2026-07-06 12:25:01.499216354 +0000 UTC m=+133.194921003"
Jul 06 12:25:02.127649 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:02.127610    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:25:02.127823 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:02.127687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:25:02.132490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:02.132467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:25:02.477331 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:02.477230    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:25:02.546065 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:02.546032    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:25:07.493295 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:07.493261    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d7b9836-fa87-4812-9c59-e060a24f5ccf" containerID="d9ce431a7b04898f9b78e8bc7d538c8257a030003a15953eaf530502af6b7e0a" exitCode=0
Jul 06 12:25:07.493679 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:07.493334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz" event={"ID":"1d7b9836-fa87-4812-9c59-e060a24f5ccf","Type":"ContainerDied","Data":"d9ce431a7b04898f9b78e8bc7d538c8257a030003a15953eaf530502af6b7e0a"}
Jul 06 12:25:07.493679 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:07.493655    2570 scope.go:117] "RemoveContainer" containerID="d9ce431a7b04898f9b78e8bc7d538c8257a030003a15953eaf530502af6b7e0a"
Jul 06 12:25:08.498905 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:08.498873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-lc7wz" event={"ID":"1d7b9836-fa87-4812-9c59-e060a24f5ccf","Type":"ContainerStarted","Data":"dbcdcb8add0526a8f571c532ad75f807267299b6a32eaa8668eecb6927e1eb75"}
Jul 06 12:25:12.515145 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:12.515110    2570 generic.go:356] "Generic (PLEG): container finished" podID="168d96e6-f819-410d-a101-e632745625f0" containerID="4f2305182cb3ae8d43edc38eb38c0a998cfa33d7295d40fdeb9c6822743795e9" exitCode=0
Jul 06 12:25:12.515536 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:12.515178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn" event={"ID":"168d96e6-f819-410d-a101-e632745625f0","Type":"ContainerDied","Data":"4f2305182cb3ae8d43edc38eb38c0a998cfa33d7295d40fdeb9c6822743795e9"}
Jul 06 12:25:12.515536 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:12.515529    2570 scope.go:117] "RemoveContainer" containerID="4f2305182cb3ae8d43edc38eb38c0a998cfa33d7295d40fdeb9c6822743795e9"
Jul 06 12:25:13.520622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:13.520590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qstdn" event={"ID":"168d96e6-f819-410d-a101-e632745625f0","Type":"ContainerStarted","Data":"ae3d7ad18f694b6499bb47216733b7c72930d0c8d267ace2aea34ae6ce7130c3"}
Jul 06 12:25:17.264710 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:17.264681    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:25:17.268563 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:17.268544    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86c9469585-dgskc"
Jul 06 12:25:27.567594 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.567522    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74f896c75d-kp469" podUID="a0190c73-344d-4c0b-9863-a0f28d74730d" containerName="console" containerID="cri-o://be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b" gracePeriod=15
Jul 06 12:25:27.803181 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.803156    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:25:27.826583 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826510    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78m5m\" (UniqueName: \"kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.826583 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826567    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.826780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826603    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.826780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826635    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.826780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826691    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.826780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.826717    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert\") pod \"a0190c73-344d-4c0b-9863-a0f28d74730d\" (UID: \"a0190c73-344d-4c0b-9863-a0f28d74730d\") "
Jul 06 12:25:27.827433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.827029    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:25:27.827433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.827383    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config" (OuterVolumeSpecName: "console-config") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:25:27.827618 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.827490    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:25:27.829204 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.829180    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:25:27.829409 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.829291    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:25:27.829409 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.829348    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m" (OuterVolumeSpecName: "kube-api-access-78m5m") pod "a0190c73-344d-4c0b-9863-a0f28d74730d" (UID: "a0190c73-344d-4c0b-9863-a0f28d74730d"). InnerVolumeSpecName "kube-api-access-78m5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:25:27.928123 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928087    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78m5m\" (UniqueName: \"kubernetes.io/projected/a0190c73-344d-4c0b-9863-a0f28d74730d-kube-api-access-78m5m\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:27.928123 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928114    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-oauth-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:27.928123 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928124    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-oauth-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:27.928123 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928133    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:27.928422 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928142    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0190c73-344d-4c0b-9863-a0f28d74730d-console-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:27.928422 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:27.928149    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0190c73-344d-4c0b-9863-a0f28d74730d-console-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:25:28.585090 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.585056    2570 generic.go:356] "Generic (PLEG): container finished" podID="a0190c73-344d-4c0b-9863-a0f28d74730d" containerID="be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b" exitCode=0
Jul 06 12:25:28.585497 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.585107    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f896c75d-kp469"
Jul 06 12:25:28.585497 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.585106    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f896c75d-kp469" event={"ID":"a0190c73-344d-4c0b-9863-a0f28d74730d","Type":"ContainerDied","Data":"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"}
Jul 06 12:25:28.585497 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.585169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f896c75d-kp469" event={"ID":"a0190c73-344d-4c0b-9863-a0f28d74730d","Type":"ContainerDied","Data":"7e11935ff20486712ce9b6b94949061b5e7de54ff1ac1f31e6901e88001a3acf"}
Jul 06 12:25:28.585497 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.585192    2570 scope.go:117] "RemoveContainer" containerID="be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"
Jul 06 12:25:28.594094 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.594075    2570 scope.go:117] "RemoveContainer" containerID="be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"
Jul 06 12:25:28.594409 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:25:28.594386    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b\": container with ID starting with be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b not found: ID does not exist" containerID="be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"
Jul 06 12:25:28.594466 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.594420    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b"} err="failed to get container status \"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b\": rpc error: code = NotFound desc = could not find container \"be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b\": container with ID starting with be753d183cb7dcfb557e7f34e41517bf5fae5120b8a1add4545313ad5d914a2b not found: ID does not exist"
Jul 06 12:25:28.605623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.605600    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:25:28.609911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.609891    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f896c75d-kp469"]
Jul 06 12:25:28.813481 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:28.813453    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0190c73-344d-4c0b-9863-a0f28d74730d" path="/var/lib/kubelet/pods/a0190c73-344d-4c0b-9863-a0f28d74730d/volumes"
Jul 06 12:25:49.963200 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.963166    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:25:49.963638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.963531    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0190c73-344d-4c0b-9863-a0f28d74730d" containerName="console"
Jul 06 12:25:49.963638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.963545    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0190c73-344d-4c0b-9863-a0f28d74730d" containerName="console"
Jul 06 12:25:49.963638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.963613    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0190c73-344d-4c0b-9863-a0f28d74730d" containerName="console"
Jul 06 12:25:49.967712 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.967693    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:49.981925 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:49.981904    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:25:50.108678 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108687    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hrlv\" (UniqueName: \"kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.108990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.108882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210135 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hrlv\" (UniqueName: \"kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210135 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.210408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.210251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.211044 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.211017    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.211163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.211101    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.211237 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.211166    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.211386 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.211361    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.212772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.212747    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.212772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.212760    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.219654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.219606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hrlv\" (UniqueName: \"kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv\") pod \"console-6c8b64f6cd-xt6br\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") " pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.276262 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.276217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:25:50.405580 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.405547    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:25:50.409183 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:25:50.409157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc417422c_7036_45c9_9d18_d3fa640a6dd0.slice/crio-dfa7d9d9dc9a8e4086327435fce5c091cfbc96c87e7ef1f45d72fc38e8df0ae3 WatchSource:0}: Error finding container dfa7d9d9dc9a8e4086327435fce5c091cfbc96c87e7ef1f45d72fc38e8df0ae3: Status 404 returned error can't find the container with id dfa7d9d9dc9a8e4086327435fce5c091cfbc96c87e7ef1f45d72fc38e8df0ae3
Jul 06 12:25:50.673982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.673951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8b64f6cd-xt6br" event={"ID":"c417422c-7036-45c9-9d18-d3fa640a6dd0","Type":"ContainerStarted","Data":"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"}
Jul 06 12:25:50.674154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.674003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8b64f6cd-xt6br" event={"ID":"c417422c-7036-45c9-9d18-d3fa640a6dd0","Type":"ContainerStarted","Data":"dfa7d9d9dc9a8e4086327435fce5c091cfbc96c87e7ef1f45d72fc38e8df0ae3"}
Jul 06 12:25:50.701543 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:25:50.701499    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c8b64f6cd-xt6br" podStartSLOduration=1.701482447 podStartE2EDuration="1.701482447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:25:50.701003582 +0000 UTC m=+182.396708235" watchObservedRunningTime="2026-07-06 12:25:50.701482447 +0000 UTC m=+182.397187096"
Jul 06 12:26:00.276508 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:00.276470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:26:00.277028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:00.276528    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:26:00.281460 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:00.281438    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:26:00.714835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:00.714253    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:26:00.770352 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:00.770299    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:26:25.792577 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:25.792512    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69576b8f44-27clc" podUID="d4101d46-a7bb-44d4-b283-32035757c2fa" containerName="console" containerID="cri-o://405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967" gracePeriod=15
Jul 06 12:26:26.038398 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.038366    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:26:26.117807 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.117707    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gflhs\" (UniqueName: \"kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.117807 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.117747    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.117807 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.117769    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.117807 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.117786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.118134 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.117818    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.118134 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118014    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.118134 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118107    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert\") pod \"d4101d46-a7bb-44d4-b283-32035757c2fa\" (UID: \"d4101d46-a7bb-44d4-b283-32035757c2fa\") "
Jul 06 12:26:26.118399 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118345    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:26:26.118399 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118349    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config" (OuterVolumeSpecName: "console-config") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:26:26.118399 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118369    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:26:26.118586 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118446    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-console-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.118586 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118457    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:26:26.118586 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118465    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-trusted-ca-bundle\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.118586 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.118512    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.120054 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.120029    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:26:26.120054 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.120044    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs" (OuterVolumeSpecName: "kube-api-access-gflhs") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "kube-api-access-gflhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:26:26.120201 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.120183    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4101d46-a7bb-44d4-b283-32035757c2fa" (UID: "d4101d46-a7bb-44d4-b283-32035757c2fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:26:26.219774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.219736    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gflhs\" (UniqueName: \"kubernetes.io/projected/d4101d46-a7bb-44d4-b283-32035757c2fa-kube-api-access-gflhs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.219774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.219766    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-oauth-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.219774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.219775    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4101d46-a7bb-44d4-b283-32035757c2fa-oauth-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.219774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.219785    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4101d46-a7bb-44d4-b283-32035757c2fa-console-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:26:26.807226 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.807184    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4101d46-a7bb-44d4-b283-32035757c2fa" containerID="405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967" exitCode=0
Jul 06 12:26:26.807674 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.807226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69576b8f44-27clc" event={"ID":"d4101d46-a7bb-44d4-b283-32035757c2fa","Type":"ContainerDied","Data":"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"}
Jul 06 12:26:26.807674 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.807259    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69576b8f44-27clc"
Jul 06 12:26:26.807674 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.807293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69576b8f44-27clc" event={"ID":"d4101d46-a7bb-44d4-b283-32035757c2fa","Type":"ContainerDied","Data":"7aebe6b8cdf1a30def0ebad484c15f18b8282b8f9b86ade29ca4f8a3873070aa"}
Jul 06 12:26:26.807674 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.807363    2570 scope.go:117] "RemoveContainer" containerID="405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"
Jul 06 12:26:26.816536 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.816518    2570 scope.go:117] "RemoveContainer" containerID="405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"
Jul 06 12:26:26.816828 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:26:26.816799    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967\": container with ID starting with 405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967 not found: ID does not exist" containerID="405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"
Jul 06 12:26:26.816941 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.816838    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967"} err="failed to get container status \"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967\": rpc error: code = NotFound desc = could not find container \"405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967\": container with ID starting with 405b2747257e2b1660a7dc5b97af217bbd469b47ff45f7d2ce1f8fd73f8c8967 not found: ID does not exist"
Jul 06 12:26:26.832380 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.832347    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:26:26.837739 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:26.837712    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69576b8f44-27clc"]
Jul 06 12:26:28.818355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:26:28.815828    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4101d46-a7bb-44d4-b283-32035757c2fa" path="/var/lib/kubelet/pods/d4101d46-a7bb-44d4-b283-32035757c2fa/volumes"
Jul 06 12:27:28.223652 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.223618    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9mkw5"]
Jul 06 12:27:28.224047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.223937    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4101d46-a7bb-44d4-b283-32035757c2fa" containerName="console"
Jul 06 12:27:28.224047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.223977    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4101d46-a7bb-44d4-b283-32035757c2fa" containerName="console"
Jul 06 12:27:28.224118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.224062    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4101d46-a7bb-44d4-b283-32035757c2fa" containerName="console"
Jul 06 12:27:28.226906 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.226892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.230502 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.230473    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gfzbn\""
Jul 06 12:27:28.231501 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.231485    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 12:27:28.231562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.231533    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 12:27:28.244383 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.244352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9mkw5"]
Jul 06 12:27:28.300335 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.300284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-bound-sa-token\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.300335 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.300330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj5hj\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-kube-api-access-nj5hj\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.401667 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.401638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-bound-sa-token\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.401848 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.401673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj5hj\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-kube-api-access-nj5hj\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.419562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.419525    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-bound-sa-token\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.419710 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.419596    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj5hj\" (UniqueName: \"kubernetes.io/projected/de8dc5e4-ba24-4395-b0a5-e295ccf059f6-kube-api-access-nj5hj\") pod \"cert-manager-55b4d954d5-9mkw5\" (UID: \"de8dc5e4-ba24-4395-b0a5-e295ccf059f6\") " pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.552653 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.552622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9mkw5"
Jul 06 12:27:28.694148 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:28.693979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9mkw5"]
Jul 06 12:27:28.696898 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:27:28.696875    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde8dc5e4_ba24_4395_b0a5_e295ccf059f6.slice/crio-987ed28064fd1ba51582fa6b3e4f70a18e194a9d283ae3aff41c0db89d83ccd7 WatchSource:0}: Error finding container 987ed28064fd1ba51582fa6b3e4f70a18e194a9d283ae3aff41c0db89d83ccd7: Status 404 returned error can't find the container with id 987ed28064fd1ba51582fa6b3e4f70a18e194a9d283ae3aff41c0db89d83ccd7
Jul 06 12:27:29.032795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:29.032762    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9mkw5" event={"ID":"de8dc5e4-ba24-4395-b0a5-e295ccf059f6","Type":"ContainerStarted","Data":"987ed28064fd1ba51582fa6b3e4f70a18e194a9d283ae3aff41c0db89d83ccd7"}
Jul 06 12:27:32.046284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:32.046243    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9mkw5" event={"ID":"de8dc5e4-ba24-4395-b0a5-e295ccf059f6","Type":"ContainerStarted","Data":"f9ce1510bca0f59a3f32553cc2551668fcc62b6e71f90a1e04cdc02f817ecd2b"}
Jul 06 12:27:32.063879 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:32.063832    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9mkw5" podStartSLOduration=1.1453818390000001 podStartE2EDuration="4.063818176s" totalImagesPullingTime="2.918436337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:32.062580862 +0000 UTC m=+283.758285511" watchObservedRunningTime="2026-07-06 12:27:32.063818176 +0000 UTC m=+283.759522824"
Jul 06 12:27:48.712786 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:48.712761    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 12:27:52.477031 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.476995    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"]
Jul 06 12:27:52.480266 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.480251    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.483642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.483619    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 12:27:52.483642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.483636    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 12:27:52.484265 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.484243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 12:27:52.484400 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.484378    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 12:27:52.484583 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.484562    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kssh9\""
Jul 06 12:27:52.503018 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.502992    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"]
Jul 06 12:27:52.590566 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.590533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.590730 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.590572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.590730 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.590622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.590730 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.590662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.590730 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.590679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdwf7\" (UniqueName: \"kubernetes.io/projected/c2b314a8-91ad-4815-bdcd-82ae355233de-kube-api-access-rdwf7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691094 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691118    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691137    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwf7\" (UniqueName: \"kubernetes.io/projected/c2b314a8-91ad-4815-bdcd-82ae355233de-kube-api-access-rdwf7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691189    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.691620 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.691604    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.693549 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.693522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b314a8-91ad-4815-bdcd-82ae355233de-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.693658 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.693625    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.693747 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.693730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2b314a8-91ad-4815-bdcd-82ae355233de-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.704167 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.704147    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwf7\" (UniqueName: \"kubernetes.io/projected/c2b314a8-91ad-4815-bdcd-82ae355233de-kube-api-access-rdwf7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zczfm\" (UID: \"c2b314a8-91ad-4815-bdcd-82ae355233de\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.790350 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.790305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:52.926125 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.925962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"]
Jul 06 12:27:52.928844 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:27:52.928824    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b314a8_91ad_4815_bdcd_82ae355233de.slice/crio-1d325e02a1c837bbfc6a74dd16e8bc49b65c8f5c4a9f2a6f03699f415684aa00 WatchSource:0}: Error finding container 1d325e02a1c837bbfc6a74dd16e8bc49b65c8f5c4a9f2a6f03699f415684aa00: Status 404 returned error can't find the container with id 1d325e02a1c837bbfc6a74dd16e8bc49b65c8f5c4a9f2a6f03699f415684aa00
Jul 06 12:27:52.930751 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:52.930733    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:27:53.122814 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:53.122738    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm" event={"ID":"c2b314a8-91ad-4815-bdcd-82ae355233de","Type":"ContainerStarted","Data":"1d325e02a1c837bbfc6a74dd16e8bc49b65c8f5c4a9f2a6f03699f415684aa00"}
Jul 06 12:27:56.138453 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:56.138412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm" event={"ID":"c2b314a8-91ad-4815-bdcd-82ae355233de","Type":"ContainerStarted","Data":"7d93492dbe38ba9027919b9a4701305834d049c6a5b1fb816b309d3b8a2be959"}
Jul 06 12:27:57.143779 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:57.143743    2570 generic.go:356] "Generic (PLEG): container finished" podID="c2b314a8-91ad-4815-bdcd-82ae355233de" containerID="7d93492dbe38ba9027919b9a4701305834d049c6a5b1fb816b309d3b8a2be959" exitCode=0
Jul 06 12:27:57.144164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:57.143831    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm" event={"ID":"c2b314a8-91ad-4815-bdcd-82ae355233de","Type":"ContainerDied","Data":"7d93492dbe38ba9027919b9a4701305834d049c6a5b1fb816b309d3b8a2be959"}
Jul 06 12:27:58.150597 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:58.150562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm" event={"ID":"c2b314a8-91ad-4815-bdcd-82ae355233de","Type":"ContainerStarted","Data":"1db07164141f006957634265c0cfea85323e03a97122a9028a40ce33c7edfc4a"}
Jul 06 12:27:58.151077 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:58.150670    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:27:58.223245 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:27:58.223195    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm" podStartSLOduration=1.889389906 podStartE2EDuration="6.223179118s" totalImagesPullingTime="3.298532733s" totalInitContainerRuntime="1.035256479s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:58.221453769 +0000 UTC m=+309.917158415" watchObservedRunningTime="2026-07-06 12:27:58.223179118 +0000 UTC m=+309.918883768"
Jul 06 12:28:09.157408 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:09.157379    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zczfm"
Jul 06 12:28:12.813882 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.813856    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mtmf"]
Jul 06 12:28:12.816092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.816076    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:12.818759 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.818731    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qqxz4\""
Jul 06 12:28:12.818880 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.818779    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 12:28:12.825137 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.825117    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mtmf"]
Jul 06 12:28:12.962264 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.962210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:12.962451 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:12.962334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pq5\" (UniqueName: \"kubernetes.io/projected/e2bc48a4-64f3-40af-b657-117b85d56d4e-kube-api-access-m9pq5\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.063109 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.063074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.063281 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.063124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pq5\" (UniqueName: \"kubernetes.io/projected/e2bc48a4-64f3-40af-b657-117b85d56d4e-kube-api-access-m9pq5\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.063281 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:28:13.063254    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 12:28:13.063398 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:28:13.063353    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert podName:e2bc48a4-64f3-40af-b657-117b85d56d4e nodeName:}" failed. No retries permitted until 2026-07-06 12:28:13.563332625 +0000 UTC m=+325.259037270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert") pod "odh-model-controller-7998c67dc4-2mtmf" (UID: "e2bc48a4-64f3-40af-b657-117b85d56d4e") : secret "odh-model-controller-webhook-cert" not found
Jul 06 12:28:13.075697 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.075630    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pq5\" (UniqueName: \"kubernetes.io/projected/e2bc48a4-64f3-40af-b657-117b85d56d4e-kube-api-access-m9pq5\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.477477 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.477400    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hzd6n"]
Jul 06 12:28:13.479772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.479751    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.482255 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.482232    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 12:28:13.492245 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.492222    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hzd6n"]
Jul 06 12:28:13.566975 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.566949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnvk\" (UniqueName: \"kubernetes.io/projected/96a37e9b-d969-4050-9543-071156573436-kube-api-access-bpnvk\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.567148 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.566990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.567148 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.567073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a37e9b-d969-4050-9543-071156573436-tls-certs\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.569608 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.569576    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2bc48a4-64f3-40af-b657-117b85d56d4e-cert\") pod \"odh-model-controller-7998c67dc4-2mtmf\" (UID: \"e2bc48a4-64f3-40af-b657-117b85d56d4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.668497 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.668462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnvk\" (UniqueName: \"kubernetes.io/projected/96a37e9b-d969-4050-9543-071156573436-kube-api-access-bpnvk\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.668681 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.668530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a37e9b-d969-4050-9543-071156573436-tls-certs\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.670851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.670828    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a37e9b-d969-4050-9543-071156573436-tls-certs\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.683120 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.683093    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnvk\" (UniqueName: \"kubernetes.io/projected/96a37e9b-d969-4050-9543-071156573436-kube-api-access-bpnvk\") pod \"model-serving-api-54d89bd5fc-hzd6n\" (UID: \"96a37e9b-d969-4050-9543-071156573436\") " pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.727047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.727023    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:13.790795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.790761    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:13.874653 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.874614    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mtmf"]
Jul 06 12:28:13.877273 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:28:13.877243    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bc48a4_64f3_40af_b657_117b85d56d4e.slice/crio-c2a790e68713c160ff9b0ddf429c753f0d510495142055cc5d698a813cdf5ec2 WatchSource:0}: Error finding container c2a790e68713c160ff9b0ddf429c753f0d510495142055cc5d698a813cdf5ec2: Status 404 returned error can't find the container with id c2a790e68713c160ff9b0ddf429c753f0d510495142055cc5d698a813cdf5ec2
Jul 06 12:28:13.942667 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:13.942641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hzd6n"]
Jul 06 12:28:13.944216 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:28:13.944178    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a37e9b_d969_4050_9543_071156573436.slice/crio-dc1cba3e0270ad5c88ed76372ba410eb5dd3dbe0a1d2e83373c76cbd4ea9309d WatchSource:0}: Error finding container dc1cba3e0270ad5c88ed76372ba410eb5dd3dbe0a1d2e83373c76cbd4ea9309d: Status 404 returned error can't find the container with id dc1cba3e0270ad5c88ed76372ba410eb5dd3dbe0a1d2e83373c76cbd4ea9309d
Jul 06 12:28:14.217768 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:14.217713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n" event={"ID":"96a37e9b-d969-4050-9543-071156573436","Type":"ContainerStarted","Data":"dc1cba3e0270ad5c88ed76372ba410eb5dd3dbe0a1d2e83373c76cbd4ea9309d"}
Jul 06 12:28:14.218988 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:14.218958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf" event={"ID":"e2bc48a4-64f3-40af-b657-117b85d56d4e","Type":"ContainerStarted","Data":"c2a790e68713c160ff9b0ddf429c753f0d510495142055cc5d698a813cdf5ec2"}
Jul 06 12:28:18.237840 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.237804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n" event={"ID":"96a37e9b-d969-4050-9543-071156573436","Type":"ContainerStarted","Data":"764c6c52c3aeb5eec44c76e0f0018b6cd9e12487ba4819bfedc7e504a7bcbbd2"}
Jul 06 12:28:18.238304 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.237902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:18.239471 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.239443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf" event={"ID":"e2bc48a4-64f3-40af-b657-117b85d56d4e","Type":"ContainerStarted","Data":"025347a870fa4f777ee095833bd10b9bdad17be609e83d79d1cca0562efa6019"}
Jul 06 12:28:18.239597 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.239513    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:18.289149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.289095    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf" podStartSLOduration=2.962891167 podStartE2EDuration="6.28907659s" totalImagesPullingTime="3.326185423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:18.287700243 +0000 UTC m=+329.983404894" watchObservedRunningTime="2026-07-06 12:28:18.28907659 +0000 UTC m=+329.984781237"
Jul 06 12:28:18.289391 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:18.289196    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n" podStartSLOduration=2.057106028 podStartE2EDuration="5.289187869s" totalImagesPullingTime="3.232081841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:18.262702986 +0000 UTC m=+329.958407635" watchObservedRunningTime="2026-07-06 12:28:18.289187869 +0000 UTC m=+329.984892519"
Jul 06 12:28:19.241955 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.241927    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"]
Jul 06 12:28:19.249050 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.249017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.252687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.252663    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zzthp\""
Jul 06 12:28:19.253740 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.253716    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:28:19.253850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.253739    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 12:28:19.254782 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.254762    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 12:28:19.254855 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.254762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 12:28:19.254979 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.254966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 12:28:19.259089 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.259069    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"]
Jul 06 12:28:19.426296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.426261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhpj\" (UniqueName: \"kubernetes.io/projected/8ecd73ca-4e68-4019-9962-dae03a7b6140-kube-api-access-kvhpj\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.426296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.426301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ecd73ca-4e68-4019-9962-dae03a7b6140-manager-config\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.426571 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.426382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.426571 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.426420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-metrics-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.526965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.526871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhpj\" (UniqueName: \"kubernetes.io/projected/8ecd73ca-4e68-4019-9962-dae03a7b6140-kube-api-access-kvhpj\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.526965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.526939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ecd73ca-4e68-4019-9962-dae03a7b6140-manager-config\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.527170 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.526984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.527170 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.527024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-metrics-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.527732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.527708    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ecd73ca-4e68-4019-9962-dae03a7b6140-manager-config\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.529488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.529465    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-metrics-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.529666 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.529647    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ecd73ca-4e68-4019-9962-dae03a7b6140-cert\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.536789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.536761    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhpj\" (UniqueName: \"kubernetes.io/projected/8ecd73ca-4e68-4019-9962-dae03a7b6140-kube-api-access-kvhpj\") pod \"lws-controller-manager-69bb7bb478-6pvc4\" (UID: \"8ecd73ca-4e68-4019-9962-dae03a7b6140\") " pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.559446 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.559415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:19.709084 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:28:19.709054    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecd73ca_4e68_4019_9962_dae03a7b6140.slice/crio-9b977266e444fc8eefb56433ed4cbc84633f8c3ee25566c722817e1841a9a7e3 WatchSource:0}: Error finding container 9b977266e444fc8eefb56433ed4cbc84633f8c3ee25566c722817e1841a9a7e3: Status 404 returned error can't find the container with id 9b977266e444fc8eefb56433ed4cbc84633f8c3ee25566c722817e1841a9a7e3
Jul 06 12:28:19.713923 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:19.713895    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"]
Jul 06 12:28:20.254525 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:20.254486    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4" event={"ID":"8ecd73ca-4e68-4019-9962-dae03a7b6140","Type":"ContainerStarted","Data":"9b977266e444fc8eefb56433ed4cbc84633f8c3ee25566c722817e1841a9a7e3"}
Jul 06 12:28:22.266084 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:22.266051    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4" event={"ID":"8ecd73ca-4e68-4019-9962-dae03a7b6140","Type":"ContainerStarted","Data":"497ce9119ebe97cbb12ed9ce4974b4accbc63737b17f6d0e0d34b0e9e4c4a71b"}
Jul 06 12:28:22.266567 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:22.266192    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:22.302144 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:22.302092    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4" podStartSLOduration=1.066698466 podStartE2EDuration="3.302076872s" totalImagesPullingTime="2.235378406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:22.300764307 +0000 UTC m=+333.996468958" watchObservedRunningTime="2026-07-06 12:28:22.302076872 +0000 UTC m=+333.997781520"
Jul 06 12:28:29.251014 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:29.250981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2mtmf"
Jul 06 12:28:29.252784 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:29.252764    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hzd6n"
Jul 06 12:28:33.272784 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.272756    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bb7bb478-6pvc4"
Jul 06 12:28:33.596491 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.596418    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"]
Jul 06 12:28:33.607127 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.607095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.613687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.613641    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 12:28:33.613687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.613679    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-22x2m\""
Jul 06 12:28:33.617965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.617943    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"]
Jul 06 12:28:33.644432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644632 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644632 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936af44-d27e-45b4-910f-b6a0c3cb1970-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644632 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644632 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqlh\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-kube-api-access-nrqlh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644719    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.644795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.644766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749583 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqlh\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-kube-api-access-nrqlh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.749785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750108 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750108 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.749815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936af44-d27e-45b4-910f-b6a0c3cb1970-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750222 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.750142    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750222 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.750194    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750347 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.750285    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750593 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.750565    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.750593 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.750576    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936af44-d27e-45b4-910f-b6a0c3cb1970-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.752326 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.752255    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.752633 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.752612    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.769264 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.769238    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqlh\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-kube-api-access-nrqlh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.787109 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.787076    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936af44-d27e-45b4-910f-b6a0c3cb1970-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4h4jsb\" (UID: \"e936af44-d27e-45b4-910f-b6a0c3cb1970\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:33.918910 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:33.918821    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:34.087092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:34.087063    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"]
Jul 06 12:28:34.090676 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:28:34.090653    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode936af44_d27e_45b4_910f_b6a0c3cb1970.slice/crio-3957a73e2bf0ce97c379c11a3addfd43f43a6c44e3df5a9853693e404b588cca WatchSource:0}: Error finding container 3957a73e2bf0ce97c379c11a3addfd43f43a6c44e3df5a9853693e404b588cca: Status 404 returned error can't find the container with id 3957a73e2bf0ce97c379c11a3addfd43f43a6c44e3df5a9853693e404b588cca
Jul 06 12:28:34.317007 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:34.316974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb" event={"ID":"e936af44-d27e-45b4-910f-b6a0c3cb1970","Type":"ContainerStarted","Data":"3957a73e2bf0ce97c379c11a3addfd43f43a6c44e3df5a9853693e404b588cca"}
Jul 06 12:28:36.801192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:36.801149    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:28:36.801472 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:36.801244    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:28:36.801472 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:36.801277    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:28:37.331610 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:37.331568    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb" event={"ID":"e936af44-d27e-45b4-910f-b6a0c3cb1970","Type":"ContainerStarted","Data":"7cc127f4821075fb65e6c92b5f9927947ca5e714e20ce9b987cfdd39629f535f"}
Jul 06 12:28:37.365340 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:37.365273    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb" podStartSLOduration=1.657130716 podStartE2EDuration="4.365255986s" totalImagesPullingTime="2.70812527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:37.364242484 +0000 UTC m=+349.059947153" watchObservedRunningTime="2026-07-06 12:28:37.365255986 +0000 UTC m=+349.060960635"
Jul 06 12:28:37.919187 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:37.919149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:37.924336 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:37.924289    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:38.336298 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:38.336264    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:28:38.337216 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:28:38.337199    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4h4jsb"
Jul 06 12:29:13.754128 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.754047    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:13.761752 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.761732    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:13.767515 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.767488    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:29:13.772728 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.772708    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:29:13.773494 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.773475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dx2jl\""
Jul 06 12:29:13.778623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.778592    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:13.896185 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.896147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv96v\" (UniqueName: \"kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v\") pod \"kuadrant-operator-catalog-9wgj6\" (UID: \"66fd367c-917f-463d-ac96-3a9268c9f563\") " pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:13.997207 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:13.997164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv96v\" (UniqueName: \"kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v\") pod \"kuadrant-operator-catalog-9wgj6\" (UID: \"66fd367c-917f-463d-ac96-3a9268c9f563\") " pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:14.016477 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.016402    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv96v\" (UniqueName: \"kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v\") pod \"kuadrant-operator-catalog-9wgj6\" (UID: \"66fd367c-917f-463d-ac96-3a9268c9f563\") " pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:14.054833 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.054798    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:14.055090 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.055078    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:14.210433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.210348    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:14.213387 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:29:14.213356    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fd367c_917f_463d_ac96_3a9268c9f563.slice/crio-b1d9cb5e23c6be327e80a9311695351e96a2f01ad753890f323a07f0d24ecd57 WatchSource:0}: Error finding container b1d9cb5e23c6be327e80a9311695351e96a2f01ad753890f323a07f0d24ecd57: Status 404 returned error can't find the container with id b1d9cb5e23c6be327e80a9311695351e96a2f01ad753890f323a07f0d24ecd57
Jul 06 12:29:14.259390 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.259362    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8vldt"]
Jul 06 12:29:14.264275 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.264256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:14.284953 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.284924    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8vldt"]
Jul 06 12:29:14.400499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.400458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dn7x\" (UniqueName: \"kubernetes.io/projected/4ccdadb4-4b47-4083-a945-9f8068292f64-kube-api-access-6dn7x\") pod \"kuadrant-operator-catalog-8vldt\" (UID: \"4ccdadb4-4b47-4083-a945-9f8068292f64\") " pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:14.493719 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.493684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" event={"ID":"66fd367c-917f-463d-ac96-3a9268c9f563","Type":"ContainerStarted","Data":"b1d9cb5e23c6be327e80a9311695351e96a2f01ad753890f323a07f0d24ecd57"}
Jul 06 12:29:14.502116 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.502085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dn7x\" (UniqueName: \"kubernetes.io/projected/4ccdadb4-4b47-4083-a945-9f8068292f64-kube-api-access-6dn7x\") pod \"kuadrant-operator-catalog-8vldt\" (UID: \"4ccdadb4-4b47-4083-a945-9f8068292f64\") " pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:14.517483 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.517449    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dn7x\" (UniqueName: \"kubernetes.io/projected/4ccdadb4-4b47-4083-a945-9f8068292f64-kube-api-access-6dn7x\") pod \"kuadrant-operator-catalog-8vldt\" (UID: \"4ccdadb4-4b47-4083-a945-9f8068292f64\") " pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:14.573433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.573347    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:14.761679 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:14.761639    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8vldt"]
Jul 06 12:29:14.764967 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:29:14.764937    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccdadb4_4b47_4083_a945_9f8068292f64.slice/crio-c47d1860a04ce068a1c2cc6f76a4fbca9cb02ce09fd366e166993963310294a8 WatchSource:0}: Error finding container c47d1860a04ce068a1c2cc6f76a4fbca9cb02ce09fd366e166993963310294a8: Status 404 returned error can't find the container with id c47d1860a04ce068a1c2cc6f76a4fbca9cb02ce09fd366e166993963310294a8
Jul 06 12:29:15.500626 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:15.500570    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8vldt" event={"ID":"4ccdadb4-4b47-4083-a945-9f8068292f64","Type":"ContainerStarted","Data":"c47d1860a04ce068a1c2cc6f76a4fbca9cb02ce09fd366e166993963310294a8"}
Jul 06 12:29:16.506604 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.506564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" event={"ID":"66fd367c-917f-463d-ac96-3a9268c9f563","Type":"ContainerStarted","Data":"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"}
Jul 06 12:29:16.507056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.506757    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" podUID="66fd367c-917f-463d-ac96-3a9268c9f563" containerName="registry-server" containerID="cri-o://9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322" gracePeriod=2
Jul 06 12:29:16.508499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.508476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8vldt" event={"ID":"4ccdadb4-4b47-4083-a945-9f8068292f64","Type":"ContainerStarted","Data":"6897ca50454a99a926118376ed449ec391905aa696903161940eaceca278477e"}
Jul 06 12:29:16.527897 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.527836    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" podStartSLOduration=1.35392536 podStartE2EDuration="3.527819017s" totalImagesPullingTime="2.173893657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:16.527730182 +0000 UTC m=+388.223434832" watchObservedRunningTime="2026-07-06 12:29:16.527819017 +0000 UTC m=+388.223523666"
Jul 06 12:29:16.549359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.549287    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8vldt" podStartSLOduration=0.923949452 podStartE2EDuration="2.549268586s" totalImagesPullingTime="1.625319134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:16.546938013 +0000 UTC m=+388.242642685" watchObservedRunningTime="2026-07-06 12:29:16.549268586 +0000 UTC m=+388.244973235"
Jul 06 12:29:16.755625 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.755601    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9wgj6_66fd367c-917f-463d-ac96-3a9268c9f563/registry-server/0.log"
Jul 06 12:29:16.757979 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.757962    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:16.925818 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.925727    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv96v\" (UniqueName: \"kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v\") pod \"66fd367c-917f-463d-ac96-3a9268c9f563\" (UID: \"66fd367c-917f-463d-ac96-3a9268c9f563\") "
Jul 06 12:29:16.927921 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:16.927895    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v" (OuterVolumeSpecName: "kube-api-access-hv96v") pod "66fd367c-917f-463d-ac96-3a9268c9f563" (UID: "66fd367c-917f-463d-ac96-3a9268c9f563"). InnerVolumeSpecName "kube-api-access-hv96v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:29:17.026614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.026565    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv96v\" (UniqueName: \"kubernetes.io/projected/66fd367c-917f-463d-ac96-3a9268c9f563-kube-api-access-hv96v\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:29:17.516666 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516642    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9wgj6_66fd367c-917f-463d-ac96-3a9268c9f563/registry-server/0.log"
Jul 06 12:29:17.517067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516679    2570 generic.go:356] "Generic (PLEG): container finished" podID="66fd367c-917f-463d-ac96-3a9268c9f563" containerID="9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322" exitCode=1
Jul 06 12:29:17.517067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" event={"ID":"66fd367c-917f-463d-ac96-3a9268c9f563","Type":"ContainerDied","Data":"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"}
Jul 06 12:29:17.517067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516744    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6"
Jul 06 12:29:17.517067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9wgj6" event={"ID":"66fd367c-917f-463d-ac96-3a9268c9f563","Type":"ContainerDied","Data":"b1d9cb5e23c6be327e80a9311695351e96a2f01ad753890f323a07f0d24ecd57"}
Jul 06 12:29:17.517067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.516822    2570 scope.go:117] "RemoveContainer" containerID="9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"
Jul 06 12:29:17.525220 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.525203    2570 scope.go:117] "RemoveContainer" containerID="9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"
Jul 06 12:29:17.525559 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:29:17.525542    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322\": container with ID starting with 9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322 not found: ID does not exist" containerID="9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"
Jul 06 12:29:17.525641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.525567    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322"} err="failed to get container status \"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322\": rpc error: code = NotFound desc = could not find container \"9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322\": container with ID starting with 9a260ea344366f36d29b9f022ebfcf7ba6edf6e961630ac0d501e8b68ed31322 not found: ID does not exist"
Jul 06 12:29:17.556648 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.556615    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:17.568058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:17.568031    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9wgj6"]
Jul 06 12:29:18.813785 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:18.813754    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fd367c-917f-463d-ac96-3a9268c9f563" path="/var/lib/kubelet/pods/66fd367c-917f-463d-ac96-3a9268c9f563/volumes"
Jul 06 12:29:24.573877 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:24.573846    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:24.574483 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:24.573929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:24.600906 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:24.600880    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:25.571967 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:25.571940    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8vldt"
Jul 06 12:29:43.635433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.635400    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788f759ff7-8tzmc"]
Jul 06 12:29:43.635799 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.635706    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fd367c-917f-463d-ac96-3a9268c9f563" containerName="registry-server"
Jul 06 12:29:43.635799 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.635717    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fd367c-917f-463d-ac96-3a9268c9f563" containerName="registry-server"
Jul 06 12:29:43.635799 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.635786    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fd367c-917f-463d-ac96-3a9268c9f563" containerName="registry-server"
Jul 06 12:29:43.638711 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.638688    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.663644 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.663611    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788f759ff7-8tzmc"]
Jul 06 12:29:43.748480 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-oauth-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-trusted-ca-bundle\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-oauth-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748806 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-service-ca\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.748806 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.748658    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2t2c\" (UniqueName: \"kubernetes.io/projected/1c835437-9f91-4270-bbf0-ee47c4fafdc3-kube-api-access-r2t2c\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850059    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-oauth-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-service-ca\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850461 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2t2c\" (UniqueName: \"kubernetes.io/projected/1c835437-9f91-4270-bbf0-ee47c4fafdc3-kube-api-access-r2t2c\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850461 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-oauth-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-trusted-ca-bundle\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.850936 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850915    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.851035 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850948    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-oauth-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.851035 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.850955    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-service-ca\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.851211 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.851193    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c835437-9f91-4270-bbf0-ee47c4fafdc3-trusted-ca-bundle\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.852637 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.852616    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-serving-cert\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.852841 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.852819    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c835437-9f91-4270-bbf0-ee47c4fafdc3-console-oauth-config\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.862493 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.862470    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2t2c\" (UniqueName: \"kubernetes.io/projected/1c835437-9f91-4270-bbf0-ee47c4fafdc3-kube-api-access-r2t2c\") pod \"console-788f759ff7-8tzmc\" (UID: \"1c835437-9f91-4270-bbf0-ee47c4fafdc3\") " pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:43.949106 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:43.949045    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:44.080292 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:44.080269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788f759ff7-8tzmc"]
Jul 06 12:29:44.082400 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:29:44.082373    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c835437_9f91_4270_bbf0_ee47c4fafdc3.slice/crio-14d71375cee710012c6966388edbd3ac1dd31b904eb157726d507e0b604392c4 WatchSource:0}: Error finding container 14d71375cee710012c6966388edbd3ac1dd31b904eb157726d507e0b604392c4: Status 404 returned error can't find the container with id 14d71375cee710012c6966388edbd3ac1dd31b904eb157726d507e0b604392c4
Jul 06 12:29:44.635102 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:44.635072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788f759ff7-8tzmc" event={"ID":"1c835437-9f91-4270-bbf0-ee47c4fafdc3","Type":"ContainerStarted","Data":"56c699be3d7ed0058c31c7b97bf1ea4894251016290dfa4ece45155d09fde2c7"}
Jul 06 12:29:44.635277 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:44.635140    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788f759ff7-8tzmc" event={"ID":"1c835437-9f91-4270-bbf0-ee47c4fafdc3","Type":"ContainerStarted","Data":"14d71375cee710012c6966388edbd3ac1dd31b904eb157726d507e0b604392c4"}
Jul 06 12:29:44.665650 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:44.665596    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788f759ff7-8tzmc" podStartSLOduration=1.66557935 podStartE2EDuration="1.66557935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:44.663836596 +0000 UTC m=+416.359541245" watchObservedRunningTime="2026-07-06 12:29:44.66557935 +0000 UTC m=+416.361283999"
Jul 06 12:29:46.340012 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.339978    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"]
Jul 06 12:29:46.346297 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.346274    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:46.350479 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.350460    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q8bth\""
Jul 06 12:29:46.361952 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.361931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"]
Jul 06 12:29:46.474266 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.474230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7st62\" (UniqueName: \"kubernetes.io/projected/36c17d51-0183-4ac2-b1cf-1718df89032d-kube-api-access-7st62\") pod \"authorino-operator-75cc8d5cb7-45zj6\" (UID: \"36c17d51-0183-4ac2-b1cf-1718df89032d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:46.575200 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.575156    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7st62\" (UniqueName: \"kubernetes.io/projected/36c17d51-0183-4ac2-b1cf-1718df89032d-kube-api-access-7st62\") pod \"authorino-operator-75cc8d5cb7-45zj6\" (UID: \"36c17d51-0183-4ac2-b1cf-1718df89032d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:46.600946 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.600869    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7st62\" (UniqueName: \"kubernetes.io/projected/36c17d51-0183-4ac2-b1cf-1718df89032d-kube-api-access-7st62\") pod \"authorino-operator-75cc8d5cb7-45zj6\" (UID: \"36c17d51-0183-4ac2-b1cf-1718df89032d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:46.656427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.656398    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:46.791516 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:46.791492    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"]
Jul 06 12:29:46.793543 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:29:46.793517    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c17d51_0183_4ac2_b1cf_1718df89032d.slice/crio-b17b41cefb34825426a27a1aab9ec4552779d042ed2a72677d311dca50fadec4 WatchSource:0}: Error finding container b17b41cefb34825426a27a1aab9ec4552779d042ed2a72677d311dca50fadec4: Status 404 returned error can't find the container with id b17b41cefb34825426a27a1aab9ec4552779d042ed2a72677d311dca50fadec4
Jul 06 12:29:47.650472 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:47.650435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6" event={"ID":"36c17d51-0183-4ac2-b1cf-1718df89032d","Type":"ContainerStarted","Data":"b17b41cefb34825426a27a1aab9ec4552779d042ed2a72677d311dca50fadec4"}
Jul 06 12:29:49.662009 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:49.661973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6" event={"ID":"36c17d51-0183-4ac2-b1cf-1718df89032d","Type":"ContainerStarted","Data":"0ff9ea33aafde2b51b38cc9054dbe8cbbdb672c0a1c1a1b81280f1a45d251b3c"}
Jul 06 12:29:49.662447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:49.662108    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:29:49.692160 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:49.692112    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6" podStartSLOduration=1.556681387 podStartE2EDuration="3.692095322s" totalImagesPullingTime="2.135413935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:49.69010334 +0000 UTC m=+421.385808002" watchObservedRunningTime="2026-07-06 12:29:49.692095322 +0000 UTC m=+421.387799970"
Jul 06 12:29:53.452099 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.452064    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"]
Jul 06 12:29:53.457458 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.457442    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:53.460238 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.460218    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 12:29:53.460376 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.460218    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fsrjk\""
Jul 06 12:29:53.469058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.469033    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"]
Jul 06 12:29:53.533895 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.533846    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv96z\" (UniqueName: \"kubernetes.io/projected/dd14d010-0968-4741-8efc-88bf1f45ef7d-kube-api-access-jv96z\") pod \"dns-operator-controller-manager-864dd78c4c-dh8hz\" (UID: \"dd14d010-0968-4741-8efc-88bf1f45ef7d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:53.635109 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.635075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv96z\" (UniqueName: \"kubernetes.io/projected/dd14d010-0968-4741-8efc-88bf1f45ef7d-kube-api-access-jv96z\") pod \"dns-operator-controller-manager-864dd78c4c-dh8hz\" (UID: \"dd14d010-0968-4741-8efc-88bf1f45ef7d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:53.653488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.653454    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv96z\" (UniqueName: \"kubernetes.io/projected/dd14d010-0968-4741-8efc-88bf1f45ef7d-kube-api-access-jv96z\") pod \"dns-operator-controller-manager-864dd78c4c-dh8hz\" (UID: \"dd14d010-0968-4741-8efc-88bf1f45ef7d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:53.767126 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.767083    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:53.896468 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.896445    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"]
Jul 06 12:29:53.899164 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:29:53.899137    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd14d010_0968_4741_8efc_88bf1f45ef7d.slice/crio-b69c902594617193ff6252b47cd273d0a1a76aee28715ed60c0fb7e06c4d6f4c WatchSource:0}: Error finding container b69c902594617193ff6252b47cd273d0a1a76aee28715ed60c0fb7e06c4d6f4c: Status 404 returned error can't find the container with id b69c902594617193ff6252b47cd273d0a1a76aee28715ed60c0fb7e06c4d6f4c
Jul 06 12:29:53.949489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.949449    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:53.949642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.949538    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:53.954173 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:53.954154    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:54.690839 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:54.690806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz" event={"ID":"dd14d010-0968-4741-8efc-88bf1f45ef7d","Type":"ContainerStarted","Data":"b69c902594617193ff6252b47cd273d0a1a76aee28715ed60c0fb7e06c4d6f4c"}
Jul 06 12:29:54.694823 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:54.694799    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788f759ff7-8tzmc"
Jul 06 12:29:54.758954 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:54.758925    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:29:56.701704 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:56.701664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz" event={"ID":"dd14d010-0968-4741-8efc-88bf1f45ef7d","Type":"ContainerStarted","Data":"84faf4643704997057edfd1baa37cbb7c0490c763184943062d38c8754cf8844"}
Jul 06 12:29:56.702133 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:56.701912    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:29:56.748795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:29:56.748725    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz" podStartSLOduration=1.5599714279999999 podStartE2EDuration="3.748709734s" totalImagesPullingTime="2.188738306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:56.747353487 +0000 UTC m=+428.443058147" watchObservedRunningTime="2026-07-06 12:29:56.748709734 +0000 UTC m=+428.444414382"
Jul 06 12:30:00.669325 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:00.669280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-45zj6"
Jul 06 12:30:07.708949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:07.708918    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dh8hz"
Jul 06 12:30:12.150056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.149970    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:30:12.153204 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.153188    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.156710 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.156689    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-drd6q\""
Jul 06 12:30:12.171990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.171966    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:30:12.209075 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.209036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.209261 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.209093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr94r\" (UniqueName: \"kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.309834 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.309794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.310004 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.309845    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr94r\" (UniqueName: \"kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.310203 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.310183    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.335137 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.335099    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr94r\" (UniqueName: \"kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r\") pod \"kuadrant-operator-controller-manager-86878c769f-vh4v5\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.464132 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.464033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:12.614229 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:30:12.614185    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73324d72_e141_416f_b8fc_c59debb0a0c1.slice/crio-3d4a57577e75f05ff438afe4935884e6f5526f87fd9d3617071d8de2a5ff0f7b WatchSource:0}: Error finding container 3d4a57577e75f05ff438afe4935884e6f5526f87fd9d3617071d8de2a5ff0f7b: Status 404 returned error can't find the container with id 3d4a57577e75f05ff438afe4935884e6f5526f87fd9d3617071d8de2a5ff0f7b
Jul 06 12:30:12.615124 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.615102    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:30:12.774547 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:12.774511    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" event={"ID":"73324d72-e141-416f-b8fc-c59debb0a0c1","Type":"ContainerStarted","Data":"3d4a57577e75f05ff438afe4935884e6f5526f87fd9d3617071d8de2a5ff0f7b"}
Jul 06 12:30:16.800631 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:16.800591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" event={"ID":"73324d72-e141-416f-b8fc-c59debb0a0c1","Type":"ContainerStarted","Data":"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"}
Jul 06 12:30:16.800992 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:16.800792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:16.829351 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:16.829294    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" podStartSLOduration=0.769275168 podStartE2EDuration="4.829280612s" totalImagesPullingTime="4.060005444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:16.828967545 +0000 UTC m=+448.524672194" watchObservedRunningTime="2026-07-06 12:30:16.829280612 +0000 UTC m=+448.524985261"
Jul 06 12:30:19.788023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:19.787984    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c8b64f6cd-xt6br" podUID="c417422c-7036-45c9-9d18-d3fa640a6dd0" containerName="console" containerID="cri-o://a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3" gracePeriod=15
Jul 06 12:30:20.049772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.049712    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:30:20.078946 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.078917    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.078991    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079026    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079054    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079183    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hrlv\" (UniqueName: \"kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079263    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079487 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config\") pod \"c417422c-7036-45c9-9d18-d3fa640a6dd0\" (UID: \"c417422c-7036-45c9-9d18-d3fa640a6dd0\") "
Jul 06 12:30:20.079561 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079469    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:30:20.079641 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079602    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca" (OuterVolumeSpecName: "service-ca") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:30:20.079797 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079777    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-oauth-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.079880 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079803    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.079880 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079816    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config" (OuterVolumeSpecName: "console-config") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:30:20.080031 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.079955    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:30:20.081735 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.081709    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:30:20.081837 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.081733    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:30:20.081885 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.081869    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv" (OuterVolumeSpecName: "kube-api-access-2hrlv") pod "c417422c-7036-45c9-9d18-d3fa640a6dd0" (UID: "c417422c-7036-45c9-9d18-d3fa640a6dd0"). InnerVolumeSpecName "kube-api-access-2hrlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:30:20.180755 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.180722    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-oauth-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.180755 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.180752    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-serving-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.180755 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.180761    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-trusted-ca-bundle\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.180987 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.180771    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hrlv\" (UniqueName: \"kubernetes.io/projected/c417422c-7036-45c9-9d18-d3fa640a6dd0-kube-api-access-2hrlv\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.180987 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.180782    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c417422c-7036-45c9-9d18-d3fa640a6dd0-console-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:20.818875 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.818842    2570 generic.go:356] "Generic (PLEG): container finished" podID="c417422c-7036-45c9-9d18-d3fa640a6dd0" containerID="a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3" exitCode=0
Jul 06 12:30:20.819288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.818905    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8b64f6cd-xt6br"
Jul 06 12:30:20.819288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.818915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8b64f6cd-xt6br" event={"ID":"c417422c-7036-45c9-9d18-d3fa640a6dd0","Type":"ContainerDied","Data":"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"}
Jul 06 12:30:20.819288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.818956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8b64f6cd-xt6br" event={"ID":"c417422c-7036-45c9-9d18-d3fa640a6dd0","Type":"ContainerDied","Data":"dfa7d9d9dc9a8e4086327435fce5c091cfbc96c87e7ef1f45d72fc38e8df0ae3"}
Jul 06 12:30:20.819288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.818979    2570 scope.go:117] "RemoveContainer" containerID="a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"
Jul 06 12:30:20.828016 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.827997    2570 scope.go:117] "RemoveContainer" containerID="a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"
Jul 06 12:30:20.828265 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:30:20.828245    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3\": container with ID starting with a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3 not found: ID does not exist" containerID="a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"
Jul 06 12:30:20.828304 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.828274    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3"} err="failed to get container status \"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3\": rpc error: code = NotFound desc = could not find container \"a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3\": container with ID starting with a17ea2d92b20d9f5147a05b4f3e47b22da460f15e9700fc9cd5a408f21c2e9c3 not found: ID does not exist"
Jul 06 12:30:20.861259 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.861237    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:30:20.873137 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:20.873115    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c8b64f6cd-xt6br"]
Jul 06 12:30:22.814620 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:22.814586    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c417422c-7036-45c9-9d18-d3fa640a6dd0" path="/var/lib/kubelet/pods/c417422c-7036-45c9-9d18-d3fa640a6dd0/volumes"
Jul 06 12:30:27.806955 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:27.806921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:30:44.555814 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.555777    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"]
Jul 06 12:30:44.556191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.556142    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c417422c-7036-45c9-9d18-d3fa640a6dd0" containerName="console"
Jul 06 12:30:44.556191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.556154    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c417422c-7036-45c9-9d18-d3fa640a6dd0" containerName="console"
Jul 06 12:30:44.556261 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.556211    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c417422c-7036-45c9-9d18-d3fa640a6dd0" containerName="console"
Jul 06 12:30:44.559282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.559262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.563114 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.563093    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-464wz\""
Jul 06 12:30:44.656249 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.656215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"]
Jul 06 12:30:44.691820 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691785    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691899    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7bn\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-kube-api-access-pd7bn\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.691957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692271 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.692089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692271 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.692130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.692271 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.692195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.792948 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.792913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.792948 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.792953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7bn\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-kube-api-access-pd7bn\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793188 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.792977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793188 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.792993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793331 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793331 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793331 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793503 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793503 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793503 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793457    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793726    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793739    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.793885 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793804    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.794008 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.793992    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.795925 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.795903    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.796292 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.796172    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.809362 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.809273    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7bn\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-kube-api-access-pd7bn\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.811201 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.811176    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vgzqz\" (UID: \"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:44.869511 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:44.869484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:45.011999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.011960    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"]
Jul 06 12:30:45.016633 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:30:45.016609    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc6b2c7_5546_4ef8_9e45_f3630d12c3b3.slice/crio-4ac7e79f0125eaa1ad6157fee3290bab15a2f0fd0345b9887a8ddbc6b243ba1d WatchSource:0}: Error finding container 4ac7e79f0125eaa1ad6157fee3290bab15a2f0fd0345b9887a8ddbc6b243ba1d: Status 404 returned error can't find the container with id 4ac7e79f0125eaa1ad6157fee3290bab15a2f0fd0345b9887a8ddbc6b243ba1d
Jul 06 12:30:45.018611 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.018577    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:30:45.018715 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.018674    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:30:45.018775 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.018729    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:30:45.938618 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.938579    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" event={"ID":"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3","Type":"ContainerStarted","Data":"c4502d7ed0671de15e6d37b5232e07e94a3b2f59b4f1c082a8425cb6df1486cf"}
Jul 06 12:30:45.939004 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.938673    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" event={"ID":"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3","Type":"ContainerStarted","Data":"4ac7e79f0125eaa1ad6157fee3290bab15a2f0fd0345b9887a8ddbc6b243ba1d"}
Jul 06 12:30:45.971858 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:45.971812    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" podStartSLOduration=1.971796404 podStartE2EDuration="1.971796404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:45.969613473 +0000 UTC m=+477.665318142" watchObservedRunningTime="2026-07-06 12:30:45.971796404 +0000 UTC m=+477.667501052"
Jul 06 12:30:46.869765 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:46.869732    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:46.874734 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:46.874704    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:46.943551 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:46.943515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:46.944561 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:46.944540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:30:48.345776 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.345737    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:48.349719 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.349694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:48.370945 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.370922    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vgnkc\""
Jul 06 12:30:48.421580 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.421538    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2cb\" (UniqueName: \"kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb\") pod \"authorino-58cd955675-gz8xw\" (UID: \"ceca4e33-bbbe-44cc-bc6e-472bcda68f50\") " pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:48.454164 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.454126    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:48.522609 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.522570    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2cb\" (UniqueName: \"kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb\") pod \"authorino-58cd955675-gz8xw\" (UID: \"ceca4e33-bbbe-44cc-bc6e-472bcda68f50\") " pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:48.544386 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.544358    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2cb\" (UniqueName: \"kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb\") pod \"authorino-58cd955675-gz8xw\" (UID: \"ceca4e33-bbbe-44cc-bc6e-472bcda68f50\") " pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:48.659529 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.659446    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:48.834300 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.834193    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:48.836872 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:30:48.836843    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podceca4e33_bbbe_44cc_bc6e_472bcda68f50.slice/crio-4feb4e7bdef0b0d10abb02885f3a85a05620f792d145a9689c511b150102360b WatchSource:0}: Error finding container 4feb4e7bdef0b0d10abb02885f3a85a05620f792d145a9689c511b150102360b: Status 404 returned error can't find the container with id 4feb4e7bdef0b0d10abb02885f3a85a05620f792d145a9689c511b150102360b
Jul 06 12:30:48.953440 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:48.953349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gz8xw" event={"ID":"ceca4e33-bbbe-44cc-bc6e-472bcda68f50","Type":"ContainerStarted","Data":"4feb4e7bdef0b0d10abb02885f3a85a05620f792d145a9689c511b150102360b"}
Jul 06 12:30:51.975869 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:51.975839    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gz8xw" event={"ID":"ceca4e33-bbbe-44cc-bc6e-472bcda68f50","Type":"ContainerStarted","Data":"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"}
Jul 06 12:30:52.002750 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:52.002699    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gz8xw" podStartSLOduration=0.933063389 podStartE2EDuration="4.002682596s" totalImagesPullingTime="3.069619207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:52.001193508 +0000 UTC m=+483.696898160" watchObservedRunningTime="2026-07-06 12:30:52.002682596 +0000 UTC m=+483.698387295"
Jul 06 12:30:53.923239 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:53.923201    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:53.985230 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:53.985193    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gz8xw" podUID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" containerName="authorino" containerID="cri-o://f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523" gracePeriod=30
Jul 06 12:30:54.232134 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.232109    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:54.379287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.379258    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2cb\" (UniqueName: \"kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb\") pod \"ceca4e33-bbbe-44cc-bc6e-472bcda68f50\" (UID: \"ceca4e33-bbbe-44cc-bc6e-472bcda68f50\") "
Jul 06 12:30:54.381326 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.381284    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb" (OuterVolumeSpecName: "kube-api-access-pj2cb") pod "ceca4e33-bbbe-44cc-bc6e-472bcda68f50" (UID: "ceca4e33-bbbe-44cc-bc6e-472bcda68f50"). InnerVolumeSpecName "kube-api-access-pj2cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:30:54.480445 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.480367    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj2cb\" (UniqueName: \"kubernetes.io/projected/ceca4e33-bbbe-44cc-bc6e-472bcda68f50-kube-api-access-pj2cb\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:30:54.990811 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.990773    2570 generic.go:356] "Generic (PLEG): container finished" podID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" containerID="f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523" exitCode=0
Jul 06 12:30:54.991299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.990828    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gz8xw" event={"ID":"ceca4e33-bbbe-44cc-bc6e-472bcda68f50","Type":"ContainerDied","Data":"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"}
Jul 06 12:30:54.991299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.990840    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gz8xw"
Jul 06 12:30:54.991299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.990860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gz8xw" event={"ID":"ceca4e33-bbbe-44cc-bc6e-472bcda68f50","Type":"ContainerDied","Data":"4feb4e7bdef0b0d10abb02885f3a85a05620f792d145a9689c511b150102360b"}
Jul 06 12:30:54.991299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.990875    2570 scope.go:117] "RemoveContainer" containerID="f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"
Jul 06 12:30:54.999221 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.999203    2570 scope.go:117] "RemoveContainer" containerID="f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"
Jul 06 12:30:54.999474 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:30:54.999457    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523\": container with ID starting with f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523 not found: ID does not exist" containerID="f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"
Jul 06 12:30:54.999573 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:54.999483    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523"} err="failed to get container status \"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523\": rpc error: code = NotFound desc = could not find container \"f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523\": container with ID starting with f971d7c6a46440b187595b54c8c1ccd203a2be6fdde4cd3ebaf5c3c056098523 not found: ID does not exist"
Jul 06 12:30:55.015285 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:55.015256    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:55.020802 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:55.020779    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gz8xw"]
Jul 06 12:30:56.814110 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:30:56.814076    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" path="/var/lib/kubelet/pods/ceca4e33-bbbe-44cc-bc6e-472bcda68f50/volumes"
Jul 06 12:32:13.344113 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.344076    2570 generic.go:356] "Generic (PLEG): container finished" podID="8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3" containerID="c4502d7ed0671de15e6d37b5232e07e94a3b2f59b4f1c082a8425cb6df1486cf" exitCode=0
Jul 06 12:32:13.344542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.344150    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" event={"ID":"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3","Type":"ContainerDied","Data":"c4502d7ed0671de15e6d37b5232e07e94a3b2f59b4f1c082a8425cb6df1486cf"}
Jul 06 12:32:13.344589 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.344561    2570 scope.go:117] "RemoveContainer" containerID="c4502d7ed0671de15e6d37b5232e07e94a3b2f59b4f1c082a8425cb6df1486cf"
Jul 06 12:32:13.345585 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.345562    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:32:13.345657 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.345625    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:32:13.345694 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:13.345655    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:32:14.354732 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:14.353772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" event={"ID":"8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3","Type":"ContainerStarted","Data":"08ad8a3106a605e13acc4819625c22fe69f08a37d02fa065ef6561d4413c2af2"}
Jul 06 12:32:14.870584 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:14.870545    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:32:14.871613 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:14.871578    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vgzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 06 12:32:14.871759 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:14.871631    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" podUID="8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 06 12:32:15.869994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:15.869958    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vgzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 06 12:32:15.870435 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:15.870007    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" podUID="8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 06 12:32:16.870842 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:16.870806    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vgzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 06 12:32:16.871235 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:16.870868    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" podUID="8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 06 12:32:16.944331 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:16.944267    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:32:17.870191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:17.870144    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vgzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 06 12:32:17.870410 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:17.870220    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz" podUID="8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 06 12:32:18.874263 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:18.874229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:32:18.875192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:18.875170    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vgzqz"
Jul 06 12:32:33.643371 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.643328    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"]
Jul 06 12:32:33.643932 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.643910    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" containerName="authorino"
Jul 06 12:32:33.643980 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.643937    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" containerName="authorino"
Jul 06 12:32:33.644058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.644045    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceca4e33-bbbe-44cc-bc6e-472bcda68f50" containerName="authorino"
Jul 06 12:32:33.646723 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.646705    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.652403 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.652382    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 12:32:33.652639 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.652478    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 12:32:33.655058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.655039    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lkt9g\""
Jul 06 12:32:33.655149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.655043    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 12:32:33.673371 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.673349    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"]
Jul 06 12:32:33.753680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.753847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753690    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.753847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.753847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.753847 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.753987 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.753866    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z68d5\" (UniqueName: \"kubernetes.io/projected/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-kube-api-access-z68d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855248 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z68d5\" (UniqueName: \"kubernetes.io/projected/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-kube-api-access-z68d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855450 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855437    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855747 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855727    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855815 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855783    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.855815 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.855791    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.857552 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.857529    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.857815 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.857797    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.898441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.898380    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z68d5\" (UniqueName: \"kubernetes.io/projected/5bb90558-9150-4ef1-8e7d-b0adcdeabc89-kube-api-access-z68d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bpbsw\" (UID: \"5bb90558-9150-4ef1-8e7d-b0adcdeabc89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:33.956901 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:33.956875    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:34.211813 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:34.211682    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"]
Jul 06 12:32:34.214102 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:32:34.214076    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb90558_9150_4ef1_8e7d_b0adcdeabc89.slice/crio-aac07e5844e7a0b6f23a2fc85c16791f401ea156e4fbc95ee04029f373856a2a WatchSource:0}: Error finding container aac07e5844e7a0b6f23a2fc85c16791f401ea156e4fbc95ee04029f373856a2a: Status 404 returned error can't find the container with id aac07e5844e7a0b6f23a2fc85c16791f401ea156e4fbc95ee04029f373856a2a
Jul 06 12:32:34.456270 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:34.456198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw" event={"ID":"5bb90558-9150-4ef1-8e7d-b0adcdeabc89","Type":"ContainerStarted","Data":"aac07e5844e7a0b6f23a2fc85c16791f401ea156e4fbc95ee04029f373856a2a"}
Jul 06 12:32:35.462911 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:35.462873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw" event={"ID":"5bb90558-9150-4ef1-8e7d-b0adcdeabc89","Type":"ContainerStarted","Data":"d58c35ce43ea10532d68ac12f0c4aba02105d63fcf8440c9b829ea993c40961c"}
Jul 06 12:32:35.490024 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:35.489974    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw" podStartSLOduration=1.482744444 podStartE2EDuration="2.489958516s" totalImagesPullingTime="1.007214072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:35.487964515 +0000 UTC m=+587.183669193" watchObservedRunningTime="2026-07-06 12:32:35.489958516 +0000 UTC m=+587.185663155"
Jul 06 12:32:43.957763 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:43.957726    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:43.958292 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:43.957796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:43.970568 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:43.970542    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:44.516527 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:44.516499    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bpbsw"
Jul 06 12:32:54.365566 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.365535    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"]
Jul 06 12:32:54.368137 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.368109    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.371165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.371142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 12:32:54.387432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.387403    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"]
Jul 06 12:32:54.441585 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.441783 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.441783 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.441783 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e4378a-7189-4715-81af-e70ef1041d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.441783 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4l7h\" (UniqueName: \"kubernetes.io/projected/a4e4378a-7189-4715-81af-e70ef1041d13-kube-api-access-h4l7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.441981 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.441815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.542913 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.542879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.542913 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.542913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e4378a-7189-4715-81af-e70ef1041d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543186 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.542936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4l7h\" (UniqueName: \"kubernetes.io/projected/a4e4378a-7189-4715-81af-e70ef1041d13-kube-api-access-h4l7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543186 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.542961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543186 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.543034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543186 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.543073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543435 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.543407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543515 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.543492    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.543562 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.543535    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.545284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.545265    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4e4378a-7189-4715-81af-e70ef1041d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.545548 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.545531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e4378a-7189-4715-81af-e70ef1041d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.553014 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.552993    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4l7h\" (UniqueName: \"kubernetes.io/projected/a4e4378a-7189-4715-81af-e70ef1041d13-kube-api-access-h4l7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6\" (UID: \"a4e4378a-7189-4715-81af-e70ef1041d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.678424 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.678346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:32:54.827952 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.827930    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"]
Jul 06 12:32:54.829971 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:32:54.829943    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e4378a_7189_4715_81af_e70ef1041d13.slice/crio-f90749ef3e8a035f5bf54c78a328691c24e3d43524a6c12fd411177fdcab8745 WatchSource:0}: Error finding container f90749ef3e8a035f5bf54c78a328691c24e3d43524a6c12fd411177fdcab8745: Status 404 returned error can't find the container with id f90749ef3e8a035f5bf54c78a328691c24e3d43524a6c12fd411177fdcab8745
Jul 06 12:32:54.831419 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:54.831398    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:32:55.559253 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:55.559216    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6" event={"ID":"a4e4378a-7189-4715-81af-e70ef1041d13","Type":"ContainerStarted","Data":"37ae3c7e28e08248563bf178f28d49350b13879217f027013e382020da7725a4"}
Jul 06 12:32:55.559779 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:32:55.559274    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6" event={"ID":"a4e4378a-7189-4715-81af-e70ef1041d13","Type":"ContainerStarted","Data":"f90749ef3e8a035f5bf54c78a328691c24e3d43524a6c12fd411177fdcab8745"}
Jul 06 12:33:04.679002 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:04.678964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:33:04.679400 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:04.679070    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:33:04.691810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:04.691778    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:33:04.712727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:04.712682    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6" podStartSLOduration=10.522148244 podStartE2EDuration="10.712668432s" totalImagesPullingTime="190.520188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:55.585568475 +0000 UTC m=+607.281273124" watchObservedRunningTime="2026-07-06 12:33:04.712668432 +0000 UTC m=+616.408373081"
Jul 06 12:33:05.616456 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:05.616430    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6"
Jul 06 12:33:07.959481 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:07.959450    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"]
Jul 06 12:33:07.965668 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:07.965643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:07.969013 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:07.968997    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 12:33:07.984685 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:07.984658    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"]
Jul 06 12:33:08.079206 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d520ef3a-c715-435d-9b52-61c97000bb79-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.079411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.079411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.079411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.079411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jln5m\" (UniqueName: \"kubernetes.io/projected/d520ef3a-c715-435d-9b52-61c97000bb79-kube-api-access-jln5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.079571 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.079469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180087 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d520ef3a-c715-435d-9b52-61c97000bb79-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180087 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180358 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180358 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180358 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jln5m\" (UniqueName: \"kubernetes.io/projected/d520ef3a-c715-435d-9b52-61c97000bb79-kube-api-access-jln5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180358 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180637 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180613    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180708 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180647    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.180708 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.180676    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.182565 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.182537    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d520ef3a-c715-435d-9b52-61c97000bb79-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.182690 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.182644    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d520ef3a-c715-435d-9b52-61c97000bb79-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.194565 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.194541    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jln5m\" (UniqueName: \"kubernetes.io/projected/d520ef3a-c715-435d-9b52-61c97000bb79-kube-api-access-jln5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f\" (UID: \"d520ef3a-c715-435d-9b52-61c97000bb79\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.275132 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.275096    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:08.431436 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.431399    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"]
Jul 06 12:33:08.437238 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:33:08.437210    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd520ef3a_c715_435d_9b52_61c97000bb79.slice/crio-6c0640d4112c8f0bc3e1a21cc6a5effa0c053671b6e620bf6d2d8d838aec035e WatchSource:0}: Error finding container 6c0640d4112c8f0bc3e1a21cc6a5effa0c053671b6e620bf6d2d8d838aec035e: Status 404 returned error can't find the container with id 6c0640d4112c8f0bc3e1a21cc6a5effa0c053671b6e620bf6d2d8d838aec035e
Jul 06 12:33:08.620672 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:08.620589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f" event={"ID":"d520ef3a-c715-435d-9b52-61c97000bb79","Type":"ContainerStarted","Data":"6c0640d4112c8f0bc3e1a21cc6a5effa0c053671b6e620bf6d2d8d838aec035e"}
Jul 06 12:33:09.626736 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:09.626698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f" event={"ID":"d520ef3a-c715-435d-9b52-61c97000bb79","Type":"ContainerStarted","Data":"1553f8b325a4dd9dfd70d6ca97d1d1d111b0369b1a316e395da5646899ba10c0"}
Jul 06 12:33:09.653596 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:09.653540    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f" podStartSLOduration=2.453989059 podStartE2EDuration="2.653524328s" totalImagesPullingTime="199.535269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:33:09.652517647 +0000 UTC m=+621.348222296" watchObservedRunningTime="2026-07-06 12:33:09.653524328 +0000 UTC m=+621.349228976"
Jul 06 12:33:18.276138 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:18.276047    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:18.276138 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:18.276100    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:18.289216 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:18.289186    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:33:18.682202 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:33:18.682104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f"
Jul 06 12:40:21.024825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:21.024786    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:40:21.025424 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:21.024997    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" podUID="73324d72-e141-416f-b8fc-c59debb0a0c1" containerName="manager" containerID="cri-o://082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550" gracePeriod=10
Jul 06 12:40:23.682728 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.682703    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:40:23.719706 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.719619    2570 generic.go:356] "Generic (PLEG): container finished" podID="73324d72-e141-416f-b8fc-c59debb0a0c1" containerID="082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550" exitCode=0
Jul 06 12:40:23.719706 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.719661    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"
Jul 06 12:40:23.719929 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.719703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" event={"ID":"73324d72-e141-416f-b8fc-c59debb0a0c1","Type":"ContainerDied","Data":"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"}
Jul 06 12:40:23.719929 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.719758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5" event={"ID":"73324d72-e141-416f-b8fc-c59debb0a0c1","Type":"ContainerDied","Data":"3d4a57577e75f05ff438afe4935884e6f5526f87fd9d3617071d8de2a5ff0f7b"}
Jul 06 12:40:23.719929 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.719781    2570 scope.go:117] "RemoveContainer" containerID="082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"
Jul 06 12:40:23.730759 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.730736    2570 scope.go:117] "RemoveContainer" containerID="082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"
Jul 06 12:40:23.731066 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:40:23.731041    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550\": container with ID starting with 082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550 not found: ID does not exist" containerID="082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"
Jul 06 12:40:23.731162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.731078    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550"} err="failed to get container status \"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550\": rpc error: code = NotFound desc = could not find container \"082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550\": container with ID starting with 082f711d36fe89c0a95c8b672961fa6187b9f02a4c64f4f874a385b88a1f3550 not found: ID does not exist"
Jul 06 12:40:23.757440 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.757408    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr94r\" (UniqueName: \"kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r\") pod \"73324d72-e141-416f-b8fc-c59debb0a0c1\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") "
Jul 06 12:40:23.757602 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.757447    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume\") pod \"73324d72-e141-416f-b8fc-c59debb0a0c1\" (UID: \"73324d72-e141-416f-b8fc-c59debb0a0c1\") "
Jul 06 12:40:23.757871 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.757848    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73324d72-e141-416f-b8fc-c59debb0a0c1" (UID: "73324d72-e141-416f-b8fc-c59debb0a0c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:40:23.759795 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.759767    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r" (OuterVolumeSpecName: "kube-api-access-sr94r") pod "73324d72-e141-416f-b8fc-c59debb0a0c1" (UID: "73324d72-e141-416f-b8fc-c59debb0a0c1"). InnerVolumeSpecName "kube-api-access-sr94r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:40:23.858762 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.858726    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr94r\" (UniqueName: \"kubernetes.io/projected/73324d72-e141-416f-b8fc-c59debb0a0c1-kube-api-access-sr94r\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:40:23.858762 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:23.858756    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73324d72-e141-416f-b8fc-c59debb0a0c1-extensions-socket-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:40:24.044056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:24.044020    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:40:24.048342 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:24.048303    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh4v5"]
Jul 06 12:40:24.815482 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:40:24.815444    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73324d72-e141-416f-b8fc-c59debb0a0c1" path="/var/lib/kubelet/pods/73324d72-e141-416f-b8fc-c59debb0a0c1/volumes"
Jul 06 12:41:22.194745 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.194706    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"]
Jul 06 12:41:22.195268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.195074    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73324d72-e141-416f-b8fc-c59debb0a0c1" containerName="manager"
Jul 06 12:41:22.195268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.195084    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="73324d72-e141-416f-b8fc-c59debb0a0c1" containerName="manager"
Jul 06 12:41:22.195268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.195146    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="73324d72-e141-416f-b8fc-c59debb0a0c1" containerName="manager"
Jul 06 12:41:22.198017 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.197998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.200523 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.200504    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-drd6q\""
Jul 06 12:41:22.214332 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.214283    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"]
Jul 06 12:41:22.289531 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.289500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0cc3a8c-5587-4da1-af89-9772e227845f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.289711 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.289535    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxh9\" (UniqueName: \"kubernetes.io/projected/f0cc3a8c-5587-4da1-af89-9772e227845f-kube-api-access-4wxh9\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.390622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.390583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0cc3a8c-5587-4da1-af89-9772e227845f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.390622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.390622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxh9\" (UniqueName: \"kubernetes.io/projected/f0cc3a8c-5587-4da1-af89-9772e227845f-kube-api-access-4wxh9\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.391001 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.390980    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0cc3a8c-5587-4da1-af89-9772e227845f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.399443 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.399415    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxh9\" (UniqueName: \"kubernetes.io/projected/f0cc3a8c-5587-4da1-af89-9772e227845f-kube-api-access-4wxh9\") pod \"kuadrant-operator-controller-manager-86878c769f-9mzgb\" (UID: \"f0cc3a8c-5587-4da1-af89-9772e227845f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.507942 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.507909    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:22.656441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.656416    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"]
Jul 06 12:41:22.659279 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:41:22.659251    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cc3a8c_5587_4da1_af89_9772e227845f.slice/crio-7a5c46798b28d3e9459668c1fe121f95b53e7ce4d9a093d138826ef683aef1ba WatchSource:0}: Error finding container 7a5c46798b28d3e9459668c1fe121f95b53e7ce4d9a093d138826ef683aef1ba: Status 404 returned error can't find the container with id 7a5c46798b28d3e9459668c1fe121f95b53e7ce4d9a093d138826ef683aef1ba
Jul 06 12:41:22.997185 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.997147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb" event={"ID":"f0cc3a8c-5587-4da1-af89-9772e227845f","Type":"ContainerStarted","Data":"dc07cdece7dd72c7eee625a0d898b200169918525c9fb062bb10ca8408b69c61"}
Jul 06 12:41:22.997435 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.997203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb" event={"ID":"f0cc3a8c-5587-4da1-af89-9772e227845f","Type":"ContainerStarted","Data":"7a5c46798b28d3e9459668c1fe121f95b53e7ce4d9a093d138826ef683aef1ba"}
Jul 06 12:41:22.997435 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:22.997256    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:41:23.019357 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:23.018991    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb" podStartSLOduration=1.018975294 podStartE2EDuration="1.018975294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:41:23.017796602 +0000 UTC m=+1114.713501276" watchObservedRunningTime="2026-07-06 12:41:23.018975294 +0000 UTC m=+1114.714679942"
Jul 06 12:41:34.004291 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:41:34.004256    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9mzgb"
Jul 06 12:47:45.259558 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.259528    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:45.262992 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.262973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.266763 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.266741    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a7d35e82-openshift-default-dockercfg-qvg24\""
Jul 06 12:47:45.280281 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.280257    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:45.376515 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376683 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376520    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376683 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376683 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376683 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376822 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376822 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376822 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.376822 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.376816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5p59\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477501 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477686 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477686 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477686 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477686 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477686 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5p59\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477926 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477926 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.477926 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.477777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.478082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.478026    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.478082 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.478051    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.478184 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.478127    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.478398 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.478371    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.478500 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.478435    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.480196 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.480176    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.480196 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.480186    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.488723 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.488701    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.489026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.489007    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5p59\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59\") pod \"e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") " pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.573288 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.573214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:45.717740 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.717715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:45.719697 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:47:45.719673    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c70cd31_5bfb_48b8_be25_9b8450e6f6e6.slice/crio-8c95a218243f7466e17f186473871254179d6450676decba31f8c51fd2524627 WatchSource:0}: Error finding container 8c95a218243f7466e17f186473871254179d6450676decba31f8c51fd2524627: Status 404 returned error can't find the container with id 8c95a218243f7466e17f186473871254179d6450676decba31f8c51fd2524627
Jul 06 12:47:45.721756 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.721722    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:45.721850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.721802    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:45.721910 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.721846    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:45.828520 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.828430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" event={"ID":"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6","Type":"ContainerStarted","Data":"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"}
Jul 06 12:47:45.828520 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.828481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" event={"ID":"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6","Type":"ContainerStarted","Data":"8c95a218243f7466e17f186473871254179d6450676decba31f8c51fd2524627"}
Jul 06 12:47:45.856356 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:45.856279    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" podStartSLOduration=0.856260844 podStartE2EDuration="856.260844ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:45.85350053 +0000 UTC m=+1497.549205238" watchObservedRunningTime="2026-07-06 12:47:45.856260844 +0000 UTC m=+1497.551965493"
Jul 06 12:47:46.573861 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:46.573816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:46.578568 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:46.578538    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:46.832734 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:46.832653    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:46.833569 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:46.833549    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:51.804692 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:51.804649    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:51.805240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:51.804881    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" podUID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" containerName="istio-proxy" containerID="cri-o://b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b" gracePeriod=30
Jul 06 12:47:57.863578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.863552    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:57.900805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.900719    2570 generic.go:356] "Generic (PLEG): container finished" podID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" containerID="b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b" exitCode=0
Jul 06 12:47:57.900805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.900784    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"
Jul 06 12:47:57.901015 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.900810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" event={"ID":"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6","Type":"ContainerDied","Data":"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"}
Jul 06 12:47:57.901015 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.900876    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx" event={"ID":"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6","Type":"ContainerDied","Data":"8c95a218243f7466e17f186473871254179d6450676decba31f8c51fd2524627"}
Jul 06 12:47:57.901015 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.900906    2570 scope.go:117] "RemoveContainer" containerID="b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"
Jul 06 12:47:57.909542 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.909523    2570 scope.go:117] "RemoveContainer" containerID="b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"
Jul 06 12:47:57.909805 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:47:57.909785    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b\": container with ID starting with b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b not found: ID does not exist" containerID="b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"
Jul 06 12:47:57.909869 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:57.909814    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b"} err="failed to get container status \"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b\": rpc error: code = NotFound desc = could not find container \"b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b\": container with ID starting with b177a16409bb90c3f9524c99921ce84c56525ab98f2ba2bb88653120d0223e3b not found: ID does not exist"
Jul 06 12:47:58.015656 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015621    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5p59\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015656 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015683    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015710    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015759    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015843    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.015916 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015880    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.016176 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.015988    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:47:58.016176 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016108    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo\") pod \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\" (UID: \"6c70cd31-5bfb-48b8-be25-9b8450e6f6e6\") "
Jul 06 12:47:58.016284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016197    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:47:58.016378 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016332    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:47:58.016525 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016504    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.016692 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016673    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.016803 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016696    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.016803 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016620    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:47:58.016803 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.016712    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:47:58.018364 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.018336    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:47:58.018459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.018446    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:47:58.018582 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.018566    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59" (OuterVolumeSpecName: "kube-api-access-l5p59") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "kube-api-access-l5p59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:47:58.018638 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.018624    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" (UID: "6c70cd31-5bfb-48b8-be25-9b8450e6f6e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:47:58.117805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117771    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.117805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117800    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5p59\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-kube-api-access-l5p59\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.117805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117809    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.118035 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117819    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.118035 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117827    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.118035 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.117834    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:47:58.225229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.225195    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:58.230591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.230570    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a7d35e82-openshift-default-6484f4cd85-gjgsx"]
Jul 06 12:47:58.691555 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.691516    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:47:58.692100 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.692084    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" containerName="istio-proxy"
Jul 06 12:47:58.692177 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.692103    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" containerName="istio-proxy"
Jul 06 12:47:58.692229 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.692218    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" containerName="istio-proxy"
Jul 06 12:47:58.695543 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.695521    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.699066 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.699046    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-22175320-openshift-default-dockercfg-ndx8r\""
Jul 06 12:47:58.714466 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.714441    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:47:58.816646 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.816616    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c70cd31-5bfb-48b8-be25-9b8450e6f6e6" path="/var/lib/kubelet/pods/6c70cd31-5bfb-48b8-be25-9b8450e6f6e6/volumes"
Jul 06 12:47:58.824800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh5xk\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.824860 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.824860 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.824947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.824992 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.825031 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.824998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.825031 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.825028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.825105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.825051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.825105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.825093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.926636 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh5xk\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926774    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.926918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927098 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.927057    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927599 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.927144    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927599 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.927171    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927599 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.927451    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.927834 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.927814    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.929249 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.929220    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.929384 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.929368    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.936061 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.936038    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:58.936160 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:58.936106    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh5xk\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk\") pod \"e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") " pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:59.006346 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.006295    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:47:59.144492 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.144458    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:47:59.148054 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:47:59.148015    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12360bfd_0580_427b_8b00_ce2ea5771cd0.slice/crio-fecaca46e7d9e7a6c9a4b91c5559a99f30143b047a66b7d384525fe2e7bfa0d7 WatchSource:0}: Error finding container fecaca46e7d9e7a6c9a4b91c5559a99f30143b047a66b7d384525fe2e7bfa0d7: Status 404 returned error can't find the container with id fecaca46e7d9e7a6c9a4b91c5559a99f30143b047a66b7d384525fe2e7bfa0d7
Jul 06 12:47:59.150513 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.150469    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:59.150648 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.150564    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:59.150648 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.150616    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:47:59.912197 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.912158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" event={"ID":"12360bfd-0580-427b-8b00-ce2ea5771cd0","Type":"ContainerStarted","Data":"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"}
Jul 06 12:47:59.912418 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.912212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" event={"ID":"12360bfd-0580-427b-8b00-ce2ea5771cd0","Type":"ContainerStarted","Data":"fecaca46e7d9e7a6c9a4b91c5559a99f30143b047a66b7d384525fe2e7bfa0d7"}
Jul 06 12:47:59.971393 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:47:59.971344    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" podStartSLOduration=1.971327199 podStartE2EDuration="1.971327199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:59.969458583 +0000 UTC m=+1511.665163223" watchObservedRunningTime="2026-07-06 12:47:59.971327199 +0000 UTC m=+1511.667031839"
Jul 06 12:48:00.007378 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:00.007345    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:00.012323 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:00.012287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:00.916744 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:00.916711    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:00.917735 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:00.917713    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:11.296654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:11.296558    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:48:11.297157 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:11.296763    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerName="istio-proxy" containerID="cri-o://c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc" gracePeriod=30
Jul 06 12:48:15.919222 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:15.919184    2570 patch_prober.go:28] interesting pod/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:48:15.919621 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:15.919242    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:48:16.550837 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.550809    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:16.588989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.588922    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.588989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.588960    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.588989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.588984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.588998    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589093    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589118    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh5xk\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589145    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589193    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket\") pod \"12360bfd-0580-427b-8b00-ce2ea5771cd0\" (UID: \"12360bfd-0580-427b-8b00-ce2ea5771cd0\") "
Jul 06 12:48:16.589240 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589206    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:16.589609 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589536    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data" (OuterVolumeSpecName: "istio-data") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:16.589609 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589580    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.589609 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589576    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:48:16.589771 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589720    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:16.589825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.589798    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:16.591411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.591384    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:16.591411 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.591391    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:48:16.591569 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.591417    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk" (OuterVolumeSpecName: "kube-api-access-bh5xk") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "kube-api-access-bh5xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:16.591611 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.591567    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token" (OuterVolumeSpecName: "istio-token") pod "12360bfd-0580-427b-8b00-ce2ea5771cd0" (UID: "12360bfd-0580-427b-8b00-ce2ea5771cd0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:16.690042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690013    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690038    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh5xk\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-kube-api-access-bh5xk\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690047    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12360bfd-0580-427b-8b00-ce2ea5771cd0-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690057    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690066    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690074    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690082    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.690268 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.690090    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12360bfd-0580-427b-8b00-ce2ea5771cd0-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:16.990663 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.990632    2570 generic.go:356] "Generic (PLEG): container finished" podID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerID="c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc" exitCode=0
Jul 06 12:48:16.991056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.990675    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"
Jul 06 12:48:16.991056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.990715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" event={"ID":"12360bfd-0580-427b-8b00-ce2ea5771cd0","Type":"ContainerDied","Data":"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"}
Jul 06 12:48:16.991056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.990767    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld" event={"ID":"12360bfd-0580-427b-8b00-ce2ea5771cd0","Type":"ContainerDied","Data":"fecaca46e7d9e7a6c9a4b91c5559a99f30143b047a66b7d384525fe2e7bfa0d7"}
Jul 06 12:48:16.991056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.990790    2570 scope.go:117] "RemoveContainer" containerID="c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"
Jul 06 12:48:16.999464 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.999448    2570 scope.go:117] "RemoveContainer" containerID="c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"
Jul 06 12:48:16.999718 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:48:16.999696    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc\": container with ID starting with c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc not found: ID does not exist" containerID="c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"
Jul 06 12:48:16.999784 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:16.999725    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc"} err="failed to get container status \"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc\": rpc error: code = NotFound desc = could not find container \"c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc\": container with ID starting with c39612abc80da61cc77d36d74c83a44aece5bf4a8b99ab426b8bc1ad799e0cbc not found: ID does not exist"
Jul 06 12:48:17.011776 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:17.011750    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:48:17.022447 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:17.022426    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-22175320-openshift-default-85f4c677ff-kn5ld"]
Jul 06 12:48:18.348661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.348633    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:18.349170 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.349154    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerName="istio-proxy"
Jul 06 12:48:18.349215 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.349173    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerName="istio-proxy"
Jul 06 12:48:18.349269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.349259    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" containerName="istio-proxy"
Jul 06 12:48:18.352591 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.352573    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.356419 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.356397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-15e56f76-openshift-default-dockercfg-h4jzj\""
Jul 06 12:48:18.367772 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.367748    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:18.405304 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405304 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405320    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtzx\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.405614 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.405591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506360 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506327    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtzx\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506773    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.506867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506825    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.507038 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.506940    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.507038 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.507024    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.507107 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.507076    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.507337 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.507296    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.508767 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.508741    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.508956 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.508941    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.517563 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.517540    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.518651 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.518633    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtzx\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx\") pod \"e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") " pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.663931 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.663847    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:18.807798 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.807739    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:18.810255 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:48:18.810223    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9aa19f_94bc_4e26_b748_3150226b1f66.slice/crio-27fcbb1a9339f5a9548126f0967eccb9576bcfbec8f63a754279f4faab44aa1f WatchSource:0}: Error finding container 27fcbb1a9339f5a9548126f0967eccb9576bcfbec8f63a754279f4faab44aa1f: Status 404 returned error can't find the container with id 27fcbb1a9339f5a9548126f0967eccb9576bcfbec8f63a754279f4faab44aa1f
Jul 06 12:48:18.812321 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.812281    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:48:18.812393 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.812361    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:48:18.812393 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.812390    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:48:18.815124 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:18.815102    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12360bfd-0580-427b-8b00-ce2ea5771cd0" path="/var/lib/kubelet/pods/12360bfd-0580-427b-8b00-ce2ea5771cd0/volumes"
Jul 06 12:48:19.003925 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.003889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" event={"ID":"3f9aa19f-94bc-4e26-b748-3150226b1f66","Type":"ContainerStarted","Data":"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"}
Jul 06 12:48:19.004272 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.003954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" event={"ID":"3f9aa19f-94bc-4e26-b748-3150226b1f66","Type":"ContainerStarted","Data":"27fcbb1a9339f5a9548126f0967eccb9576bcfbec8f63a754279f4faab44aa1f"}
Jul 06 12:48:19.031620 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.031565    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" podStartSLOduration=1.031545995 podStartE2EDuration="1.031545995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:19.030180363 +0000 UTC m=+1530.725885014" watchObservedRunningTime="2026-07-06 12:48:19.031545995 +0000 UTC m=+1530.727250643"
Jul 06 12:48:19.664386 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.664350    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:19.665746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.665722    2570 patch_prober.go:28] interesting pod/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 12:48:19.665867 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:19.665768    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 12:48:20.668442 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:20.668411    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:21.014362 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:21.014334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:21.015237 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:21.015221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:24.186566 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:24.186527    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:24.187053 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:24.186757    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerName="istio-proxy" containerID="cri-o://40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403" gracePeriod=30
Jul 06 12:48:29.444871 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.444797    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:29.510761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.510735    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.510899 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.510770    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.510899 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.510798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511019 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.510995    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511079 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511039    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511079 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511067    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511247 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511215    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwtzx\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511260    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket\") pod \"3f9aa19f-94bc-4e26-b748-3150226b1f66\" (UID: \"3f9aa19f-94bc-4e26-b748-3150226b1f66\") "
Jul 06 12:48:29.511302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511259    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:29.511680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511480    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:29.511680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511492    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:29.511680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511522    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:48:29.511872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511778    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:29.511872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511794    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.511872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511818    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.511872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511834    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9aa19f-94bc-4e26-b748-3150226b1f66-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.511872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.511848    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.513103 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.513073    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:29.513296 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.513270    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:48:29.513410 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.513365    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:48:29.513485 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.513453    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx" (OuterVolumeSpecName: "kube-api-access-jwtzx") pod "3f9aa19f-94bc-4e26-b748-3150226b1f66" (UID: "3f9aa19f-94bc-4e26-b748-3150226b1f66"). InnerVolumeSpecName "kube-api-access-jwtzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:29.613159 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.613127    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwtzx\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-kube-api-access-jwtzx\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.613159 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.613154    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.613376 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.613168    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.613376 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.613182    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:29.613376 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:29.613192    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9aa19f-94bc-4e26-b748-3150226b1f66-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:48:30.067667 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.067634    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerID="40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403" exitCode=0
Jul 06 12:48:30.067825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.067672    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"
Jul 06 12:48:30.067825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.067719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" event={"ID":"3f9aa19f-94bc-4e26-b748-3150226b1f66","Type":"ContainerDied","Data":"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"}
Jul 06 12:48:30.067825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.067776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n" event={"ID":"3f9aa19f-94bc-4e26-b748-3150226b1f66","Type":"ContainerDied","Data":"27fcbb1a9339f5a9548126f0967eccb9576bcfbec8f63a754279f4faab44aa1f"}
Jul 06 12:48:30.067825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.067804    2570 scope.go:117] "RemoveContainer" containerID="40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"
Jul 06 12:48:30.077052 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.077036    2570 scope.go:117] "RemoveContainer" containerID="40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"
Jul 06 12:48:30.077281 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:48:30.077264    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403\": container with ID starting with 40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403 not found: ID does not exist" containerID="40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"
Jul 06 12:48:30.077339 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.077293    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403"} err="failed to get container status \"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403\": rpc error: code = NotFound desc = could not find container \"40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403\": container with ID starting with 40dc1e0a676012b79d1afde55d50b04679dd0c9fb1be33ecacd2d2b5fc616403 not found: ID does not exist"
Jul 06 12:48:30.091490 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.091469    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:30.096279 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.096257    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-15e56f76-openshift-default-5dc4497fcf-dcj6n"]
Jul 06 12:48:30.815041 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:48:30.815009    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" path="/var/lib/kubelet/pods/3f9aa19f-94bc-4e26-b748-3150226b1f66/volumes"
Jul 06 12:50:09.798250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.798213    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:09.798719 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.798689    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerName="istio-proxy"
Jul 06 12:50:09.798719 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.798703    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerName="istio-proxy"
Jul 06 12:50:09.798790 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.798771    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9aa19f-94bc-4e26-b748-3150226b1f66" containerName="istio-proxy"
Jul 06 12:50:09.801657 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.801642    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.805133 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.805112    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-75df4d48-openshift-default-dockercfg-nd2ns\""
Jul 06 12:50:09.834842 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.834801    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:09.944266 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944233    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944463 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944463 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944463 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5st\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944463 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944612 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:09.944705 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:09.944617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.045976 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.045938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.045986    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5st\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046536 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046505    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046868 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046844    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046996 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046951    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046996 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046881    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.046996 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.046898    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.048360 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.048300    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.048805 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.048788    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.055074 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.055039    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5st\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.056287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.056262    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token\") pod \"e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") " pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.111854 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.111825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:10.255797 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.255695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:10.258751 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:50:10.258726    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc972b95f_a8de_4b8d_ac37_dd4a04af360f.slice/crio-dceefa3ea64321f9e75499cdecae1176efa960f59353f0d0fcba7b98393beefa WatchSource:0}: Error finding container dceefa3ea64321f9e75499cdecae1176efa960f59353f0d0fcba7b98393beefa: Status 404 returned error can't find the container with id dceefa3ea64321f9e75499cdecae1176efa960f59353f0d0fcba7b98393beefa
Jul 06 12:50:10.261223 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.261193    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:10.261287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.261260    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:10.261337 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.261288    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:10.548485 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.548446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerStarted","Data":"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"}
Jul 06 12:50:10.548689 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.548512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerStarted","Data":"dceefa3ea64321f9e75499cdecae1176efa960f59353f0d0fcba7b98393beefa"}
Jul 06 12:50:10.574982 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:10.574881    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podStartSLOduration=1.574865704 podStartE2EDuration="1.574865704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:50:10.572732847 +0000 UTC m=+1642.268437524" watchObservedRunningTime="2026-07-06 12:50:10.574865704 +0000 UTC m=+1642.270570353"
Jul 06 12:50:11.113017 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:11.112974    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:11.118039 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:11.118014    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:11.553398 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:11.553363    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:11.554545 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:11.554524    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:27.203237 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.201985    2570 patch_prober.go:28] interesting pod/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:48460->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Jul 06 12:50:27.203237 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.202069    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:48460->10.133.0.43:15021: read: connection reset by peer"
Jul 06 12:50:27.635214 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.635184    2570 generic.go:356] "Generic (PLEG): container finished" podID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerID="d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8" exitCode=0
Jul 06 12:50:27.635403 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.635256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerDied","Data":"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"}
Jul 06 12:50:27.635684 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.635670    2570 scope.go:117] "RemoveContainer" containerID="d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"
Jul 06 12:50:27.636678 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.636652    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:27.636738 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.636723    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:27.636790 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:27.636758    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:28.645459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:28.645426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerStarted","Data":"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"}
Jul 06 12:50:29.112203 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:29.112169    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:29.112445 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:29.112424    2570 patch_prober.go:28] interesting pod/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 06 12:50:29.112505 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:29.112470    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 06 12:50:30.112620 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:30.112578    2570 patch_prober.go:28] interesting pod/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 06 12:50:30.113099 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:30.112637    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 06 12:50:31.113072 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:31.113035    2570 patch_prober.go:28] interesting pod/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 06 12:50:31.113502 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:31.113102    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 06 12:50:31.873849 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:31.873814    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:31.874544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:31.874515    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy" containerID="cri-o://504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7" gracePeriod=30
Jul 06 12:50:37.940108 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:37.940081    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:38.026165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026086    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z5st\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026165 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026154    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026221    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026241    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026269    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026366    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026389    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data\") pod \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\" (UID: \"c972b95f-a8de-4b8d-ac37-dd4a04af360f\") "
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026470    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:50:38.026581 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026480    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:50:38.026949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026711    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.026949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026732    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.026949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026730    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:50:38.026949 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.026781    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:50:38.027420 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.027400    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:50:38.029003 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.028971    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:50:38.029105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.028982    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st" (OuterVolumeSpecName: "kube-api-access-4z5st") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "kube-api-access-4z5st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:50:38.029105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.029014    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:50:38.029105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.029051    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c972b95f-a8de-4b8d-ac37-dd4a04af360f" (UID: "c972b95f-a8de-4b8d-ac37-dd4a04af360f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:50:38.128204 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128172    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128204 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128199    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128204 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128209    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128473 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128217    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128473 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128226    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z5st\" (UniqueName: \"kubernetes.io/projected/c972b95f-a8de-4b8d-ac37-dd4a04af360f-kube-api-access-4z5st\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128473 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128234    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c972b95f-a8de-4b8d-ac37-dd4a04af360f-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.128473 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.128242    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c972b95f-a8de-4b8d-ac37-dd4a04af360f-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:50:38.699184 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.699154    2570 generic.go:356] "Generic (PLEG): container finished" podID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerID="504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7" exitCode=0
Jul 06 12:50:38.699413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.699216    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"
Jul 06 12:50:38.699413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.699228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerDied","Data":"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"}
Jul 06 12:50:38.699413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.699280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz" event={"ID":"c972b95f-a8de-4b8d-ac37-dd4a04af360f","Type":"ContainerDied","Data":"dceefa3ea64321f9e75499cdecae1176efa960f59353f0d0fcba7b98393beefa"}
Jul 06 12:50:38.699413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.699333    2570 scope.go:117] "RemoveContainer" containerID="504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"
Jul 06 12:50:38.708382 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.708356    2570 scope.go:117] "RemoveContainer" containerID="d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"
Jul 06 12:50:38.715890 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.715873    2570 scope.go:117] "RemoveContainer" containerID="504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"
Jul 06 12:50:38.716138 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:50:38.716121    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7\": container with ID starting with 504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7 not found: ID does not exist" containerID="504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"
Jul 06 12:50:38.716193 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.716145    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7"} err="failed to get container status \"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7\": rpc error: code = NotFound desc = could not find container \"504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7\": container with ID starting with 504ab7edd2a4d10d50189554d35903a97ef819e9b48f28c83579784c4bbb7dc7 not found: ID does not exist"
Jul 06 12:50:38.716193 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.716165    2570 scope.go:117] "RemoveContainer" containerID="d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"
Jul 06 12:50:38.716450 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:50:38.716434    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8\": container with ID starting with d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8 not found: ID does not exist" containerID="d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"
Jul 06 12:50:38.716517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.716453    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8"} err="failed to get container status \"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8\": rpc error: code = NotFound desc = could not find container \"d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8\": container with ID starting with d1eddf32ec2dd7de7adee469abf5f87d8a009c666ead7dff5f576dccbd20e1d8 not found: ID does not exist"
Jul 06 12:50:38.775161 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.775134    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:38.817527 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:38.817500    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75df4d48-openshift-default-76dc6c9b7f-688hz"]
Jul 06 12:50:40.814285 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:40.814252    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" path="/var/lib/kubelet/pods/c972b95f-a8de-4b8d-ac37-dd4a04af360f/volumes"
Jul 06 12:50:52.102149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102115    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:50:52.102578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102536    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.102578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102549    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.102578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102560    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.102578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102566    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.102758 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102640    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.102758 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.102648    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c972b95f-a8de-4b8d-ac37-dd4a04af360f" containerName="istio-proxy"
Jul 06 12:50:52.105538 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.105524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.108896 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.108878    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0113cf1b-openshift-default-dockercfg-m945m\""
Jul 06 12:50:52.116715 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.116694    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:50:52.261832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzqtl\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.261832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261875    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261954    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.261996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.262044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.262075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.262364 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.262120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363352 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzqtl\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363352 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363352 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363352 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363687 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363953 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363806    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.363953 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.363851    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.364059 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.364042    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.364117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.364054    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.364117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.364082    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.365596 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.365572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.366068 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.366044    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.375558 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.375538    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.375856 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.375834    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzqtl\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl\") pod \"e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") " pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.416858 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.416832    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:52.560529 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.560504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:50:52.562687 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:50:52.562658    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77ebc82_d7d9_40d8_99da_006b6de3d361.slice/crio-23f6ef344039b9b6f08efde5b22186ff5e3205d233ac82177d003ab7f5eeab98 WatchSource:0}: Error finding container 23f6ef344039b9b6f08efde5b22186ff5e3205d233ac82177d003ab7f5eeab98: Status 404 returned error can't find the container with id 23f6ef344039b9b6f08efde5b22186ff5e3205d233ac82177d003ab7f5eeab98
Jul 06 12:50:52.564774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.564745    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:52.564839 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.564810    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:52.564881 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.564837    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:50:52.766136 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.766085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerStarted","Data":"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"}
Jul 06 12:50:52.766344 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.766155    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerStarted","Data":"23f6ef344039b9b6f08efde5b22186ff5e3205d233ac82177d003ab7f5eeab98"}
Jul 06 12:50:52.789010 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:52.788954    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podStartSLOduration=0.788933254 podStartE2EDuration="788.933254ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:50:52.787443383 +0000 UTC m=+1684.483148058" watchObservedRunningTime="2026-07-06 12:50:52.788933254 +0000 UTC m=+1684.484637905"
Jul 06 12:50:53.417058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:53.417022    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:53.421945 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:53.421921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:53.770792 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:53.770757    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:50:53.771627 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:50:53.771605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:51:07.845105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.845073    2570 generic.go:356] "Generic (PLEG): container finished" podID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerID="dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1" exitCode=0
Jul 06 12:51:07.845557 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.845151    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerDied","Data":"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"}
Jul 06 12:51:07.845619 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.845573    2570 scope.go:117] "RemoveContainer" containerID="dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"
Jul 06 12:51:07.846555 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.846530    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:51:07.846617 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.846596    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:51:07.846660 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:07.846643    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:51:08.770872 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:08.770828    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:51:08.857971 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:08.857932    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerStarted","Data":"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"}
Jul 06 12:51:09.417223 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:09.417185    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:51:09.418234 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:09.418196    2570 patch_prober.go:28] interesting pod/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 12:51:09.418384 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:09.418254    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 12:51:10.417401 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:10.417302    2570 patch_prober.go:28] interesting pod/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 12:51:10.417401 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:10.417377    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 12:51:11.417689 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:11.417647    2570 patch_prober.go:28] interesting pod/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 12:51:11.418247 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:11.417707    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 12:51:12.417832 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:12.417791    2570 patch_prober.go:28] interesting pod/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 12:51:12.418233 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:12.417847    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 12:51:13.421290 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:13.421260    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:51:13.421693 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:13.421544    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:51:13.422156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:51:13.422135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:52:42.932756 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:42.932675    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:52:42.933341 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:42.932942    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" containerID="cri-o://6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd" gracePeriod=30
Jul 06 12:52:43.423851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:43.423816    2570 patch_prober.go:28] interesting pod/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:52:43.424029 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:43.423883    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:52:48.190503 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.190474    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:52:48.275858 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.275831    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.275869    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.275890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276060    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzqtl\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276125    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276209    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276359 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276281    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket\") pod \"a77ebc82-d7d9-40d8-99da-006b6de3d361\" (UID: \"a77ebc82-d7d9-40d8-99da-006b6de3d361\") "
Jul 06 12:52:48.276560 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276531    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:52:48.276733 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276711    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a77ebc82-d7d9-40d8-99da-006b6de3d361-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.276733 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276711    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:52:48.276878 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276804    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:52:48.276878 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276827    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data" (OuterVolumeSpecName: "istio-data") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:52:48.276990 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.276937    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:52:48.278300 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.278261    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token" (OuterVolumeSpecName: "istio-token") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:52:48.278433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.278328    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl" (OuterVolumeSpecName: "kube-api-access-vzqtl") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "kube-api-access-vzqtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:52:48.278433 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.278336    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:52:48.278598 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.278579    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a77ebc82-d7d9-40d8-99da-006b6de3d361" (UID: "a77ebc82-d7d9-40d8-99da-006b6de3d361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:52:48.337019 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.336989    2570 generic.go:356] "Generic (PLEG): container finished" podID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerID="6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd" exitCode=0
Jul 06 12:52:48.337149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.337033    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"
Jul 06 12:52:48.337149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.337076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerDied","Data":"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"}
Jul 06 12:52:48.337149 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.337133    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf" event={"ID":"a77ebc82-d7d9-40d8-99da-006b6de3d361","Type":"ContainerDied","Data":"23f6ef344039b9b6f08efde5b22186ff5e3205d233ac82177d003ab7f5eeab98"}
Jul 06 12:52:48.337252 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.337156    2570 scope.go:117] "RemoveContainer" containerID="6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"
Jul 06 12:52:48.346523 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.346507    2570 scope.go:117] "RemoveContainer" containerID="dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"
Jul 06 12:52:48.353823 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.353804    2570 scope.go:117] "RemoveContainer" containerID="6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"
Jul 06 12:52:48.354057 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:52:48.354038    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd\": container with ID starting with 6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd not found: ID does not exist" containerID="6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"
Jul 06 12:52:48.354106 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.354065    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd"} err="failed to get container status \"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd\": rpc error: code = NotFound desc = could not find container \"6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd\": container with ID starting with 6549b9034f200154891dabfefd0bb9001cd19ec94a082286ff4fe48cf1c0e3cd not found: ID does not exist"
Jul 06 12:52:48.354106 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.354082    2570 scope.go:117] "RemoveContainer" containerID="dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"
Jul 06 12:52:48.354353 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:52:48.354331    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1\": container with ID starting with dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1 not found: ID does not exist" containerID="dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"
Jul 06 12:52:48.354394 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.354361    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1"} err="failed to get container status \"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1\": rpc error: code = NotFound desc = could not find container \"dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1\": container with ID starting with dab9cdb4903ef9e37ab181ee1f431c2ec5d1a10fdf2f0a983ca3771bcc71e1c1 not found: ID does not exist"
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377392    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377419    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377433    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377446    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377458    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzqtl\" (UniqueName: \"kubernetes.io/projected/a77ebc82-d7d9-40d8-99da-006b6de3d361-kube-api-access-vzqtl\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377472    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377484    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.377517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.377497    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a77ebc82-d7d9-40d8-99da-006b6de3d361-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:52:48.379386 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.379367    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:52:48.392878 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.392848    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0113cf1b-openshift-default-7f978df847-4ncbf"]
Jul 06 12:52:48.815096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:52:48.815067    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" path="/var/lib/kubelet/pods/a77ebc82-d7d9-40d8-99da-006b6de3d361/volumes"
Jul 06 12:53:38.769661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.769623    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.769986    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.769997    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.770006    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.770011    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.770077    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.770162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.770087    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77ebc82-d7d9-40d8-99da-006b6de3d361" containerName="istio-proxy"
Jul 06 12:53:38.773153 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.773136    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.776286 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.776263    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-86ab8b-openshift-default-dockercfg-6gblm\""
Jul 06 12:53:38.796048 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.796023    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:53:38.935898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.935863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.935898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.935902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.935925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.935977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4d5\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.936033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.936052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936117 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.936086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936378 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.936267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:38.936378 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:38.936333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037541 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037541 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037541 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.037866 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.037742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4d5\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.038353 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.038283    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.038353 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.038301    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.038714 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.038450    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.038714 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.038488    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.038714 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.038518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.040386 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.040360    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.040559 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.040539    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.052996 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.052975    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.053096 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.053013    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4d5\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5\") pod \"e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") " pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.083983 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.083952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:39.225588 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.225547    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:53:39.227796 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:53:39.227767    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c7608f_0b15_44aa_827b_4ea9bbe99251.slice/crio-68168f356b079200f79b3c8dc8c6cdc89a1f3574cda51d39e3ef121772c45932 WatchSource:0}: Error finding container 68168f356b079200f79b3c8dc8c6cdc89a1f3574cda51d39e3ef121772c45932: Status 404 returned error can't find the container with id 68168f356b079200f79b3c8dc8c6cdc89a1f3574cda51d39e3ef121772c45932
Jul 06 12:53:39.229865 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.229835    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:39.229950 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.229898    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:39.229950 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.229938    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:39.573940 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.573844    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerStarted","Data":"1bc219acbc002cb2bd07576929e6a67ef580ef0fb294267d838772b3860b08f8"}
Jul 06 12:53:39.573940 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.573916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerStarted","Data":"68168f356b079200f79b3c8dc8c6cdc89a1f3574cda51d39e3ef121772c45932"}
Jul 06 12:53:39.596723 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:39.596675    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podStartSLOduration=1.59666105 podStartE2EDuration="1.59666105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:53:39.595291916 +0000 UTC m=+1851.290996567" watchObservedRunningTime="2026-07-06 12:53:39.59666105 +0000 UTC m=+1851.292365698"
Jul 06 12:53:40.085020 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:40.084986    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:40.086442 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:40.086413    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:53:40.086554 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:40.086471    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:53:41.088282 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:41.088251    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:41.584527 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:41.584495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:41.585518 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:41.585489    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:46.754341 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.754268    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:53:46.757903 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.757884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.762327 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.762288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c5c936-openshift-default-dockercfg-p4wq9\""
Jul 06 12:53:46.778791 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.778765    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:53:46.804984 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.804951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.804984 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.804982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805360 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8lx\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.805360 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.805259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.906578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.906540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.906800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.906603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.906800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.906630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.906800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.906647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.906800 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.906681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907032 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907011    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907105 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907057    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907169 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8lx\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907231 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907424 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907620 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907848 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907828    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.907920 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907846    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.908007 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.907983    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.909100 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.909080    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.909299 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.909283    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.915357 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.915333    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:46.915673 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:46.915653    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8lx\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx\") pod \"e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") " pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:47.069021 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.068937    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:47.216760 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:53:47.216728    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ffd04c_1b69_422a_ad91_07dbbdfc6da2.slice/crio-5e8ec9ca5a08b9ad0909b447aa0a68251b2af13777d298478c8a14e7712c18c4 WatchSource:0}: Error finding container 5e8ec9ca5a08b9ad0909b447aa0a68251b2af13777d298478c8a14e7712c18c4: Status 404 returned error can't find the container with id 5e8ec9ca5a08b9ad0909b447aa0a68251b2af13777d298478c8a14e7712c18c4
Jul 06 12:53:47.217277 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.217241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:53:47.218857 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.218827    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:47.218943 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.218900    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:47.218943 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.218928    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:47.613528 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.613493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerStarted","Data":"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"}
Jul 06 12:53:47.613995 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.613553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerStarted","Data":"5e8ec9ca5a08b9ad0909b447aa0a68251b2af13777d298478c8a14e7712c18c4"}
Jul 06 12:53:47.645553 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:47.645495    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podStartSLOduration=1.6454756929999999 podStartE2EDuration="1.645475693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:53:47.643238444 +0000 UTC m=+1859.338943093" watchObservedRunningTime="2026-07-06 12:53:47.645475693 +0000 UTC m=+1859.341180342"
Jul 06 12:53:48.069170 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:48.069123    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:48.074099 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:48.074068    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:48.618556 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:48.618525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:48.619413 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:48.619393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:53:56.585944 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.585862    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:53:56.586377 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.585938    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:53:56.664986 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.664955    2570 generic.go:356] "Generic (PLEG): container finished" podID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerID="1bc219acbc002cb2bd07576929e6a67ef580ef0fb294267d838772b3860b08f8" exitCode=0
Jul 06 12:53:56.665145 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.665005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerDied","Data":"1bc219acbc002cb2bd07576929e6a67ef580ef0fb294267d838772b3860b08f8"}
Jul 06 12:53:56.665455 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.665439    2570 scope.go:117] "RemoveContainer" containerID="1bc219acbc002cb2bd07576929e6a67ef580ef0fb294267d838772b3860b08f8"
Jul 06 12:53:56.666438 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.666411    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:56.666499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.666474    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:56.666535 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:56.666507    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:53:57.672371 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:57.672336    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerStarted","Data":"371a90f39a4a6923bdb5ff304461e85f7ebb3516fb73ecc6c884cc7cc7a68710"}
Jul 06 12:53:58.085146 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:58.085113    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:53:58.085563 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:58.085519    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:53:58.085762 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:58.085731    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:53:59.085124 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:59.085085    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:53:59.085757 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:53:59.085711    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:54:00.088881 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:00.088844    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:54:00.089499 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:00.089464    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:54:01.085172 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:01.085133    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:54:01.085487 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:01.085453    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:54:02.089670 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:02.089634    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:54:02.090157 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:02.090072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:54:02.090810 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:02.090788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:54:04.659493 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:04.659446    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 12:54:04.659909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:04.659553    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 12:54:05.723793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.723760    2570 generic.go:356] "Generic (PLEG): container finished" podID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerID="179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf" exitCode=0
Jul 06 12:54:05.724228 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.723831    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerDied","Data":"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"}
Jul 06 12:54:05.724274 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.724231    2570 scope.go:117] "RemoveContainer" containerID="179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"
Jul 06 12:54:05.725233 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.725203    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:54:05.725355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.725269    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:54:05.725355 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:05.725302    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:54:06.730304 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:06.730268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerStarted","Data":"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"}
Jul 06 12:54:07.069919 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:07.069872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:54:07.070142 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:07.070117    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 12:54:07.070224 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:07.070174    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 12:54:08.070129 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:08.070088    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 12:54:08.070659 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:08.070157    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 12:54:09.070231 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:09.070195    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 12:54:09.070685 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:09.070258    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 12:54:10.069538 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:10.069500    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 12:54:10.069725 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:10.069554    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 12:54:11.072544 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:11.072510    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:54:11.073015 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:11.072787    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:54:11.073476 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:54:11.073460    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:55:26.965789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:26.965757    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:55:26.966455 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:26.965986    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" containerID="cri-o://371a90f39a4a6923bdb5ff304461e85f7ebb3516fb73ecc6c884cc7cc7a68710" gracePeriod=30
Jul 06 12:55:32.091729 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.091695    2570 patch_prober.go:28] interesting pod/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 12:55:32.092090 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.091761    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 12:55:32.159110 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.159079    2570 generic.go:356] "Generic (PLEG): container finished" podID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerID="371a90f39a4a6923bdb5ff304461e85f7ebb3516fb73ecc6c884cc7cc7a68710" exitCode=0
Jul 06 12:55:32.159267 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.159130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerDied","Data":"371a90f39a4a6923bdb5ff304461e85f7ebb3516fb73ecc6c884cc7cc7a68710"}
Jul 06 12:55:32.159267 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.159177    2570 scope.go:117] "RemoveContainer" containerID="1bc219acbc002cb2bd07576929e6a67ef580ef0fb294267d838772b3860b08f8"
Jul 06 12:55:32.219939 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.219916    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:55:32.271014 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.270986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271049    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271146    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271181    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271209 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271210    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf4d5\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271256    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271284    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy\") pod \"38c7608f-0b15-44aa-827b-4ea9bbe99251\" (UID: \"38c7608f-0b15-44aa-827b-4ea9bbe99251\") "
Jul 06 12:55:32.271578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271431    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:32.271578 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271476    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:55:32.271789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271693    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38c7608f-0b15-44aa-827b-4ea9bbe99251-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.271789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271714    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.271789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.271780    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:32.272080 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.272050    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:32.272250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.272222    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data" (OuterVolumeSpecName: "istio-data") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:32.273583 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.273556    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token" (OuterVolumeSpecName: "istio-token") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:55:32.273738 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.273722    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:32.274510 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.274481    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:55:32.274596 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.274523    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5" (OuterVolumeSpecName: "kube-api-access-zf4d5") pod "38c7608f-0b15-44aa-827b-4ea9bbe99251" (UID: "38c7608f-0b15-44aa-827b-4ea9bbe99251"). InnerVolumeSpecName "kube-api-access-zf4d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:55:32.372680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372643    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372674    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372680 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372684    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372694    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf4d5\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-kube-api-access-zf4d5\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372704    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372712    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:32.372989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:32.372720    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38c7608f-0b15-44aa-827b-4ea9bbe99251-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:33.165669 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:33.165589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs" event={"ID":"38c7608f-0b15-44aa-827b-4ea9bbe99251","Type":"ContainerDied","Data":"68168f356b079200f79b3c8dc8c6cdc89a1f3574cda51d39e3ef121772c45932"}
Jul 06 12:55:33.165669 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:33.165606    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"
Jul 06 12:55:33.165669 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:33.165650    2570 scope.go:117] "RemoveContainer" containerID="371a90f39a4a6923bdb5ff304461e85f7ebb3516fb73ecc6c884cc7cc7a68710"
Jul 06 12:55:33.190061 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:33.190032    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:55:33.192047 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:33.192025    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-86ab8b-openshift-default-64cc7c66cf-x9mhs"]
Jul 06 12:55:34.512943 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:34.512912    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:55:34.513371 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:34.513103    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy" containerID="cri-o://94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a" gracePeriod=30
Jul 06 12:55:34.814381 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:34.814270    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" path="/var/lib/kubelet/pods/38c7608f-0b15-44aa-827b-4ea9bbe99251/volumes"
Jul 06 12:55:35.410023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.409992    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:55:35.410434 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410419    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.410488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410438    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.410488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410451    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.410488 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410457    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.410588 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410519    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.410588 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.410531    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38c7608f-0b15-44aa-827b-4ea9bbe99251" containerName="istio-proxy"
Jul 06 12:55:35.413491 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.413469    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.416831 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.416813    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b84121-openshift-default-dockercfg-fspzg\""
Jul 06 12:55:35.432781 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.432759    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:55:35.501480 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501508    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmgtm\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501827 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501827 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501936 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501836    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501936 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.501936 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.501910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.603477 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.603477 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmgtm\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603693    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603906    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.603925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.604101    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.604125    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604432 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.604178    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.604595 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.604434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.606129 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.606105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.606129 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.606120    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.612777 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.612754    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.612888 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.612857    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmgtm\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm\") pod \"e2e-api-a-b84121-openshift-default-7dc559df5-v47gg\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") " pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.723251 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.723164    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:35.863381 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.863354    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:55:35.865425 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:55:35.865397    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0d7121_13f4_4740_bf20_b52846c56910.slice/crio-eed77d6336c93615cd86c1303195098debf780ea8e5ec63df0d5f1a72aa32187 WatchSource:0}: Error finding container eed77d6336c93615cd86c1303195098debf780ea8e5ec63df0d5f1a72aa32187: Status 404 returned error can't find the container with id eed77d6336c93615cd86c1303195098debf780ea8e5ec63df0d5f1a72aa32187
Jul 06 12:55:35.867742 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.867713    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:35.867804 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.867775    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:35.867841 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:35.867804    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:36.183074 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:36.183036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerStarted","Data":"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"}
Jul 06 12:55:36.183255 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:36.183090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerStarted","Data":"eed77d6336c93615cd86c1303195098debf780ea8e5ec63df0d5f1a72aa32187"}
Jul 06 12:55:36.214077 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:36.214025    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podStartSLOduration=1.214008036 podStartE2EDuration="1.214008036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:36.21286499 +0000 UTC m=+1967.908569697" watchObservedRunningTime="2026-07-06 12:55:36.214008036 +0000 UTC m=+1967.909712684"
Jul 06 12:55:36.723967 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:36.723931    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:36.729092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:36.729066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:37.188656 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:37.188631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:37.189663 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:37.189644    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:39.773072 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.773005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:55:39.846536 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846505    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846571    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846640    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846727 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846668    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846813    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846855    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.846947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846930    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:55:39.846947 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846941    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn8lx\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx\") pod \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\" (UID: \"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2\") "
Jul 06 12:55:39.847210 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846929    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:39.847210 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.846958    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:39.847210 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847182    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:39.847415 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847345    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.847415 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847365    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.847415 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847380    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.847415 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847392    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.847718 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.847695    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:39.849024 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.848995    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:55:39.849119 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.849066    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx" (OuterVolumeSpecName: "kube-api-access-jn8lx") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "kube-api-access-jn8lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:55:39.849587 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.849566    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:55:39.849672 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.849588    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" (UID: "a9ffd04c-1b69-422a-ad91-07dbbdfc6da2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:55:39.948899 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.948867    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.948899 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.948894    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.948899 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.948903    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.949136 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.948911    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:39.949136 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:39.948919    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn8lx\" (UniqueName: \"kubernetes.io/projected/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2-kube-api-access-jn8lx\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:55:40.205746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.205626    2570 generic.go:356] "Generic (PLEG): container finished" podID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerID="94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a" exitCode=0
Jul 06 12:55:40.205746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.205676    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"
Jul 06 12:55:40.205983 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.205676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerDied","Data":"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"}
Jul 06 12:55:40.205983 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.205800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2" event={"ID":"a9ffd04c-1b69-422a-ad91-07dbbdfc6da2","Type":"ContainerDied","Data":"5e8ec9ca5a08b9ad0909b447aa0a68251b2af13777d298478c8a14e7712c18c4"}
Jul 06 12:55:40.205983 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.205830    2570 scope.go:117] "RemoveContainer" containerID="94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"
Jul 06 12:55:40.214768 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.214749    2570 scope.go:117] "RemoveContainer" containerID="179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"
Jul 06 12:55:40.222452 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.222427    2570 scope.go:117] "RemoveContainer" containerID="94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"
Jul 06 12:55:40.222713 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:55:40.222694    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a\": container with ID starting with 94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a not found: ID does not exist" containerID="94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"
Jul 06 12:55:40.222761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.222723    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a"} err="failed to get container status \"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a\": rpc error: code = NotFound desc = could not find container \"94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a\": container with ID starting with 94ff5f8ea87ecde73e7d1b86bf4f25abcbdeb35543567bb482bd76d542924b6a not found: ID does not exist"
Jul 06 12:55:40.222761 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.222741    2570 scope.go:117] "RemoveContainer" containerID="179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"
Jul 06 12:55:40.222963 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:55:40.222945    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf\": container with ID starting with 179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf not found: ID does not exist" containerID="179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"
Jul 06 12:55:40.223001 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.222970    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf"} err="failed to get container status \"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf\": rpc error: code = NotFound desc = could not find container \"179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf\": container with ID starting with 179433c67e0d447b4410129e6565fe4a46b753a0a36c60ba276075943eff03cf not found: ID does not exist"
Jul 06 12:55:40.228883 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.228852    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:55:40.234427 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.234405    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c5c936-openshift-default-7cb4f7bd5-wzkr2"]
Jul 06 12:55:40.815169 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:40.815134    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" path="/var/lib/kubelet/pods/a9ffd04c-1b69-422a-ad91-07dbbdfc6da2/volumes"
Jul 06 12:55:43.722056 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722022    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:55:43.722484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722423    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.722484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722436    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.722484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722447    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.722484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722452    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.722642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722514    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.722642 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.722523    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ffd04c-1b69-422a-ad91-07dbbdfc6da2" containerName="istio-proxy"
Jul 06 12:55:43.725885 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.725868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.729446 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.729424    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4a355b-openshift-default-dockercfg-kj2w8\""
Jul 06 12:55:43.740557 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.740533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:55:43.786793 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.786977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.786977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786823    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.786977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.786977 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.787154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.786979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.787154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.787016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.787154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.787035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.787154 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.787052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfp4d\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888042 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888199 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888199 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888199 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888199 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888459 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888625 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfp4d\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888625 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888590    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888625 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.888875 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.888839    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.889022 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.889001    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.889125 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.889105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.890278 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.890258    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.890655 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.890637    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.900392 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.900366    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:43.900587 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:43.900569    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfp4d\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d\") pod \"e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") " pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:44.036465 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.036425    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:44.188731 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.188705    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:55:44.191042 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:55:44.191012    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e72b55e_46a4_4324_ae77_1071f2d8f4ed.slice/crio-a958bcbcf840376871425754b9b3b698c40da8feeccf945631087f078763dca3 WatchSource:0}: Error finding container a958bcbcf840376871425754b9b3b698c40da8feeccf945631087f078763dca3: Status 404 returned error can't find the container with id a958bcbcf840376871425754b9b3b698c40da8feeccf945631087f078763dca3
Jul 06 12:55:44.193095 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.193062    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:44.193159 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.193127    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:44.193200 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.193160    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:44.232089 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:44.232058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerStarted","Data":"a958bcbcf840376871425754b9b3b698c40da8feeccf945631087f078763dca3"}
Jul 06 12:55:45.239163 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:45.239076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerStarted","Data":"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"}
Jul 06 12:55:45.264901 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:45.264833    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podStartSLOduration=2.264810401 podStartE2EDuration="2.264810401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:45.261153886 +0000 UTC m=+1976.956858536" watchObservedRunningTime="2026-07-06 12:55:45.264810401 +0000 UTC m=+1976.960515052"
Jul 06 12:55:46.037789 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:46.037754    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:46.050617 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:46.050578    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:46.247633 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:46.247598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:46.249945 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:46.249913    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:55:52.190484 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.190446    2570 patch_prober.go:28] interesting pod/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 12:55:52.190898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.190511    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 12:55:52.283618 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.283587    2570 generic.go:356] "Generic (PLEG): container finished" podID="8a0d7121-13f4-4740-bf20-b52846c56910" containerID="c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2" exitCode=0
Jul 06 12:55:52.283774 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.283658    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerDied","Data":"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"}
Jul 06 12:55:52.284107 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.284087    2570 scope.go:117] "RemoveContainer" containerID="c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"
Jul 06 12:55:52.285176 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.285150    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:52.285245 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.285230    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:52.285302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:52.285290    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:55:53.290014 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:53.289979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerStarted","Data":"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"}
Jul 06 12:55:53.724032 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:53.723938    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:53.724192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:53.724138    2570 patch_prober.go:28] interesting pod/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 12:55:53.724192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:53.724179    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 12:55:54.723517 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:54.723484    2570 patch_prober.go:28] interesting pod/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 12:55:54.723898 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:54.723533    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 12:55:55.724654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:55.724566    2570 patch_prober.go:28] interesting pod/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 12:55:55.724654 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:55.724623    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 12:55:56.723870 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:56.723829    2570 patch_prober.go:28] interesting pod/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 12:55:56.724067 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:56.723906    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 12:55:57.727901 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:57.727872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:57.728377 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:57.728240    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:55:57.728999 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:55:57.728979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:56:07.061232 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.061199    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:56:07.061726 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.061482    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy" containerID="cri-o://3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0" gracePeriod=30
Jul 06 12:56:07.368780 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.368750    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerID="556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1" exitCode=0
Jul 06 12:56:07.369006 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.368824    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerDied","Data":"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"}
Jul 06 12:56:07.369278 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.369264    2570 scope.go:117] "RemoveContainer" containerID="556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"
Jul 06 12:56:07.370275 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.370249    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:07.370361 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.370347    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:07.370402 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:07.370385    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:08.375880 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:08.375845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerStarted","Data":"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"}
Jul 06 12:56:09.036922 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:09.036830    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:09.037559 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:09.037526    2570 patch_prober.go:28] interesting pod/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 12:56:09.037787 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:09.037761    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 12:56:10.037932 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:10.037887    2570 patch_prober.go:28] interesting pod/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 12:56:10.038482 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:10.037954    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 12:56:11.037532 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:11.037490    2570 patch_prober.go:28] interesting pod/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 12:56:11.037851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:11.037821    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 12:56:12.037371 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.037329    2570 patch_prober.go:28] interesting pod/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 12:56:12.037856 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.037396    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 12:56:12.342243 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.342204    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:56:12.382850 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382863    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382892    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382914    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382943    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmgtm\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383026 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.382967    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383093    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383119    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert\") pod \"8a0d7121-13f4-4740-bf20-b52846c56910\" (UID: \"8a0d7121-13f4-4740-bf20-b52846c56910\") "
Jul 06 12:56:12.383287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383171    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:12.383287 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383209    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:12.383579 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383473    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.383579 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383491    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.383579 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383552    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:12.383812 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.383791    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:12.384460 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.384428    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:12.385464 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.385428    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm" (OuterVolumeSpecName: "kube-api-access-cmgtm") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "kube-api-access-cmgtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:12.385560 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.385506    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:56:12.385663 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.385643    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:12.385705 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.385658    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a0d7121-13f4-4740-bf20-b52846c56910" (UID: "8a0d7121-13f4-4740-bf20-b52846c56910"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:12.397661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.397633    2570 generic.go:356] "Generic (PLEG): container finished" podID="8a0d7121-13f4-4740-bf20-b52846c56910" containerID="3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0" exitCode=0
Jul 06 12:56:12.397766 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.397687    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"
Jul 06 12:56:12.397766 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.397715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerDied","Data":"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"}
Jul 06 12:56:12.397857 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.397773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg" event={"ID":"8a0d7121-13f4-4740-bf20-b52846c56910","Type":"ContainerDied","Data":"eed77d6336c93615cd86c1303195098debf780ea8e5ec63df0d5f1a72aa32187"}
Jul 06 12:56:12.397857 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.397806    2570 scope.go:117] "RemoveContainer" containerID="3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"
Jul 06 12:56:12.406835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.406815    2570 scope.go:117] "RemoveContainer" containerID="c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"
Jul 06 12:56:12.414302 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.414283    2570 scope.go:117] "RemoveContainer" containerID="3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"
Jul 06 12:56:12.414609 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:56:12.414590    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0\": container with ID starting with 3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0 not found: ID does not exist" containerID="3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"
Jul 06 12:56:12.414671 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.414616    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0"} err="failed to get container status \"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0\": rpc error: code = NotFound desc = could not find container \"3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0\": container with ID starting with 3e9eb16628bb678544df6b03ba006d1350cf132db2b949780fdfc7f16cc563d0 not found: ID does not exist"
Jul 06 12:56:12.414671 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.414631    2570 scope.go:117] "RemoveContainer" containerID="c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"
Jul 06 12:56:12.414852 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:56:12.414834    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2\": container with ID starting with c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2 not found: ID does not exist" containerID="c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"
Jul 06 12:56:12.414892 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.414859    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2"} err="failed to get container status \"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2\": rpc error: code = NotFound desc = could not find container \"c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2\": container with ID starting with c756b2b6fc31484e5951339d6ea66a06c6825d2daf855ae4b0e4df33f42531f2 not found: ID does not exist"
Jul 06 12:56:12.425175 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.425150    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:56:12.429211 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.429191    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b84121-openshift-default-7dc559df5-v47gg"]
Jul 06 12:56:12.483965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483926    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.483965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483957    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.483965 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483968    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmgtm\" (UniqueName: \"kubernetes.io/projected/8a0d7121-13f4-4740-bf20-b52846c56910-kube-api-access-cmgtm\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.484192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483978    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.484192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483987    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0d7121-13f4-4740-bf20-b52846c56910-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.484192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.483994    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0d7121-13f4-4740-bf20-b52846c56910-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.484192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.484001    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d7121-13f4-4740-bf20-b52846c56910-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:12.814975 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:12.814941    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" path="/var/lib/kubelet/pods/8a0d7121-13f4-4740-bf20-b52846c56910/volumes"
Jul 06 12:56:13.041142 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:13.041114    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:13.041630 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:13.041392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:13.042153 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:13.042130    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:14.472643 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:14.472605    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:56:15.244955 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.244920    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 12:56:15.245356 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.245341    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:15.245356 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.245357    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:15.245469 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.245367    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:15.245469 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.245373    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:15.245469 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.245444    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:15.248324 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.248286    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.251078 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.251058    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e47695-openshift-default-dockercfg-gkf92\""
Jul 06 12:56:15.260259 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.260202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 12:56:15.312742 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nf7f\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312866    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.312909 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.312907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.313158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.313020    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.313158 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.313051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.412623 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.412580    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy" containerID="cri-o://2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1" gracePeriod=30
Jul 06 12:56:15.414320 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414436 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414436 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414556 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nf7f\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414556 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414661 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414820 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414820 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414740    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414820 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414767    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.414989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.414863    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.415058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.415027    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.415621 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.415599    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.417000 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.416973    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.417211 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.417195    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.423681 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.423657    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nf7f\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.424957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.424923    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token\") pod \"e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") " pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.559763 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.559681    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:15.715915 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.715892    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 12:56:15.718194 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:56:15.718162    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b5b741_8f53_4d51_aaf6_1d2b390b9340.slice/crio-cab7f0d6d679300fd35fc14b7e3beb060b4cbbfeb7438c908905d102f6f96540 WatchSource:0}: Error finding container cab7f0d6d679300fd35fc14b7e3beb060b4cbbfeb7438c908905d102f6f96540: Status 404 returned error can't find the container with id cab7f0d6d679300fd35fc14b7e3beb060b4cbbfeb7438c908905d102f6f96540
Jul 06 12:56:15.720330 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.720281    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:15.720441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.720363    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:15.720441 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:15.720393    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:16.419703 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:16.419661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerStarted","Data":"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"}
Jul 06 12:56:16.419871 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:16.419721    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerStarted","Data":"cab7f0d6d679300fd35fc14b7e3beb060b4cbbfeb7438c908905d102f6f96540"}
Jul 06 12:56:16.453874 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:16.453813    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podStartSLOduration=1.453796956 podStartE2EDuration="1.453796956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:16.451257335 +0000 UTC m=+2008.146962007" watchObservedRunningTime="2026-07-06 12:56:16.453796956 +0000 UTC m=+2008.149501653"
Jul 06 12:56:16.560685 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:16.560650    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:16.565885 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:16.565855    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:17.424773 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:17.424745    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:17.425852 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:17.425830    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:20.673808 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.673747    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:20.768746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.768712    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.768746 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.768745    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.768994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.768764    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfp4d\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.768994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.768812    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.768994 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.768976    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.769156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769029    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.769156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769066    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.769156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769091    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.769156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769125    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket\") pod \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\" (UID: \"1e72b55e-46a4-4324-ae77-1071f2d8f4ed\") "
Jul 06 12:56:20.769394 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769197    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:20.769557 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769512    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:20.769557 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769527    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.769557 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769526    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:20.769835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769627    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:20.769835 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.769722    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:20.771118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.771089    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:20.771217 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.771134    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:56:20.771217 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.771167    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d" (OuterVolumeSpecName: "kube-api-access-dfp4d") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "kube-api-access-dfp4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:20.771303 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.771290    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e72b55e-46a4-4324-ae77-1071f2d8f4ed" (UID: "1e72b55e-46a4-4324-ae77-1071f2d8f4ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:56:20.870721 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870697    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870723    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfp4d\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-kube-api-access-dfp4d\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870737    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870747    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870755    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870764    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870771    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:20.870825 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:20.870779    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e72b55e-46a4-4324-ae77-1071f2d8f4ed-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 12:56:21.446829 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.446794    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerID="2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1" exitCode=0
Jul 06 12:56:21.447028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.446855    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"
Jul 06 12:56:21.447028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.446876    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerDied","Data":"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"}
Jul 06 12:56:21.447028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.446932    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r" event={"ID":"1e72b55e-46a4-4324-ae77-1071f2d8f4ed","Type":"ContainerDied","Data":"a958bcbcf840376871425754b9b3b698c40da8feeccf945631087f078763dca3"}
Jul 06 12:56:21.447028 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.446956    2570 scope.go:117] "RemoveContainer" containerID="2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"
Jul 06 12:56:21.455733 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.455716    2570 scope.go:117] "RemoveContainer" containerID="556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"
Jul 06 12:56:21.463231 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.463212    2570 scope.go:117] "RemoveContainer" containerID="2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"
Jul 06 12:56:21.463502 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:56:21.463485    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1\": container with ID starting with 2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1 not found: ID does not exist" containerID="2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"
Jul 06 12:56:21.463561 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.463516    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1"} err="failed to get container status \"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1\": rpc error: code = NotFound desc = could not find container \"2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1\": container with ID starting with 2cba05adb1b85a43b4acc36b9ea393cb64634fe5b27b6ceea45cfb86568755a1 not found: ID does not exist"
Jul 06 12:56:21.463561 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.463534    2570 scope.go:117] "RemoveContainer" containerID="556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"
Jul 06 12:56:21.463769 ip-10-0-129-248 kubenswrapper[2570]: E0706 12:56:21.463752    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1\": container with ID starting with 556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1 not found: ID does not exist" containerID="556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"
Jul 06 12:56:21.463821 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.463778    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1"} err="failed to get container status \"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1\": rpc error: code = NotFound desc = could not find container \"556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1\": container with ID starting with 556e7dcd8cb6d6a71aee73003d2cfea8d6402500bd6103488137be385a7f84d1 not found: ID does not exist"
Jul 06 12:56:21.467058 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.467035    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:56:21.471424 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:21.471405    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4a355b-openshift-default-58ff7f694f-t7s7r"]
Jul 06 12:56:22.814608 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:22.814578    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" path="/var/lib/kubelet/pods/1e72b55e-46a4-4324-ae77-1071f2d8f4ed/volumes"
Jul 06 12:56:23.592684 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.592648    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 12:56:23.593111 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.593092    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:56:23.593111 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.593112    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:56:23.593269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.593217    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0d7121-13f4-4740-bf20-b52846c56910" containerName="istio-proxy"
Jul 06 12:56:23.593269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.593231    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:56:23.593269 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.593242    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:56:23.595677 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.595656    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.599234 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.599212    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-984f35-openshift-default-dockercfg-kh66r\""
Jul 06 12:56:23.610084 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.610062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 12:56:23.697672 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hc7\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.697851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.697851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697912    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698023 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.697944    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.698119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698191 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.698179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.698328 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.698240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799263 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799263 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799506 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799506 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799506 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799665 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799665 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799582    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799665 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799665 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hc7\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.799851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.799812    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.800177 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.800151    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.800286 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.800157    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.800286 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.800196    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.801434 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.801409    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.802048 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.802028    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.808957 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.808935    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.810434 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.810410    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hc7\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7\") pod \"e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") " pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:23.906183 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:23.906105    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:24.044622 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.044595    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 12:56:24.046266 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:56:24.046239    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73b9b37_f23a_466f_930f_d9cd7a4c5cc0.slice/crio-21b64fef05f47fc9bfd28f2f025ac96de830ab20bbd84769c2d98d16b2b40d5f WatchSource:0}: Error finding container 21b64fef05f47fc9bfd28f2f025ac96de830ab20bbd84769c2d98d16b2b40d5f: Status 404 returned error can't find the container with id 21b64fef05f47fc9bfd28f2f025ac96de830ab20bbd84769c2d98d16b2b40d5f
Jul 06 12:56:24.048524 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.048494    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:24.048636 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.048569    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:24.048636 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.048611    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:24.464005 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.463959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerStarted","Data":"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"}
Jul 06 12:56:24.464166 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.464072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerStarted","Data":"21b64fef05f47fc9bfd28f2f025ac96de830ab20bbd84769c2d98d16b2b40d5f"}
Jul 06 12:56:24.488127 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.488078    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podStartSLOduration=1.488062152 podStartE2EDuration="1.488062152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:24.485964371 +0000 UTC m=+2016.181669020" watchObservedRunningTime="2026-07-06 12:56:24.488062152 +0000 UTC m=+2016.183766800"
Jul 06 12:56:24.907074 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:24.907044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:25.911741 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:25.911710    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:26.473784 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:26.473761    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:26.474667 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:26.474645    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:33.466529 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:33.466480    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 12:56:33.466998 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:33.466589    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 12:56:34.516156 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.516123    2570 generic.go:356] "Generic (PLEG): container finished" podID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerID="0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152" exitCode=0
Jul 06 12:56:34.516663 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.516196    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerDied","Data":"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"}
Jul 06 12:56:34.516707 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.516677    2570 scope.go:117] "RemoveContainer" containerID="0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"
Jul 06 12:56:34.517762 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.517733    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:34.517851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.517802    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:34.517851 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:34.517832    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:35.522118 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:35.522076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerStarted","Data":"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"}
Jul 06 12:56:35.561101 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:35.560672    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:35.561101 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:35.560798    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 12:56:35.561101 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:35.560843    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 12:56:36.561162 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:36.561114    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 12:56:36.561712 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:36.561184    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 12:56:37.560751 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:37.560710    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 12:56:37.561045 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:37.561013    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 12:56:38.560064 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:38.560028    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 12:56:38.560659 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:38.560629    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 12:56:39.560590 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:39.560558    2570 patch_prober.go:28] interesting pod/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 12:56:39.561066 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:39.560967    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 12:56:40.563649 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:40.563616    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:40.564092 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:40.563960    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:40.564603 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:40.564581    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 12:56:42.192720 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.191667    2570 patch_prober.go:28] interesting pod/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:33380->10.133.0.50:15021: read: connection reset by peer" start-of-body=
Jul 06 12:56:42.192720 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.191730    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:33380->10.133.0.50:15021: read: connection reset by peer"
Jul 06 12:56:42.561505 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.561474    2570 generic.go:356] "Generic (PLEG): container finished" podID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerID="153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a" exitCode=0
Jul 06 12:56:42.561701 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.561550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerDied","Data":"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"}
Jul 06 12:56:42.562152 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.562134    2570 scope.go:117] "RemoveContainer" containerID="153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"
Jul 06 12:56:42.563192 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.563165    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:42.563280 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.563241    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:42.563372 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:42.563291    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:56:43.569986 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:43.569949    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerStarted","Data":"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"}
Jul 06 12:56:43.907140 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:43.907043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:43.907341 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:43.907227    2570 patch_prober.go:28] interesting pod/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 12:56:43.907341 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:43.907270    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 12:56:44.907017 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:44.906985    2570 patch_prober.go:28] interesting pod/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 12:56:44.907443 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:44.907033    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 12:56:45.906595 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:45.906559    2570 patch_prober.go:28] interesting pod/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 12:56:45.906775 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:45.906610    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 12:56:46.907388 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:46.907350    2570 patch_prober.go:28] interesting pod/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 12:56:46.907854 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:46.907412    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 12:56:47.910124 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:47.910093    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:47.910613 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:47.910365    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:56:47.910989 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:56:47.910970    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 12:59:11.743919 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.743768    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 12:59:11.744458 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.744273    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:59:11.744458 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.744288    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e72b55e-46a4-4324-ae77-1071f2d8f4ed" containerName="istio-proxy"
Jul 06 12:59:11.747462 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.747444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.751830 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.751804    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e47695\"/\"openshift-service-ca.crt\""
Jul 06 12:59:11.751830 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.751804    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e47695\"/\"kube-root-ca.crt\""
Jul 06 12:59:11.752012 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.751845    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e47695\"/\"sub-test-model-e47695-kserve-self-signed-certs\""
Jul 06 12:59:11.752012 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.751852    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e47695\"/\"default-dockercfg-6sxfw\""
Jul 06 12:59:11.758664 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.758643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 12:59:11.848079 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.848079 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.848284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9lxw\" (UniqueName: \"kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.848284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.848284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.848284 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.848214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.949682 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.949877 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.949877 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.949877 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.950059 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9lxw\" (UniqueName: \"kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.950059 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.949923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.950170 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.950112    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.950239 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.950195    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.950543 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.950522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.952111 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.952082    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.952272 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.952251    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:11.959764 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:11.959741    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9lxw\" (UniqueName: \"kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw\") pod \"sub-test-model-e47695-kserve-59d6c45b59-dpjkt\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") " pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:12.059520 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:12.059437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:12.196518 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:12.196364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 12:59:12.198732 ip-10-0-129-248 kubenswrapper[2570]: W0706 12:59:12.198703    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod980dffdd_8977_4bf6_8eba_e28b0730a508.slice/crio-34183b3ac9ffa34ca6ded8a5fe0235f6f95a426a31659a97175b2eac38e9318b WatchSource:0}: Error finding container 34183b3ac9ffa34ca6ded8a5fe0235f6f95a426a31659a97175b2eac38e9318b: Status 404 returned error can't find the container with id 34183b3ac9ffa34ca6ded8a5fe0235f6f95a426a31659a97175b2eac38e9318b
Jul 06 12:59:12.299758 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:12.299726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" event={"ID":"980dffdd-8977-4bf6-8eba-e28b0730a508","Type":"ContainerStarted","Data":"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"}
Jul 06 12:59:12.299924 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:12.299770    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" event={"ID":"980dffdd-8977-4bf6-8eba-e28b0730a508","Type":"ContainerStarted","Data":"34183b3ac9ffa34ca6ded8a5fe0235f6f95a426a31659a97175b2eac38e9318b"}
Jul 06 12:59:12.320678 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:12.320579    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" podStartSLOduration=1.3205624120000001 podStartE2EDuration="1.320562412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:59:12.318473398 +0000 UTC m=+2184.014178050" watchObservedRunningTime="2026-07-06 12:59:12.320562412 +0000 UTC m=+2184.016267060"
Jul 06 12:59:22.060489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:22.060450    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:22.060489 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:22.060495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:22.073250 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:22.073221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 12:59:22.365747 ip-10-0-129-248 kubenswrapper[2570]: I0706 12:59:22.365673    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 13:00:28.832807 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:28.832773    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 13:00:43.852822 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:43.852780    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" podUID="980dffdd-8977-4bf6-8eba-e28b0730a508" containerName="main" containerID="cri-o://f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3" gracePeriod=45
Jul 06 13:00:44.110527 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.110460    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 13:00:44.248883 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.248848    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249061 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.248911    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249061 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.248937    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249061 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.248992    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249218 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249142    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249270 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249222    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9lxw\" (UniqueName: \"kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw\") pod \"980dffdd-8977-4bf6-8eba-e28b0730a508\" (UID: \"980dffdd-8977-4bf6-8eba-e28b0730a508\") "
Jul 06 13:00:44.249270 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249226    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache" (OuterVolumeSpecName: "model-cache") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:00:44.249270 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249241    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:00:44.249454 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249410    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home" (OuterVolumeSpecName: "home") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:00:44.249623 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249603    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-tmp-dir\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.249683 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249628    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-home\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.249683 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.249641    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-model-cache\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.251199 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.251172    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm" (OuterVolumeSpecName: "dshm") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:00:44.251349 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.251220    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw" (OuterVolumeSpecName: "kube-api-access-t9lxw") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "kube-api-access-t9lxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:00:44.251407 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.251388    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "980dffdd-8977-4bf6-8eba-e28b0730a508" (UID: "980dffdd-8977-4bf6-8eba-e28b0730a508"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:00:44.350790 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.350753    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9lxw\" (UniqueName: \"kubernetes.io/projected/980dffdd-8977-4bf6-8eba-e28b0730a508-kube-api-access-t9lxw\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.350790 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.350789    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/980dffdd-8977-4bf6-8eba-e28b0730a508-dshm\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.350987 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.350803    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/980dffdd-8977-4bf6-8eba-e28b0730a508-tls-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:00:44.761371 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.761329    2570 generic.go:356] "Generic (PLEG): container finished" podID="980dffdd-8977-4bf6-8eba-e28b0730a508" containerID="f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3" exitCode=0
Jul 06 13:00:44.761371 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.761372    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"
Jul 06 13:00:44.761599 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.761401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" event={"ID":"980dffdd-8977-4bf6-8eba-e28b0730a508","Type":"ContainerDied","Data":"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"}
Jul 06 13:00:44.761599 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.761446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt" event={"ID":"980dffdd-8977-4bf6-8eba-e28b0730a508","Type":"ContainerDied","Data":"34183b3ac9ffa34ca6ded8a5fe0235f6f95a426a31659a97175b2eac38e9318b"}
Jul 06 13:00:44.761599 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.761473    2570 scope.go:117] "RemoveContainer" containerID="f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"
Jul 06 13:00:44.770787 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.770764    2570 scope.go:117] "RemoveContainer" containerID="f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"
Jul 06 13:00:44.771017 ip-10-0-129-248 kubenswrapper[2570]: E0706 13:00:44.771002    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3\": container with ID starting with f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3 not found: ID does not exist" containerID="f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"
Jul 06 13:00:44.771061 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.771024    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3"} err="failed to get container status \"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3\": rpc error: code = NotFound desc = could not find container \"f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3\": container with ID starting with f185ea5a186960b4691ec68f11c8f5e69f77961f5dcfe29b6f72666343dd59a3 not found: ID does not exist"
Jul 06 13:00:44.784094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.784070    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 13:00:44.790795 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.790772    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e47695/sub-test-model-e47695-kserve-59d6c45b59-dpjkt"]
Jul 06 13:00:44.814554 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:00:44.814534    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="980dffdd-8977-4bf6-8eba-e28b0730a508" path="/var/lib/kubelet/pods/980dffdd-8977-4bf6-8eba-e28b0730a508/volumes"
Jul 06 13:03:02.996987 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:02.996954    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 13:03:02.997604 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:02.997159    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy" containerID="cri-o://ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5" gracePeriod=30
Jul 06 13:03:08.248029 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.248001    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 13:03:08.303761 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303761 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303731    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303968 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303785    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303968 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303815    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303968 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303838    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303968 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.303968 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303950    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nf7f\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.304258 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.303976    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.304258 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304015    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket\") pod \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\" (UID: \"99b5b741-8f53-4d51-aaf6-1d2b390b9340\") "
Jul 06 13:03:08.304414 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304388    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:08.304475 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304399    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:03:08.304602 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304579    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:08.304720 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304652    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:08.304720 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.304701    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data" (OuterVolumeSpecName: "istio-data") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:08.306066 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.306043    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:08.306274 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.306236    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f" (OuterVolumeSpecName: "kube-api-access-6nf7f") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "kube-api-access-6nf7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:03:08.306392 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.306292    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 13:03:08.306392 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.306340    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token" (OuterVolumeSpecName: "istio-token") pod "99b5b741-8f53-4d51-aaf6-1d2b390b9340" (UID: "99b5b741-8f53-4d51-aaf6-1d2b390b9340"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:03:08.404898 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404869    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.404898 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404894    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nf7f\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-kube-api-access-6nf7f\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404907    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404919    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404930    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404943    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404953    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404964    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.405058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.404975    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b5b741-8f53-4d51-aaf6-1d2b390b9340-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:08.471239 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.471204    2570 generic.go:356] "Generic (PLEG): container finished" podID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerID="ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5" exitCode=0
Jul 06 13:03:08.471393 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.471249    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerDied","Data":"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"}
Jul 06 13:03:08.471393 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.471256    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"
Jul 06 13:03:08.471393 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.471301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt" event={"ID":"99b5b741-8f53-4d51-aaf6-1d2b390b9340","Type":"ContainerDied","Data":"cab7f0d6d679300fd35fc14b7e3beb060b4cbbfeb7438c908905d102f6f96540"}
Jul 06 13:03:08.471393 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.471348    2570 scope.go:117] "RemoveContainer" containerID="ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"
Jul 06 13:03:08.480987 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.480969    2570 scope.go:117] "RemoveContainer" containerID="0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"
Jul 06 13:03:08.488608 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.488592    2570 scope.go:117] "RemoveContainer" containerID="ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"
Jul 06 13:03:08.488835 ip-10-0-129-248 kubenswrapper[2570]: E0706 13:03:08.488819    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5\": container with ID starting with ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5 not found: ID does not exist" containerID="ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"
Jul 06 13:03:08.488874 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.488844    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5"} err="failed to get container status \"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5\": rpc error: code = NotFound desc = could not find container \"ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5\": container with ID starting with ebe78298a371ebae979689ae95bb43347e43f11449cc6a17d1f3c4b56442c7d5 not found: ID does not exist"
Jul 06 13:03:08.488874 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.488864    2570 scope.go:117] "RemoveContainer" containerID="0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"
Jul 06 13:03:08.489074 ip-10-0-129-248 kubenswrapper[2570]: E0706 13:03:08.489056    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152\": container with ID starting with 0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152 not found: ID does not exist" containerID="0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"
Jul 06 13:03:08.489117 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.489080    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152"} err="failed to get container status \"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152\": rpc error: code = NotFound desc = could not find container \"0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152\": container with ID starting with 0bb5e000ee71f81394ef9045dfe91c9a0eeea64a9ed1449375f1970531e8e152 not found: ID does not exist"
Jul 06 13:03:08.498809 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.498779    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 13:03:08.508113 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.508081    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e47695-openshift-default-5865dbb947-fr6pt"]
Jul 06 13:03:08.819058 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:08.819025    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" path="/var/lib/kubelet/pods/99b5b741-8f53-4d51-aaf6-1d2b390b9340/volumes"
Jul 06 13:03:10.687609 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:10.687530    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 13:03:10.688004 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:10.687832    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy" containerID="cri-o://887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d" gracePeriod=30
Jul 06 13:03:15.943409 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:15.943383    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 13:03:16.079498 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079468    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079520    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079548    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079577    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079599    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079633    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.079689 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9hc7\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.080000 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079728    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.080000 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079802    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket\") pod \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\" (UID: \"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0\") "
Jul 06 13:03:16.080000 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.079805    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:16.080160 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080019    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:03:16.080227 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080169    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.080227 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080188    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.080705 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080577    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:16.080818 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080720    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:16.080883 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.080853    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:16.086337 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.085790    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 13:03:16.088486 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.088420    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:03:16.088799 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.088767    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7" (OuterVolumeSpecName: "kube-api-access-m9hc7") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "kube-api-access-m9hc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:03:16.089025 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.089009    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" (UID: "e73b9b37-f23a-466f-930f-d9cd7a4c5cc0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:03:16.180838 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180805    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.180838 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180835    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.181031 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180849    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.181031 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180863    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9hc7\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-kube-api-access-m9hc7\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.181031 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180877    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.181031 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180887    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.181031 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.180897    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Jul 06 13:03:16.510289 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.510227    2570 generic.go:356] "Generic (PLEG): container finished" podID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerID="887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d" exitCode=0
Jul 06 13:03:16.510512 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.510332    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"
Jul 06 13:03:16.510512 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.510323    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerDied","Data":"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"}
Jul 06 13:03:16.510512 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.510428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8" event={"ID":"e73b9b37-f23a-466f-930f-d9cd7a4c5cc0","Type":"ContainerDied","Data":"21b64fef05f47fc9bfd28f2f025ac96de830ab20bbd84769c2d98d16b2b40d5f"}
Jul 06 13:03:16.510512 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.510463    2570 scope.go:117] "RemoveContainer" containerID="887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"
Jul 06 13:03:16.519625 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.519605    2570 scope.go:117] "RemoveContainer" containerID="153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"
Jul 06 13:03:16.529231 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.529215    2570 scope.go:117] "RemoveContainer" containerID="887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"
Jul 06 13:03:16.529577 ip-10-0-129-248 kubenswrapper[2570]: E0706 13:03:16.529556    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d\": container with ID starting with 887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d not found: ID does not exist" containerID="887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"
Jul 06 13:03:16.529670 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.529588    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d"} err="failed to get container status \"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d\": rpc error: code = NotFound desc = could not find container \"887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d\": container with ID starting with 887aa4b6a96e4a2d76920808156b4a4f72fb85d80799d32c286c3c9152ec322d not found: ID does not exist"
Jul 06 13:03:16.529670 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.529613    2570 scope.go:117] "RemoveContainer" containerID="153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"
Jul 06 13:03:16.529821 ip-10-0-129-248 kubenswrapper[2570]: E0706 13:03:16.529800    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a\": container with ID starting with 153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a not found: ID does not exist" containerID="153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"
Jul 06 13:03:16.529869 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.529832    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a"} err="failed to get container status \"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a\": rpc error: code = NotFound desc = could not find container \"153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a\": container with ID starting with 153ea55644f0c0abb942f98e1973d333dbdadf2737ca19e532c05f08465cda1a not found: ID does not exist"
Jul 06 13:03:16.534097 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.534076    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 13:03:16.542037 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.542016    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-984f35-openshift-default-74cdcdd679-vmjd8"]
Jul 06 13:03:16.633145 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.633119    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hzd6n_96a37e9b-d969-4050-9543-071156573436/server/0.log"
Jul 06 13:03:16.755502 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.755474    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2mtmf_e2bc48a4-64f3-40af-b657-117b85d56d4e/manager/0.log"
Jul 06 13:03:16.815577 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.815504    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" path="/var/lib/kubelet/pods/e73b9b37-f23a-466f-930f-d9cd7a4c5cc0/volumes"
Jul 06 13:03:16.991886 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:16.991859    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zczfm_c2b314a8-91ad-4815-bdcd-82ae355233de/copy-manifests/0.log"
Jul 06 13:03:17.005823 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:17.005802    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zczfm_c2b314a8-91ad-4815-bdcd-82ae355233de/manager/0.log"
Jul 06 13:03:18.648699 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:18.648670    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-45zj6_36c17d51-0183-4ac2-b1cf-1718df89032d/manager/0.log"
Jul 06 13:03:18.768213 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:18.768179    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dh8hz_dd14d010-0968-4741-8efc-88bf1f45ef7d/manager/0.log"
Jul 06 13:03:19.006366 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:19.006334    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8vldt_4ccdadb4-4b47-4083-a945-9f8068292f64/registry-server/0.log"
Jul 06 13:03:19.136068 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:19.136044    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9mzgb_f0cc3a8c-5587-4da1-af89-9772e227845f/manager/0.log"
Jul 06 13:03:19.757960 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:19.757931    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4h4jsb_e936af44-d27e-45b4-910f-b6a0c3cb1970/istio-proxy/0.log"
Jul 06 13:03:20.253213 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:20.253183    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/1.log"
Jul 06 13:03:20.645781 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:20.645703    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5b4bc6b7-f2r4j_334bea9f-de75-4f79-a6b9-364f5f7158cd/router/0.log"
Jul 06 13:03:21.131986 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:21.131954    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bpbsw_5bb90558-9150-4ef1-8e7d-b0adcdeabc89/main/0.log"
Jul 06 13:03:21.352521 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:21.352481    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6tkb6_a4e4378a-7189-4715-81af-e70ef1041d13/main/0.log"
Jul 06 13:03:21.588330 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:21.588276    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-g8v8f_d520ef3a-c715-435d-9b52-61c97000bb79/main/0.log"
Jul 06 13:03:25.979470 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979434    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfwcs/must-gather-dthvs"]
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979787    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979798    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979808    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979813    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979820    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.979826 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979826    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979840    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="980dffdd-8977-4bf6-8eba-e28b0730a508" containerName="main"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979845    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="980dffdd-8977-4bf6-8eba-e28b0730a508" containerName="main"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979924    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979933    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979939    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e73b9b37-f23a-466f-930f-d9cd7a4c5cc0" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979944    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.979952    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="980dffdd-8977-4bf6-8eba-e28b0730a508" containerName="main"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.980013    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.980022 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.980018    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b5b741-8f53-4d51-aaf6-1d2b390b9340" containerName="istio-proxy"
Jul 06 13:03:25.982912 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.982896    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:25.986234 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.986214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfwcs\"/\"kube-root-ca.crt\""
Jul 06 13:03:25.986374 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.986350    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfwcs\"/\"openshift-service-ca.crt\""
Jul 06 13:03:25.987285 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.987269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfwcs\"/\"default-dockercfg-h759v\""
Jul 06 13:03:25.998647 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:25.998622    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/must-gather-dthvs"]
Jul 06 13:03:26.073065 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.073033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-must-gather-output\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.073065 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.073074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8wx\" (UniqueName: \"kubernetes.io/projected/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-kube-api-access-8g8wx\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.173639 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.173599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-must-gather-output\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.173639 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.173642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8wx\" (UniqueName: \"kubernetes.io/projected/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-kube-api-access-8g8wx\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.173982 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.173958    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-must-gather-output\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.185883 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.185858    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8wx\" (UniqueName: \"kubernetes.io/projected/36541bc8-cfc8-489b-ad3f-e5067b3c13c8-kube-api-access-8g8wx\") pod \"must-gather-dthvs\" (UID: \"36541bc8-cfc8-489b-ad3f-e5067b3c13c8\") " pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.292671 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.292643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/must-gather-dthvs"
Jul 06 13:03:26.451864 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.451809    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/must-gather-dthvs"]
Jul 06 13:03:26.454019 ip-10-0-129-248 kubenswrapper[2570]: W0706 13:03:26.453989    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36541bc8_cfc8_489b_ad3f_e5067b3c13c8.slice/crio-ef24754b716771276d6676eefb1009f7a44a6bc3a032c01c6f95e77df8eacb0a WatchSource:0}: Error finding container ef24754b716771276d6676eefb1009f7a44a6bc3a032c01c6f95e77df8eacb0a: Status 404 returned error can't find the container with id ef24754b716771276d6676eefb1009f7a44a6bc3a032c01c6f95e77df8eacb0a
Jul 06 13:03:26.455953 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.455935    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:03:26.562410 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:26.562298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/must-gather-dthvs" event={"ID":"36541bc8-cfc8-489b-ad3f-e5067b3c13c8","Type":"ContainerStarted","Data":"ef24754b716771276d6676eefb1009f7a44a6bc3a032c01c6f95e77df8eacb0a"}
Jul 06 13:03:27.569029 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:27.568997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/must-gather-dthvs" event={"ID":"36541bc8-cfc8-489b-ad3f-e5067b3c13c8","Type":"ContainerStarted","Data":"470596e93808f7315e2036a160db1fa05e8c8f50100e7e02defcd873c71a5101"}
Jul 06 13:03:27.569373 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:27.569049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/must-gather-dthvs" event={"ID":"36541bc8-cfc8-489b-ad3f-e5067b3c13c8","Type":"ContainerStarted","Data":"403cae768b2c8c98765a787f6840f851c6f55fa4aa2dbc53f229dee38628eed9"}
Jul 06 13:03:27.591162 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:27.591095    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfwcs/must-gather-dthvs" podStartSLOduration=1.687995673 podStartE2EDuration="2.591071949s" totalImagesPullingTime="903.076276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:03:27.589279574 +0000 UTC m=+2439.284984222" watchObservedRunningTime="2026-07-06 13:03:27.591071949 +0000 UTC m=+2439.286776599"
Jul 06 13:03:29.312492 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:29.312457    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tmf54_3ebed58a-1507-4958-9ab0-3d4d060ac15e/global-pull-secret-syncer/0.log"
Jul 06 13:03:29.461108 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:29.461080    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pgxxq_06b0c17c-7475-4f10-8ed8-045b11381fe4/konnectivity-agent/0.log"
Jul 06 13:03:29.489643 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:29.489612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-248.ec2.internal_574c7dd2fe0232ed5ac86b87d67e74b7/haproxy/0.log"
Jul 06 13:03:35.151702 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:35.151668    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-45zj6_36c17d51-0183-4ac2-b1cf-1718df89032d/manager/0.log"
Jul 06 13:03:35.185831 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:35.185801    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dh8hz_dd14d010-0968-4741-8efc-88bf1f45ef7d/manager/0.log"
Jul 06 13:03:35.271380 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:35.271343    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8vldt_4ccdadb4-4b47-4083-a945-9f8068292f64/registry-server/0.log"
Jul 06 13:03:35.449654 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:35.449438    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9mzgb_f0cc3a8c-5587-4da1-af89-9772e227845f/manager/0.log"
Jul 06 13:03:37.481597 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.481526    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-62tdj_a38573a3-9470-4e29-afe0-c1e2649ca17d/kube-state-metrics/0.log"
Jul 06 13:03:37.511389 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.511348    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-62tdj_a38573a3-9470-4e29-afe0-c1e2649ca17d/kube-rbac-proxy-main/0.log"
Jul 06 13:03:37.539948 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.539898    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-62tdj_a38573a3-9470-4e29-afe0-c1e2649ca17d/kube-rbac-proxy-self/0.log"
Jul 06 13:03:37.585622 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.585573    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86c9469585-dgskc_388288da-26e1-4506-86db-6186f8d65d22/metrics-server/0.log"
Jul 06 13:03:37.697725 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.697695    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fsnjb_15c2587a-108f-437b-a493-1da3fe656275/node-exporter/0.log"
Jul 06 13:03:37.751169 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.751074    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fsnjb_15c2587a-108f-437b-a493-1da3fe656275/kube-rbac-proxy/0.log"
Jul 06 13:03:37.788210 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:37.788187    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fsnjb_15c2587a-108f-437b-a493-1da3fe656275/init-textfile/0.log"
Jul 06 13:03:38.132493 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:38.132412    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-wkc89_19979d37-f374-4a9a-b878-4df95dda2391/kube-rbac-proxy-main/0.log"
Jul 06 13:03:38.161612 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:38.161584    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-wkc89_19979d37-f374-4a9a-b878-4df95dda2391/kube-rbac-proxy-self/0.log"
Jul 06 13:03:38.192749 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:38.192713    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-wkc89_19979d37-f374-4a9a-b878-4df95dda2391/openshift-state-metrics/0.log"
Jul 06 13:03:39.071220 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.071186    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"]
Jul 06 13:03:39.075718 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.075692    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.126856 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.126819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-sys\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.126856 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.126855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-lib-modules\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.127127 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.126877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm5gr\" (UniqueName: \"kubernetes.io/projected/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-kube-api-access-cm5gr\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.127127 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.126895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-proc\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.127127 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.126930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-podres\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.171451 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.171412    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"]
Jul 06 13:03:39.227836 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-sys\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.227836 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-lib-modules\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm5gr\" (UniqueName: \"kubernetes.io/projected/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-kube-api-access-cm5gr\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-proc\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227937    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-sys\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227991    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-lib-modules\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.227996    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-proc\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228094 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.228024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-podres\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.228328 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.228108    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-podres\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.239469 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.238978    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm5gr\" (UniqueName: \"kubernetes.io/projected/cad7ca8d-a33e-483c-86b7-ba6900a5cb1e-kube-api-access-cm5gr\") pod \"perf-node-gather-daemonset-srlsx\" (UID: \"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.390107 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.390010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:39.574132 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.574102    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"]
Jul 06 13:03:39.576116 ip-10-0-129-248 kubenswrapper[2570]: W0706 13:03:39.576052    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcad7ca8d_a33e_483c_86b7_ba6900a5cb1e.slice/crio-653bc89937ecd0b5af6b716c5b1061cec4e3809aed2dcf20fe3a818464a09157 WatchSource:0}: Error finding container 653bc89937ecd0b5af6b716c5b1061cec4e3809aed2dcf20fe3a818464a09157: Status 404 returned error can't find the container with id 653bc89937ecd0b5af6b716c5b1061cec4e3809aed2dcf20fe3a818464a09157
Jul 06 13:03:39.654472 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:39.654440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx" event={"ID":"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e","Type":"ContainerStarted","Data":"653bc89937ecd0b5af6b716c5b1061cec4e3809aed2dcf20fe3a818464a09157"}
Jul 06 13:03:40.661886 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:40.661848    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx" event={"ID":"cad7ca8d-a33e-483c-86b7-ba6900a5cb1e","Type":"ContainerStarted","Data":"79265748a2cf9c55225619d74b21e6346af6ad7609a9629ca217879e48d650fc"}
Jul 06 13:03:40.662270 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:40.661981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:40.685200 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:40.685156    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx" podStartSLOduration=1.685139875 podStartE2EDuration="1.685139875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:03:40.681818103 +0000 UTC m=+2452.377522751" watchObservedRunningTime="2026-07-06 13:03:40.685139875 +0000 UTC m=+2452.380844524"
Jul 06 13:03:41.239043 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:41.239015    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-788f759ff7-8tzmc_1c835437-9f91-4270-bbf0-ee47c4fafdc3/console/0.log"
Jul 06 13:03:41.958097 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:41.958064    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-srbrk_2b6adfc0-15c1-4879-a78c-f2fd1609b687/volume-data-source-validator/0.log"
Jul 06 13:03:43.132146 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:43.132117    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqrhw_13e78e7a-1991-4f70-ad83-e9281b51a7a9/dns/0.log"
Jul 06 13:03:43.155423 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:43.155396    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqrhw_13e78e7a-1991-4f70-ad83-e9281b51a7a9/kube-rbac-proxy/0.log"
Jul 06 13:03:43.212427 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:43.212403    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqkrs_8fb822e6-1871-4a32-a722-b1e505f9c252/dns-node-resolver/0.log"
Jul 06 13:03:43.814361 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:43.814321    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6795764c4f-b2gld_0683c445-9879-4c79-9934-4b839d7a0cd1/registry/0.log"
Jul 06 13:03:43.902904 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:43.902881    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mslb8_e660f6ad-0357-4bcc-bec3-81f3c3a53865/node-ca/0.log"
Jul 06 13:03:44.991673 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:44.991621    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4h4jsb_e936af44-d27e-45b4-910f-b6a0c3cb1970/istio-proxy/0.log"
Jul 06 13:03:45.274496 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:45.274418    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/0.log"
Jul 06 13:03:45.310858 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:45.310829    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/1.log"
Jul 06 13:03:45.473042 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:45.473017    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5b4bc6b7-f2r4j_334bea9f-de75-4f79-a6b9-364f5f7158cd/router/0.log"
Jul 06 13:03:46.181566 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.181538    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gmwlr_9cc99336-1ed4-4704-9dd0-b8e68f207e31/serve-healthcheck-canary/0.log"
Jul 06 13:03:46.679854 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.679826    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-srlsx"
Jul 06 13:03:46.781640 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.781594    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-lc7wz_1d7b9836-fa87-4812-9c59-e060a24f5ccf/insights-operator/0.log"
Jul 06 13:03:46.782036 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.781991    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-lc7wz_1d7b9836-fa87-4812-9c59-e060a24f5ccf/insights-operator/1.log"
Jul 06 13:03:46.806698 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.806677    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9r8g8_17687b5e-4402-4fc1-ba6f-ab7363b87466/kube-rbac-proxy/0.log"
Jul 06 13:03:46.833844 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.833815    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9r8g8_17687b5e-4402-4fc1-ba6f-ab7363b87466/exporter/0.log"
Jul 06 13:03:46.866108 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:46.866079    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9r8g8_17687b5e-4402-4fc1-ba6f-ab7363b87466/extractor/0.log"
Jul 06 13:03:49.399127 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:49.399096    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4h4jsb_e936af44-d27e-45b4-910f-b6a0c3cb1970/istio-proxy/0.log"
Jul 06 13:03:49.652898 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:49.652801    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/0.log"
Jul 06 13:03:49.684945 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:49.684915    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/1.log"
Jul 06 13:03:49.865534 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:49.865501    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5b4bc6b7-f2r4j_334bea9f-de75-4f79-a6b9-364f5f7158cd/router/0.log"
Jul 06 13:03:50.058264 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:50.058235    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hzd6n_96a37e9b-d969-4050-9543-071156573436/server/0.log"
Jul 06 13:03:50.144752 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:50.144716    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2mtmf_e2bc48a4-64f3-40af-b657-117b85d56d4e/manager/0.log"
Jul 06 13:03:50.293998 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:50.293962    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zczfm_c2b314a8-91ad-4815-bdcd-82ae355233de/manager/0.log"
Jul 06 13:03:50.315143 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:50.315078    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zczfm_c2b314a8-91ad-4815-bdcd-82ae355233de/copy-manifests/0.log"
Jul 06 13:03:51.113072 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:51.113044    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4h4jsb_e936af44-d27e-45b4-910f-b6a0c3cb1970/istio-proxy/0.log"
Jul 06 13:03:51.372201 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:51.372128    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/0.log"
Jul 06 13:03:51.405197 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:51.405159    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vgzqz_8cc6b2c7-5546-4ef8-9e45-f3630d12c3b3/istio-proxy/1.log"
Jul 06 13:03:51.534405 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:51.534374    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5b4bc6b7-f2r4j_334bea9f-de75-4f79-a6b9-364f5f7158cd/router/0.log"
Jul 06 13:03:51.609604 ip-10-0-129-248 kubenswrapper[2570]: I0706 13:03:51.609569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bb7bb478-6pvc4_8ecd73ca-4e68-4019-9962-dae03a7b6140/manager/0.log"