Jul 02 23:10:11.899195 ip-10-0-141-125 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.309831    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314529    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314547    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314551    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314554    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314556    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314561    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314564    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.439876 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314567    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.393338 ip-10-0-141-125 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314570    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314573    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314575    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314578    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314580    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314583    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314586    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314588    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314592    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314594    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314597    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314599    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314602    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314604    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314607    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314610    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314612    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314616    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314619    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.441752 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314621    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314627    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314631    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314634    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314637    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314641    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314644    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314647    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314650    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314652    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314655    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314658    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314661    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314663    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314666    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314676    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314679    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314682    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314686    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.442455 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314690    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314693    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314696    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314699    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314702    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314705    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314707    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314710    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314712    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314715    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314717    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314720    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314723    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314725    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314728    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314730    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314733    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314735    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314738    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314741    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.591526 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314744    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314746    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314749    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314751    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314753    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314756    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314759    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314761    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314764    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314767    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314770    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314772    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314776    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314779    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314782    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314785    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314787    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314790    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314792    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314795    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.602805 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314797    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314800    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314803    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314805    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314809    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314813    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314816    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314819    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314821    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314824    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314827    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314829    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.314832    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315619    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315626    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315630    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315633    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315640    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315644    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.603884 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315646    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315650    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315653    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315656    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315658    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315661    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315664    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315667    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315670    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315673    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315675    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315678    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315680    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315683    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315686    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315688    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315691    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315694    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315696    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315698    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.604928 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315701    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315704    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315706    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315709    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315712    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315714    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315717    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315720    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315722    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315725    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315729    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315732    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315735    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315738    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315740    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315743    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315745    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315748    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315751    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315753    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.605734 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315757    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315760    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315762    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315765    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315768    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315771    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315773    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315778    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315783    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315786    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315789    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315791    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315794    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315796    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315799    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315803    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315806    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315810    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315813    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.606440 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315816    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315819    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315822    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315826    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315829    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315832    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315836    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315839    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315842    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315845    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315847    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315851    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315853    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315856    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315859    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315862    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315865    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315868    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315870    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315873    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.607453 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315877    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315879    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315898    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315901    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315904    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315906    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315909    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315912    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315915    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315922    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315925    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315928    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315930    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.315933    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316341    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316348    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316351    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316354    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316357    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316360    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.608659 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316362    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316365    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316368    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316371    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316373    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316376    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316379    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316381    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316384    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316386    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316389    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316392    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316394    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316397    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316400    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316402    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316405    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316408    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316410    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316413    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.609825 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316415    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316420    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316424    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316427    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316430    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316433    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316436    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316441    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316444    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316446    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316449    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316453    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316455    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316458    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316461    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316463    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316466    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316468    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316471    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.611235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316474    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316476    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316478    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316481    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316483    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316486    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316489    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316492    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316495    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316497    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316500    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316502    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316505    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316507    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316511    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316514    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316516    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316519    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316521    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316524    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.612175 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316528    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316531    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316534    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316536    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316540    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316543    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316546    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316548    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316551    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316553    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316556    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316558    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316561    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316563    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316566    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316569    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316571    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316574    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316576    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316579    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.613168 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316581    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316584    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316587    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316590    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316593    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316595    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316600    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316602    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316605    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316607    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316610    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316613    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316617    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.316619    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316699    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316714    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316721    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316726    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316731    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316734    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316738    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:10:12.614131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316742    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316746    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316749    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316752    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316756    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316759    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316762    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316766    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316769    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316772    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316775    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316779    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316782    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316785    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316788    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316792    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316796    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316800    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316803    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316807    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316810    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316813    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316816    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316821    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:10:12.615099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316824    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316829    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316832    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316834    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316837    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316840    2573 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316844    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316849    2573 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316853    2573 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316855    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316859    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316861    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316865    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316868    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316871    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316874    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316877    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316894    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316898    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316901    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316904    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316907    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316910    2573 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316913    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316916    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:10:12.616278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316921    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316924    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316927    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316930    2573 flags.go:64] FLAG: --help="false"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316934    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316937    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316941    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316944    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316948    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316952    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316955    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316958    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316961    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316964    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316967    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316970    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316973    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316976    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316980    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316982    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316985    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316988    2573 flags.go:64] FLAG: --lock-file=""
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316991    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316994    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:10:12.617481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.316997    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317004    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317006    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317009    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317012    2573 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317015    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317018    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317021    2573 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317025    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317030    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317033    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317037    2573 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317040    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317043    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317047    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317050    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317053    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317056    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317059    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317067    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317070    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317073    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317076    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:10:12.618675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317079    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317085    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317089    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317092    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317094    2573 flags.go:64] FLAG: --port="10250"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317097    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317100    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0316ecece39b933e7"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317104    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317107    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317110    2573 flags.go:64] FLAG: --register-node="true"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317113    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317116    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317119    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317122    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317125    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317128    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317131    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317136    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317139    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317142    2573 flags.go:64] FLAG: --runonce="false"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317144    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317148    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317151    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317154    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317158    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317161    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:10:12.619889 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317165    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317168    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317171    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317174    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317177    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317179    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317183    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317186    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317189    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317194    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317197    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317200    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317204    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317207    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317210    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317213    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317216    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317218    2573 flags.go:64] FLAG: --v="2"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317222    2573 flags.go:64] FLAG: --version="false"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317226    2573 flags.go:64] FLAG: --vmodule=""
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317230    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.317233    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317376    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317383    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.623397 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317387    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317390    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317393    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317396    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317399    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317402    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317407    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317410    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317412    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317415    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317418    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317420    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317423    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317425    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317428    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317430    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317433    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317436    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317438    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317441    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317443    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.624597 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317446    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317449    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317451    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317453    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317456    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317458    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317461    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317463    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317466    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317468    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317472    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317475    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317477    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317480    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317482    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317485    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317488    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317491    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317494    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317497    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.632632 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317499    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317502    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317504    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317507    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317509    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317513    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317517    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317519    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317523    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317526    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317529    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317532    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317536    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317539    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317542    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317545    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317548    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317551    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317553    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.633594 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317556    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317559    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317563    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317567    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317570    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317573    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317577    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317580    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317583    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317586    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317590    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317593    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317596    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317598    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317601    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317603    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317606    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317608    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317611    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.634562 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317613    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317616    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317619    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317622    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317624    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317627    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317630    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317632    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317635    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317637    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317640    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317642    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317645    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317647    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317650    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317652    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317657    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.635530 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.317660    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.318225    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.329857    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.329879    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.330591    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.330599    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330662    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330669    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330672    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330675    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330678    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330680    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330683    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330687    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330689    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.636482 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330692    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330694    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330697    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330700    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330703    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330706    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330709    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330711    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330714    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330717    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330719    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330722    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330725    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330728    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330731    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330733    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330735    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330738    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330742    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330745    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.637438 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330748    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330750    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330753    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330756    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330758    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330761    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330763    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330766    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330768    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330771    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330773    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330778    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330782    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330785    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330788    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330791    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330795    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330799    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330802    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.638394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330805    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330808    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330810    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330813    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330815    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330821    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330823    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330826    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330830    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330833    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330836    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330840    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330844    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330847    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330850    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330853    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330857    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330860    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330864    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.769702 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330867    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330871    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330874    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330877    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330879    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330896    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330901    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330904    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330907    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330910    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330913    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330915    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330919    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330922    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330925    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330928    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330930    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330933    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330937    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330939    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.771235 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330942    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330944    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330947    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330950    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330953    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330955    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330958    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330960    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330963    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330966    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330968    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.330973    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.330978    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331098    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331104    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:12.772428 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331107    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331110    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331112    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331115    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331118    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331120    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331123    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331126    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331128    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331131    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331134    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331136    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331139    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331141    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331144    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331148    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331151    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331153    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331156    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331158    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:12.773181 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331161    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331163    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331166    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331169    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331171    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331174    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331176    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331179    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331181    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331186    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331190    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331193    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331196    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331199    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331202    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331205    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331207    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331210    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331212    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:12.774154 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331215    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331217    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331220    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331222    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331225    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331228    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331230    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331233    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331236    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331239    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331241    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331244    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331247    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331249    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331252    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331254    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331257    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331259    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331262    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331264    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:12.775130 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331266    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331269    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331273    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331275    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331277    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331280    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331284    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331287    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331291    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331294    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331296    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331300    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331302    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331305    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331307    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331310    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331312    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331317    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331320    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:12.776107 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331323    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331327    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331330    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331333    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331335    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331338    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331340    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331343    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331345    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331348    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331350    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331352    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331355    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331357    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331360    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331364    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331366    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331369    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:12.777289 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:12.331371    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.331377    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.331506    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.333617    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.335325    2573 server.go:1019] "Starting client certificate rotation"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.335567    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.335596    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.338017    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.340973    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.357203    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.359832    2573 log.go:25] "Validated CRI v1 image API"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.360775    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:10:12.778247 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.361685    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:12.778982 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.363411    2573 fs.go:135] Filesystem UUIDs: map[30ce7ae1-2571-491c-be46-5bb0b4d7cf8a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d4ea1d62-2a6f-47da-ad9b-7c2a49e4bbf6:/dev/nvme0n1p4]
Jul 02 23:10:12.778982 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.363431    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.370316    2573 manager.go:216] Machine: {Timestamp:2026-07-02 23:10:12.368564137 +0000 UTC m=+0.352632513 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3049274 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f5087901db9a537d50bbac499aab7 SystemUUID:ec2f5087-901d-b9a5-37d5-0bbac499aab7 BootID:e7ee84a8-9cf0-49a4-8c4d-235c8143e893 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:e9:a7:02:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:e9:a7:02:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:59:4a:a3:15:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.370617    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.370725    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.374168    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.374197    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.374994    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.375006    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.375013    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.375771    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.377041    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.378355    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4g565"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.379985    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380114    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380141    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380151    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380162    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:10:12.779425 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380171    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380181    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380526    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.380541    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.384316    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.385721    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4g565"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.386475    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.386503    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387514    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387537    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387545    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387553    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387565    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387575    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387588    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387595    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387605    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387612    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387625    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.387633    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.388367    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.388373    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.392355    2573 server.go:1268] "Started kubelet"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.392458    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.392799    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.393048    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.394200    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.395374    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.396477    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.400210    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.400254    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.400552    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.400964    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.400975    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.400983    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401081    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401090    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.401087    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401587    2573 factory.go:55] Registering systemd factory
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401610    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401856    2573 factory.go:153] Registering CRI-O factory
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401869    2573 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401932    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.401951    2573 factory.go:103] Registering Raw factory
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.402008    2573 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.402384    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.402404    2573 manager.go:349] Starting recovery of all containers
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.402533    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-125.ec2.internal" not found
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.403396    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.404008    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-125.ec2.internal\" not found" node="ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.416160    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-125.ec2.internal" not found
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.416668    2573 manager.go:354] Recovery completed
Jul 02 23:10:12.780399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.421863    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.425589    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.425615    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.425626    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.426259    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.426271    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.426277    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.426291    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427099    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427132    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427149    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427420    2573 policy_none.go:49] "None policy: Start"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427433    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.427444    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.428461    2573 policy_none.go:47] "Start"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.473851    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-125.ec2.internal" not found
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.488678    2573 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.488716    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.488726    2573 server.go:87] "Starting device plugin registration server"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.489030    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.489040    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.489127    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.489211    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.489222    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.489860    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.489917    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.526662    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.528034    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.528102    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.528137    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.528181    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.530463    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.589914    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.591463    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.591492    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.591507    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.591541    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.600469    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:12.600493    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-125.ec2.internal\": node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.645671    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"]
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.647908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.648910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.693313    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.698374    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.784839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.703901    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:12.786790 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.708642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.786790 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.708667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.786790 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.708694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4d63ef409094950b6ec013bdbf23f0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"6c4d63ef409094950b6ec013bdbf23f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.786790 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.710641    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.809819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4d63ef409094950b6ec013bdbf23f0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"6c4d63ef409094950b6ec013bdbf23f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.809851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.809867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.809927    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4d63ef409094950b6ec013bdbf23f0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"6c4d63ef409094950b6ec013bdbf23f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.810000    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:12.903692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:12.810050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30932a74b348095a7dd3a594d81325a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"30932a74b348095a7dd3a594d81325a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:13.117300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.008190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:13.117300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.014241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 02 23:10:13.339882 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.336431    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:10:13.339882 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.336653    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:13.339882 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.336653    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:13.339882 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.336694    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.382814    2573 apiserver.go:52] "Watching apiserver"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.389890    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:05:13 +0000 UTC" deadline="2028-01-07 09:49:03.249236296 +0000 UTC"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.389934    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13282h38m49.859305253s"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.394221    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.395364    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rkw8t","kube-system/konnectivity-agent-t26ch","kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sjdcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal","openshift-multus/multus-additional-cni-plugins-lg4ts","openshift-multus/network-metrics-daemon-zj9d7","openshift-ovn-kubernetes/ovnkube-node-vh4wr","kube-system/global-pull-secret-syncer-hwdkt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj","openshift-dns/node-resolver-9s79s","openshift-image-registry/node-ca-9k7w2","openshift-multus/multus-ppgdb","openshift-network-diagnostics/network-check-target-cskmv"]
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.396869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.397958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.399113    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.399636    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.399729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4q6rp\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.399753    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.399734    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.400211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.400500    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.400541    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.400803    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wphz\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.400820    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.401459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.401505    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.401528    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.401724    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.401767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gnrxq\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.402797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.402961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.403069    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.403097    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.403420    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.403543    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.403719    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nngrm\""
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.405347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.532745 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.405402    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.405527    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.405783    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406172    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406301    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406415    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wdfwz\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406702    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.406826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.407324    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.408015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.408972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.409425    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.409585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.409785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g6d92\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.410296    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410378    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410821    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410921    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-97wff\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410933    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410950    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.410982    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hmc9w\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.411015    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.411206    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.411591    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.411671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-44tqh\""
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9351f70f-6e01-4dad-8afd-367dbc3064fb-host-slash\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-tmp\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-system-cni-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.535159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysconfig\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-host\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs6fl\" (UniqueName: \"kubernetes.io/projected/a4843568-8872-452d-a8cd-5452d104de63-kube-api-access-vs6fl\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e8ccb3-d79a-4e77-b3f8-08935f215f43-konnectivity-ca\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-run\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-cnibin\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9351f70f-6e01-4dad-8afd-367dbc3064fb-iptables-alerter-script\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-var-lib-kubelet\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-etc-tuned\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-os-release\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssmw4\" (UniqueName: \"kubernetes.io/projected/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-kube-api-access-ssmw4\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-modprobe-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-conf\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-lib-modules\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.537342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xglh\" (UniqueName: \"kubernetes.io/projected/9351f70f-6e01-4dad-8afd-367dbc3064fb-kube-api-access-5xglh\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-kubernetes\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-systemd\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e8ccb3-d79a-4e77-b3f8-08935f215f43-agent-certs\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412727    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-sys\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94t2k\" (UniqueName: \"kubernetes.io/projected/656ca62d-f422-4a93-a688-16fc089444ee-kube-api-access-94t2k\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.412791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.417292    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.440973    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfg27"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.449638    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfg27"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.502354    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysconfig\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs6fl\" (UniqueName: \"kubernetes.io/projected/a4843568-8872-452d-a8cd-5452d104de63-kube-api-access-vs6fl\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-netns\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-cnibin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysconfig\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.538297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-run\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-cnibin\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-bin\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc28d19b-dfb8-4909-af3e-988562654b9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514298    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-run\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba0af08b-e746-4406-b9c7-82d95e148d7f-hosts-file\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514352    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-cnibin\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba0af08b-e746-4406-b9c7-82d95e148d7f-tmp-dir\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-var-lib-kubelet\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-os-release\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssmw4\" (UniqueName: \"kubernetes.io/projected/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-kube-api-access-ssmw4\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-var-lib-kubelet\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-systemd-units\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-socket-dir-parent\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-netns\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.539480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514568    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-os-release\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-netd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpksj\" (UniqueName: \"kubernetes.io/projected/ba0af08b-e746-4406-b9c7-82d95e148d7f-kube-api-access-cpksj\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-kubelet\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-etc-kubernetes\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-kubernetes\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-systemd\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-slash\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514768    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-kubernetes\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-sys-fs\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514805    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-systemd\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-var-lib-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-socket-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-conf-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e8ccb3-d79a-4e77-b3f8-08935f215f43-agent-certs\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.540686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.514977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-device-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-os-release\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9351f70f-6e01-4dad-8afd-367dbc3064fb-host-slash\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-tmp\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-system-cni-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515165    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9351f70f-6e01-4dad-8afd-367dbc3064fb-host-slash\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-928b9\" (UniqueName: \"kubernetes.io/projected/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kube-api-access-928b9\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515231    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-system-cni-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515225    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-kubelet-config\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-host\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-host\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-etc-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sm4d\" (UniqueName: \"kubernetes.io/projected/2c3a5902-591b-46e5-bb6f-4742af23c689-kube-api-access-7sm4d\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.541651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/656ca62d-f422-4a93-a688-16fc089444ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-multus\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e8ccb3-d79a-4e77-b3f8-08935f215f43-konnectivity-ca\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6f2k\" (UniqueName: \"kubernetes.io/projected/cc28d19b-dfb8-4909-af3e-988562654b9f-kube-api-access-p6f2k\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9351f70f-6e01-4dad-8afd-367dbc3064fb-iptables-alerter-script\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-etc-tuned\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515658    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-ovn\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-dbus\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-k8s-cni-cncf-io\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-hostroot\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdr6\" (UniqueName: \"kubernetes.io/projected/f85d1666-c93b-46a8-9b99-2a3e70af502d-kube-api-access-2wdr6\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-modprobe-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.515946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-conf\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-lib-modules\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516055    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e8ccb3-d79a-4e77-b3f8-08935f215f43-konnectivity-ca\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.542869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-modprobe-d\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9351f70f-6e01-4dad-8afd-367dbc3064fb-iptables-alerter-script\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516154    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-etc-sysctl-conf\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xglh\" (UniqueName: \"kubernetes.io/projected/9351f70f-6e01-4dad-8afd-367dbc3064fb-kube-api-access-5xglh\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-node-log\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-log-socket\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-env-overrides\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516159    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-lib-modules\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-script-lib\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-kubelet\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-systemd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-config\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.544000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-registration-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c3a5902-591b-46e5-bb6f-4742af23c689-serviceca\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-multus-certs\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-sys\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94t2k\" (UniqueName: \"kubernetes.io/projected/656ca62d-f422-4a93-a688-16fc089444ee-kube-api-access-94t2k\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4843568-8872-452d-a8cd-5452d104de63-sys\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516766    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c3a5902-591b-46e5-bb6f-4742af23c689-host\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516791    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-system-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.516869    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516875    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-bin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-cni-binary-copy\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-daemon-config\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.516957    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:14.016939616 +0000 UTC m=+2.001007967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:13.545401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.516971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/656ca62d-f422-4a93-a688-16fc089444ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.518813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-etc-tuned\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.518869    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4843568-8872-452d-a8cd-5452d104de63-tmp\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.519118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e8ccb3-d79a-4e77-b3f8-08935f215f43-agent-certs\") pod \"konnectivity-agent-t26ch\" (UID: \"76e8ccb3-d79a-4e77-b3f8-08935f215f43\") " pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.528339    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xglh\" (UniqueName: \"kubernetes.io/projected/9351f70f-6e01-4dad-8afd-367dbc3064fb-kube-api-access-5xglh\") pod \"iptables-alerter-rkw8t\" (UID: \"9351f70f-6e01-4dad-8afd-367dbc3064fb\") " pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.528906    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssmw4\" (UniqueName: \"kubernetes.io/projected/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-kube-api-access-ssmw4\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.529395    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs6fl\" (UniqueName: \"kubernetes.io/projected/a4843568-8872-452d-a8cd-5452d104de63-kube-api-access-vs6fl\") pod \"tuned-sjdcd\" (UID: \"a4843568-8872-452d-a8cd-5452d104de63\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.546360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.531958    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94t2k\" (UniqueName: \"kubernetes.io/projected/656ca62d-f422-4a93-a688-16fc089444ee-kube-api-access-94t2k\") pod \"multus-additional-cni-plugins-lg4ts\" (UID: \"656ca62d-f422-4a93-a688-16fc089444ee\") " pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-config\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-registration-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618209    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-registration-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c3a5902-591b-46e5-bb6f-4742af23c689-serviceca\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-multus-certs\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c3a5902-591b-46e5-bb6f-4742af23c689-host\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-system-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618345    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-bin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-cni-binary-copy\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-multus-certs\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618416    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c3a5902-591b-46e5-bb6f-4742af23c689-host\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-bin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618430    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-system-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-daemon-config\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-netns\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.688320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-cni-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-cnibin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618381    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618566    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-netns\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-bin\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc28d19b-dfb8-4909-af3e-988562654b9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618633    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-cnibin\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba0af08b-e746-4406-b9c7-82d95e148d7f-hosts-file\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba0af08b-e746-4406-b9c7-82d95e148d7f-tmp-dir\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-bin\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-config\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-systemd-units\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618789    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c3a5902-591b-46e5-bb6f-4742af23c689-serviceca\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618818    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-systemd-units\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618847    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba0af08b-e746-4406-b9c7-82d95e148d7f-hosts-file\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-socket-dir-parent\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-netns\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-netd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.690012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-socket-dir-parent\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.618991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619013    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-netns\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpksj\" (UniqueName: \"kubernetes.io/projected/ba0af08b-e746-4406-b9c7-82d95e148d7f-kube-api-access-cpksj\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-daemon-config\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619029    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-cni-netd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-kubelet\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-etc-kubernetes\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619086    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f85d1666-c93b-46a8-9b99-2a3e70af502d-cni-binary-copy\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.619106    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-slash\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619120    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-etc-kubernetes\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619123    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-kubelet\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-sys-fs\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619081    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba0af08b-e746-4406-b9c7-82d95e148d7f-tmp-dir\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-slash\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.619167    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:14.119148284 +0000 UTC m=+2.103216625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:13.691003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619188    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-sys-fs\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-var-lib-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-socket-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619281    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-var-lib-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619300    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-conf-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619339    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-multus-conf-dir\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619360    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-socket-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-device-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-os-release\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928b9\" (UniqueName: \"kubernetes.io/projected/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kube-api-access-928b9\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-kubelet-config\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-etc-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sm4d\" (UniqueName: \"kubernetes.io/projected/2c3a5902-591b-46e5-bb6f-4742af23c689-kube-api-access-7sm4d\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.692847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-multus\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619530    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-device-dir\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-etc-openvswitch\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-os-release\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619539    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-kubelet-config\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619572    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-var-lib-cni-multus\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6f2k\" (UniqueName: \"kubernetes.io/projected/cc28d19b-dfb8-4909-af3e-988562654b9f-kube-api-access-p6f2k\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-ovn\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-dbus\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-ovn\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-k8s-cni-cncf-io\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-hostroot\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619763    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-host-run-k8s-cni-cncf-io\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f85d1666-c93b-46a8-9b99-2a3e70af502d-hostroot\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619812    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-dbus\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdr6\" (UniqueName: \"kubernetes.io/projected/f85d1666-c93b-46a8-9b99-2a3e70af502d-kube-api-access-2wdr6\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.693821 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-node-log\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619915    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-log-socket\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-env-overrides\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-node-log\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.619977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-script-lib\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620006    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-log-socket\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-kubelet\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-systemd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620147    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620152    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-run-systemd\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620173    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc28d19b-dfb8-4909-af3e-988562654b9f-host-kubelet\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620326    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-env-overrides\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.620453    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc28d19b-dfb8-4909-af3e-988562654b9f-ovnkube-script-lib\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.621399    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc28d19b-dfb8-4909-af3e-988562654b9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.631423    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.631449    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:13.695945 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.631465    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.631555    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:14.131535517 +0000 UTC m=+2.115603858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.632762    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdr6\" (UniqueName: \"kubernetes.io/projected/f85d1666-c93b-46a8-9b99-2a3e70af502d-kube-api-access-2wdr6\") pod \"multus-ppgdb\" (UID: \"f85d1666-c93b-46a8-9b99-2a3e70af502d\") " pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.632919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sm4d\" (UniqueName: \"kubernetes.io/projected/2c3a5902-591b-46e5-bb6f-4742af23c689-kube-api-access-7sm4d\") pod \"node-ca-9k7w2\" (UID: \"2c3a5902-591b-46e5-bb6f-4742af23c689\") " pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.633188    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpksj\" (UniqueName: \"kubernetes.io/projected/ba0af08b-e746-4406-b9c7-82d95e148d7f-kube-api-access-cpksj\") pod \"node-resolver-9s79s\" (UID: \"ba0af08b-e746-4406-b9c7-82d95e148d7f\") " pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.633348    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-928b9\" (UniqueName: \"kubernetes.io/projected/b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e-kube-api-access-928b9\") pod \"aws-ebs-csi-driver-node-mnlhj\" (UID: \"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.696908 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.635533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6f2k\" (UniqueName: \"kubernetes.io/projected/cc28d19b-dfb8-4909-af3e-988562654b9f-kube-api-access-p6f2k\") pod \"ovnkube-node-vh4wr\" (UID: \"cc28d19b-dfb8-4909-af3e-988562654b9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.709539    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4d63ef409094950b6ec013bdbf23f0.slice/crio-578347c5d01a6ee10b5539d4096ea43c035f13d12fa2b472b37a3c30dac205ad WatchSource:0}: Error finding container 578347c5d01a6ee10b5539d4096ea43c035f13d12fa2b472b37a3c30dac205ad: Status 404 returned error can't find the container with id 578347c5d01a6ee10b5539d4096ea43c035f13d12fa2b472b37a3c30dac205ad
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.709831    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30932a74b348095a7dd3a594d81325a8.slice/crio-3e88d77841c00b3b96f83da6b11b1b939c2c3d4092f866e1f7023f99dfd8dbe7 WatchSource:0}: Error finding container 3e88d77841c00b3b96f83da6b11b1b939c2c3d4092f866e1f7023f99dfd8dbe7: Status 404 returned error can't find the container with id 3e88d77841c00b3b96f83da6b11b1b939c2c3d4092f866e1f7023f99dfd8dbe7
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.715218    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.731727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkw8t"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.741360    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9351f70f_6e01_4dad_8afd_367dbc3064fb.slice/crio-ff7f6ea4f3a1868ff23743c3c41fcce1cc8a42b18311cc7c514921945043fec3 WatchSource:0}: Error finding container ff7f6ea4f3a1868ff23743c3c41fcce1cc8a42b18311cc7c514921945043fec3: Status 404 returned error can't find the container with id ff7f6ea4f3a1868ff23743c3c41fcce1cc8a42b18311cc7c514921945043fec3
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.754280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.763938    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e8ccb3_d79a_4e77_b3f8_08935f215f43.slice/crio-65cec9bcb530b18048393973e25da2d3d26f1d9bdcbe27c6a13699bcf3f3416e WatchSource:0}: Error finding container 65cec9bcb530b18048393973e25da2d3d26f1d9bdcbe27c6a13699bcf3f3416e: Status 404 returned error can't find the container with id 65cec9bcb530b18048393973e25da2d3d26f1d9bdcbe27c6a13699bcf3f3416e
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.772406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjdcd"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.779465    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lg4ts"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.785070    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4843568_8872_452d_a8cd_5452d104de63.slice/crio-4dbe4d2604f21e5a38b10599943753c18b341d4ccebfdc176d021a27121f76a9 WatchSource:0}: Error finding container 4dbe4d2604f21e5a38b10599943753c18b341d4ccebfdc176d021a27121f76a9: Status 404 returned error can't find the container with id 4dbe4d2604f21e5a38b10599943753c18b341d4ccebfdc176d021a27121f76a9
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.788036    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656ca62d_f422_4a93_a688_16fc089444ee.slice/crio-a7f316a3f8ba720751268e5b40545f48646fbcc5d2d02f36c237f2e4b7d3e918 WatchSource:0}: Error finding container a7f316a3f8ba720751268e5b40545f48646fbcc5d2d02f36c237f2e4b7d3e918: Status 404 returned error can't find the container with id a7f316a3f8ba720751268e5b40545f48646fbcc5d2d02f36c237f2e4b7d3e918
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.796502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.802799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.807649    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc28d19b_dfb8_4909_af3e_988562654b9f.slice/crio-b3dcf139cfa5735ea0d5d71014ab4de572ea7791fdd4468cb77f75ab956b0c54 WatchSource:0}: Error finding container b3dcf139cfa5735ea0d5d71014ab4de572ea7791fdd4468cb77f75ab956b0c54: Status 404 returned error can't find the container with id b3dcf139cfa5735ea0d5d71014ab4de572ea7791fdd4468cb77f75ab956b0c54
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.813158    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dccbe3_cf23_4fbf_ae62_247ccaf1e62e.slice/crio-1e6be933d04b5bc9be2497f2bf6cc709be03375eb227709ca41fd683c688b6e5 WatchSource:0}: Error finding container 1e6be933d04b5bc9be2497f2bf6cc709be03375eb227709ca41fd683c688b6e5: Status 404 returned error can't find the container with id 1e6be933d04b5bc9be2497f2bf6cc709be03375eb227709ca41fd683c688b6e5
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.828940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9s79s"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.839127    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0af08b_e746_4406_b9c7_82d95e148d7f.slice/crio-de49eea5af33a2714367d1e80a706ef2dcf72a0ebe06036a4db5743bde905400 WatchSource:0}: Error finding container de49eea5af33a2714367d1e80a706ef2dcf72a0ebe06036a4db5743bde905400: Status 404 returned error can't find the container with id de49eea5af33a2714367d1e80a706ef2dcf72a0ebe06036a4db5743bde905400
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.881238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9k7w2"
Jul 02 23:10:13.900515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:13.884253    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ppgdb"
Jul 02 23:10:13.902377 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.892237    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3a5902_591b_46e5_bb6f_4742af23c689.slice/crio-77f23bfe24bd26763775761eeff22c0b1792c80e83855bee94524bc10c7d9759 WatchSource:0}: Error finding container 77f23bfe24bd26763775761eeff22c0b1792c80e83855bee94524bc10c7d9759: Status 404 returned error can't find the container with id 77f23bfe24bd26763775761eeff22c0b1792c80e83855bee94524bc10c7d9759
Jul 02 23:10:13.902377 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:13.896098    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85d1666_c93b_46a8_9b99_2a3e70af502d.slice/crio-74192535ef497ec857bf72e3ceb5946351b07e56ae178390072f003ef7010d3d WatchSource:0}: Error finding container 74192535ef497ec857bf72e3ceb5946351b07e56ae178390072f003ef7010d3d: Status 404 returned error can't find the container with id 74192535ef497ec857bf72e3ceb5946351b07e56ae178390072f003ef7010d3d
Jul 02 23:10:13.902377 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.897916    2573 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-ppgdb_openshift-multus(f85d1666-c93b-46a8-9b99-2a3e70af502d): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 02 23:10:13.902377 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:13.897973    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-ppgdb" podUID="f85d1666-c93b-46a8-9b99-2a3e70af502d"
Jul 02 23:10:14.119505 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.024105    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:14.119505 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.024263    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:14.119505 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.024331    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:15.024315072 +0000 UTC m=+3.008383411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:14.127682 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.125874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:14.127682 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.126028    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:14.127682 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.126108    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:15.126090537 +0000 UTC m=+3.110158877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:14.260559 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.226518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:14.260559 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.226740    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:14.260559 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.226767    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:14.260559 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.226789    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:14.260559 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.226901    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:15.226853575 +0000 UTC m=+3.210921919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:14.451598 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.451548    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:14 +0000 UTC" deadline="2028-01-23 10:06:50.162365834 +0000 UTC"
Jul 02 23:10:14.451598 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.451590    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13666h56m35.710780929s"
Jul 02 23:10:14.526547 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.526507    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:14.530548 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.529986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:14.530548 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.530126    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:14.530548 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.530332    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:14.570156 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.569308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9k7w2" event={"ID":"2c3a5902-591b-46e5-bb6f-4742af23c689","Type":"ContainerStarted","Data":"77f23bfe24bd26763775761eeff22c0b1792c80e83855bee94524bc10c7d9759"}
Jul 02 23:10:14.592035 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.591839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9s79s" event={"ID":"ba0af08b-e746-4406-b9c7-82d95e148d7f","Type":"ContainerStarted","Data":"de49eea5af33a2714367d1e80a706ef2dcf72a0ebe06036a4db5743bde905400"}
Jul 02 23:10:14.599985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.599936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t26ch" event={"ID":"76e8ccb3-d79a-4e77-b3f8-08935f215f43","Type":"ContainerStarted","Data":"65cec9bcb530b18048393973e25da2d3d26f1d9bdcbe27c6a13699bcf3f3416e"}
Jul 02 23:10:14.614233 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.614146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkw8t" event={"ID":"9351f70f-6e01-4dad-8afd-367dbc3064fb","Type":"ContainerStarted","Data":"ff7f6ea4f3a1868ff23743c3c41fcce1cc8a42b18311cc7c514921945043fec3"}
Jul 02 23:10:14.617134 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.617045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"30932a74b348095a7dd3a594d81325a8","Type":"ContainerStarted","Data":"3e88d77841c00b3b96f83da6b11b1b939c2c3d4092f866e1f7023f99dfd8dbe7"}
Jul 02 23:10:14.619026 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.618994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj" event={"ID":"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e","Type":"ContainerStarted","Data":"1e6be933d04b5bc9be2497f2bf6cc709be03375eb227709ca41fd683c688b6e5"}
Jul 02 23:10:14.633053 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.632842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"b3dcf139cfa5735ea0d5d71014ab4de572ea7791fdd4468cb77f75ab956b0c54"}
Jul 02 23:10:14.644562 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.644514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerStarted","Data":"a7f316a3f8ba720751268e5b40545f48646fbcc5d2d02f36c237f2e4b7d3e918"}
Jul 02 23:10:14.653225 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.653186    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:14.655441 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.655405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjdcd" event={"ID":"a4843568-8872-452d-a8cd-5452d104de63","Type":"ContainerStarted","Data":"4dbe4d2604f21e5a38b10599943753c18b341d4ccebfdc176d021a27121f76a9"}
Jul 02 23:10:14.665140 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.665103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" event={"ID":"6c4d63ef409094950b6ec013bdbf23f0","Type":"ContainerStarted","Data":"578347c5d01a6ee10b5539d4096ea43c035f13d12fa2b472b37a3c30dac205ad"}
Jul 02 23:10:14.677609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:14.677570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ppgdb" event={"ID":"f85d1666-c93b-46a8-9b99-2a3e70af502d","Type":"ContainerStarted","Data":"74192535ef497ec857bf72e3ceb5946351b07e56ae178390072f003ef7010d3d"}
Jul 02 23:10:14.680487 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:14.680358    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55ec7147f859301bbb8288966c8a21c5db729200f3c3d91db671978baef79517\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-ppgdb" podUID="f85d1666-c93b-46a8-9b99-2a3e70af502d"
Jul 02 23:10:15.035054 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.035010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:15.035265 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.035232    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:15.035336 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.035300    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:17.035280107 +0000 UTC m=+5.019348454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:15.136304 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.136261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:15.136515 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.136450    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:15.136576 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.136517    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:17.136497387 +0000 UTC m=+5.120565745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:15.237503 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.237400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:15.237708 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.237588    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:15.237708 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.237612    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:15.237708 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.237626    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:15.237708 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.237690    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:17.237670957 +0000 UTC m=+5.221739368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:15.452102 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.452027    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:14 +0000 UTC" deadline="2028-01-05 15:18:43.1361294 +0000 UTC"
Jul 02 23:10:15.452102 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.452098    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13240h8m27.68403676s"
Jul 02 23:10:15.528741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.528707    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:15.528922 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.528843    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:15.529322 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:15.529297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:15.529469 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:15.529421    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:16.533020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:16.532080    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:16.533020 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:16.532231    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:17.057867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:17.057788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:17.058080 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.057939    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:17.058080 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.058024    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:21.058003109 +0000 UTC m=+9.042071452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:17.159033 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:17.158996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:17.159248 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.159179    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:17.159346 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.159258    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:21.159235743 +0000 UTC m=+9.143304088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:17.260825 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:17.260071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:17.260825 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.260345    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:17.260825 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.260367    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:17.260825 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.260381    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:17.260825 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.260452    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:21.260432432 +0000 UTC m=+9.244500797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:17.529224 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:17.529183    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:17.529443 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.529354    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:17.529772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:17.529746    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:17.529915 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:17.529870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:18.529299 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:18.529247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:18.529789 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:18.529404    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:19.528776 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:19.528734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:19.529006 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:19.528867    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:19.529006 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:19.528940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:19.529137 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:19.529038    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:20.529414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:20.529271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:20.529414 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:20.529412    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:21.096446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:21.096395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:21.096657 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.096576    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:21.096657 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.096650    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:29.09662808 +0000 UTC m=+17.080696439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:21.197461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:21.197418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:21.197639 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.197560    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:21.197700 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.197638    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:29.197617242 +0000 UTC m=+17.181685585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:21.298123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:21.298082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:21.298339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.298279    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:21.298339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.298311    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:21.298339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.298328    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:21.298510 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.298408    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:29.298384266 +0000 UTC m=+17.282452628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:21.528511 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:21.528473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:21.528719 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.528607    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:21.528719 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:21.528644    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:21.528719 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:21.528713    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:22.529632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:22.529595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:22.530127 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:22.529716    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:23.529420 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:23.529381    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:23.529603 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:23.529421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:23.529603 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:23.529517    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:23.530032 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:23.529658    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:24.529256 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:24.529220    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:24.529435 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:24.529367    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:25.528584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.528398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:25.529331 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.528423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:25.529331 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:25.528705    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:25.529331 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:25.528751    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:25.711034 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.710948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9k7w2" event={"ID":"2c3a5902-591b-46e5-bb6f-4742af23c689","Type":"ContainerStarted","Data":"ae5a6fd407b077271295e6a5fd6d0fee639f37170a43423002899288b8e843ab"}
Jul 02 23:10:25.712556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.712514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9s79s" event={"ID":"ba0af08b-e746-4406-b9c7-82d95e148d7f","Type":"ContainerStarted","Data":"8154487423c14d4e1a4fea557e03065f8071ad72370e49a40b3c03452482a6bd"}
Jul 02 23:10:25.714107 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.714075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t26ch" event={"ID":"76e8ccb3-d79a-4e77-b3f8-08935f215f43","Type":"ContainerStarted","Data":"8de1609ada685f873926a90fe2f68b11a90a0d0b8eed8a53e7480423499097cf"}
Jul 02 23:10:25.715569 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.715541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"30932a74b348095a7dd3a594d81325a8","Type":"ContainerStarted","Data":"f5d232b190cc2ebdaca36446491888fd3a5381dc0d392a1c8c448121e2ab8364"}
Jul 02 23:10:25.717143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.717092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj" event={"ID":"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e","Type":"ContainerStarted","Data":"2df30e08c38adcb507b2b30a0faa244bf652430c8a374e52d3798d1976ae1be8"}
Jul 02 23:10:25.718625 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.718602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerStarted","Data":"78ff29e40a7ebe29b83538e680a068022cd1933a1a1740b4152e57b5bd63ab88"}
Jul 02 23:10:25.720103 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.720073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjdcd" event={"ID":"a4843568-8872-452d-a8cd-5452d104de63","Type":"ContainerStarted","Data":"3c696664ec9c40cfaea64e660db3b67b80800773232e98f66b577ee72ce03ba0"}
Jul 02 23:10:25.721651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.721627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" event={"ID":"6c4d63ef409094950b6ec013bdbf23f0","Type":"ContainerStarted","Data":"3728ff6acc374087af1c7dd30f81da45904f9b46daae75683c109dc46410dad9"}
Jul 02 23:10:25.726674 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.726623    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9k7w2" podStartSLOduration=1.936322656 podStartE2EDuration="12.726605117s" totalImagesPullingTime="10.790282461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.725850177 +0000 UTC m=+13.709918539" watchObservedRunningTime="2026-07-02 23:10:25.726605117 +0000 UTC m=+13.710673478"
Jul 02 23:10:25.774904 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.774822    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t26ch" podStartSLOduration=1.8537756010000002 podStartE2EDuration="12.774799115s" totalImagesPullingTime="10.921023514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.756731709 +0000 UTC m=+13.740800068" watchObservedRunningTime="2026-07-02 23:10:25.774799115 +0000 UTC m=+13.758867528"
Jul 02 23:10:25.775076 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.775002    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sjdcd" podStartSLOduration=1.859860136 podStartE2EDuration="12.774992017s" totalImagesPullingTime="10.915131881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.773896509 +0000 UTC m=+13.757964865" watchObservedRunningTime="2026-07-02 23:10:25.774992017 +0000 UTC m=+13.759060378"
Jul 02 23:10:25.789252 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.789201    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9s79s" podStartSLOduration=1.945559288 podStartE2EDuration="12.789182698s" totalImagesPullingTime="10.84362341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.789096897 +0000 UTC m=+13.773165259" watchObservedRunningTime="2026-07-02 23:10:25.789182698 +0000 UTC m=+13.773251052"
Jul 02 23:10:25.808499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:25.808446    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" podStartSLOduration=12.808424746 podStartE2EDuration="12.808424746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.807471621 +0000 UTC m=+13.791539991" watchObservedRunningTime="2026-07-02 23:10:25.808424746 +0000 UTC m=+13.792493107"
Jul 02 23:10:26.529086 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:26.528778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:26.529480 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:26.529152    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:26.726370 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:26.726324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkw8t" event={"ID":"9351f70f-6e01-4dad-8afd-367dbc3064fb","Type":"ContainerStarted","Data":"3c8e39614293a66988399d07910fc6d06e72206369585af624f545e7bdf99924"}
Jul 02 23:10:26.744738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:26.744681    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rkw8t" podStartSLOduration=2.792629847 podStartE2EDuration="13.74466687s" totalImagesPullingTime="10.952037023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:26.744452199 +0000 UTC m=+14.728520582" watchObservedRunningTime="2026-07-02 23:10:26.74466687 +0000 UTC m=+14.728735239"
Jul 02 23:10:27.528638 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:27.528569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:27.528826 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:27.528570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:27.528826 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:27.528697    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:27.528826 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:27.528764    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:28.086009 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:28.085971    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:28.086660 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:28.086637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:28.528941 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:28.528908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:28.529225 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:28.529193    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:29.161394 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:29.161353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:29.161849 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.161520    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:29.161849 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.161587    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:45.161572492 +0000 UTC m=+33.145640830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:29.262146 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:29.262103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:29.262339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.262244    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:29.262339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.262315    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:45.262294808 +0000 UTC m=+33.246363151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:29.363137 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:29.363101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:29.363311 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.363283    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:29.363311 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.363306    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:29.363400 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.363316    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:29.363400 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.363373    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:45.363358285 +0000 UTC m=+33.347426623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:29.528572 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:29.528535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:29.528730 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.528661    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:29.528730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:29.528718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:29.528866 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:29.528839    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:30.529083 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.528828    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:30.529771 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:30.529203    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:30.719477 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.719450    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:10:30.736375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.736320    2573 generic.go:356] "Generic (PLEG): container finished" podID="30932a74b348095a7dd3a594d81325a8" containerID="f5d232b190cc2ebdaca36446491888fd3a5381dc0d392a1c8c448121e2ab8364" exitCode=0
Jul 02 23:10:30.736518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.736400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"30932a74b348095a7dd3a594d81325a8","Type":"ContainerDied","Data":"f5d232b190cc2ebdaca36446491888fd3a5381dc0d392a1c8c448121e2ab8364"}
Jul 02 23:10:30.738867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.738829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj" event={"ID":"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e","Type":"ContainerStarted","Data":"0fbd4c82231291243b3c475a3254a13f3560ccea44c0139e7bbe59e3973daf15"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.743823    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"acffcc56d3e462762c6c00e781c72b2ef39c57925a12a0821e83535182d2ff7d"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.743931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"5f89d8154ab6bca9d644ea06ac12e8c537456942b820388f782e3149a3c57630"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.743985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"61fc3e2ecc64c7d43125fa450638d3a4e0d2ef5c5628eb4af77b3a068bcacc7c"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.744031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"76c0a58ef1c6900234ee96548e9521e533404f2b3d09e80f6f41652632392c83"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.744082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"efe992335d8d1a9de715b5b2b240d37cd9a55a9deddaa1dc08769f1c3f8757de"}
Jul 02 23:10:30.744187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.744130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"b731a20f6fd508db870a9a27476174794f04806fa768605ee14b1e1c282897b4"}
Jul 02 23:10:30.745799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.745774    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="78ff29e40a7ebe29b83538e680a068022cd1933a1a1740b4152e57b5bd63ab88" exitCode=0
Jul 02 23:10:30.745925 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:30.745814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"78ff29e40a7ebe29b83538e680a068022cd1933a1a1740b4152e57b5bd63ab88"}
Jul 02 23:10:31.499983 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.499623    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:10:30.719473204Z","UUID":"b22132e5-afd3-4458-8d4f-26d8d5a6dd68","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:10:31.501828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.501807    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:10:31.502038 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.501851    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:10:31.528917 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.528864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:31.529051 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.528864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:31.529051 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:31.529019    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:31.529123 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:31.529066    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:31.750836 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.750752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"30932a74b348095a7dd3a594d81325a8","Type":"ContainerStarted","Data":"9628cc60e5f9be142d4f979d085d0a6343bccc3a8c23b7d93460d396e2c12fd4"}
Jul 02 23:10:31.767196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:31.767135    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" podStartSLOduration=18.767115082 podStartE2EDuration="18.767115082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:31.766700616 +0000 UTC m=+19.750768977" watchObservedRunningTime="2026-07-02 23:10:31.767115082 +0000 UTC m=+19.751183444"
Jul 02 23:10:32.529501 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:32.529468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:32.530089 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:32.529906    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:32.756241 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:32.756170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj" event={"ID":"b7dccbe3-cf23-4fbf-ae62-247ccaf1e62e","Type":"ContainerStarted","Data":"80fb0d86ed3c37529a239c46255c112be7a016852fecdf1a4236f7a8fdfe215e"}
Jul 02 23:10:32.777838 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:32.777684    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnlhj" podStartSLOduration=2.812572693 podStartE2EDuration="19.777663417s" totalImagesPullingTime="16.965090724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:32.7774253 +0000 UTC m=+20.761493662" watchObservedRunningTime="2026-07-02 23:10:32.777663417 +0000 UTC m=+20.761731781"
Jul 02 23:10:33.529082 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:33.529047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:33.529260 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:33.529200    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:33.529334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:33.529256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:33.529392 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:33.529375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:33.762234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:33.762195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"3ee4d1bbe1401ebc606b0ab2aeaf5a087848336d3dc419e1b6859553c011f36f"}
Jul 02 23:10:34.528609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:34.528583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:34.528775 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:34.528688    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:35.528973 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:35.528871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:35.528973 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:35.528927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:35.529577 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:35.529029    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:35.529577 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:35.529197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:36.529004 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:36.528922    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:36.529490 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:36.529066    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:37.529228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:37.529185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:37.529228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:37.529224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:37.529768 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:37.529306    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:37.529768 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:37.529431    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:38.529311 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:38.529282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:38.529694 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:38.529414    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:39.529219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:39.529178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:39.529219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:39.529211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:39.529774 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:39.529337    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:39.529774 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:39.529467    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:40.528922 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.528712    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:40.529131 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:40.529004    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:40.782963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.782920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" event={"ID":"cc28d19b-dfb8-4909-af3e-988562654b9f","Type":"ContainerStarted","Data":"2ee1f946b0b3793c4501ec5539d0f180f9471bfff6a02c409126e196a5328d73"}
Jul 02 23:10:40.783460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.783162    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:40.784734 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.784711    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="53112c0d6753fb376e15e30c8967d761375baf86d29b6c13ef5ac177ed800563" exitCode=0
Jul 02 23:10:40.784867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.784788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"53112c0d6753fb376e15e30c8967d761375baf86d29b6c13ef5ac177ed800563"}
Jul 02 23:10:40.786307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.786282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ppgdb" event={"ID":"f85d1666-c93b-46a8-9b99-2a3e70af502d","Type":"ContainerStarted","Data":"aedc2c2eec7f0c15267ea3ce2e250f031ec77a23e07ddf59c59247a7cb4ef6f1"}
Jul 02 23:10:40.799626 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.799588    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:40.809791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.809746    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr" podStartSLOduration=11.558638878 podStartE2EDuration="27.809731157s" totalImagesPullingTime="16.251092279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:40.809164553 +0000 UTC m=+28.793232914" watchObservedRunningTime="2026-07-02 23:10:40.809731157 +0000 UTC m=+28.793799517"
Jul 02 23:10:40.830608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:40.830556    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ppgdb" podStartSLOduration=1.3887108590000001 podStartE2EDuration="27.830540334s" totalImagesPullingTime="26.441829475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 23:10:40.830109055 +0000 UTC m=+28.814177414" watchObservedRunningTime="2026-07-02 23:10:40.830540334 +0000 UTC m=+28.814608694"
Jul 02 23:10:41.528770 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:41.528726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:41.528976 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:41.528779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:41.528976 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:41.528866    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:41.529097 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:41.528986    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:41.788525 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:41.788445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:41.788861 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:41.788528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:41.803840 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:41.803810    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:10:42.098361 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.098133    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwdkt"]
Jul 02 23:10:42.098495 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.098460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:42.098607 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:42.098580    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:42.101348 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.101297    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cskmv"]
Jul 02 23:10:42.101429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.101397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:42.101513 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:42.101490    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:42.102183 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.102104    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zj9d7"]
Jul 02 23:10:42.102285 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.102197    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:42.102343 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:42.102290    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:42.280513 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.280472    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:42.280682 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.280596    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 23:10:42.281124 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.281110    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t26ch"
Jul 02 23:10:42.792316 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.792277    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="1239b830ace2232399763cc69eed7104781dc8aba87f7f4ce7fcef3c06c905c4" exitCode=0
Jul 02 23:10:42.792811 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:42.792361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"1239b830ace2232399763cc69eed7104781dc8aba87f7f4ce7fcef3c06c905c4"}
Jul 02 23:10:43.529142 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:43.529108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:43.529317 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:43.529107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:43.529317 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:43.529252    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:43.529317 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:43.529107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:43.529317 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:43.529299    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:43.529518 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:43.529361    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:44.799050 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:44.798965    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="98870a14007c145e24ea930978093566e58135f46ac704da7cee15fec5804150" exitCode=0
Jul 02 23:10:44.799050 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:44.799023    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"98870a14007c145e24ea930978093566e58135f46ac704da7cee15fec5804150"}
Jul 02 23:10:45.184706 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.184676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:45.184839 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.184788    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:45.184912 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.184845    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs podName:2ef9dea4-06a4-4fd9-9321-ba5296b61b59 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:17.184828995 +0000 UTC m=+65.168897352 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs") pod "network-metrics-daemon-zj9d7" (UID: "2ef9dea4-06a4-4fd9-9321-ba5296b61b59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:45.285438 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.285404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:45.285619 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.285564    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:45.285661 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.285633    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret podName:e76d6b91-105e-4eb3-9942-40d5e59a2c4f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:17.28561762 +0000 UTC m=+65.269685960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret") pod "global-pull-secret-syncer-hwdkt" (UID: "e76d6b91-105e-4eb3-9942-40d5e59a2c4f") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:45.386383 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.386349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:45.386563 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.386498    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:45.386563 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.386519    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:45.386563 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.386532    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qzttz for pod openshift-network-diagnostics/network-check-target-cskmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:45.386685 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.386602    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz podName:45bafc54-d8c7-4f45-b075-85853e493b72 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:17.386582205 +0000 UTC m=+65.370650546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzttz" (UniqueName: "kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz") pod "network-check-target-cskmv" (UID: "45bafc54-d8c7-4f45-b075-85853e493b72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:45.528930 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.528826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:45.528930 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.528826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:45.529149 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.528971    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwdkt" podUID="e76d6b91-105e-4eb3-9942-40d5e59a2c4f"
Jul 02 23:10:45.529149 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.528826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:45.529149 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.529027    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zj9d7" podUID="2ef9dea4-06a4-4fd9-9321-ba5296b61b59"
Jul 02 23:10:45.529149 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:45.529114    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cskmv" podUID="45bafc54-d8c7-4f45-b075-85853e493b72"
Jul 02 23:10:45.849761 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.849687    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeReady"
Jul 02 23:10:45.850232 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.849852    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:10:45.900530 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.900489    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d5tkh"]
Jul 02 23:10:45.916504 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.916466    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pgr7p"]
Jul 02 23:10:45.916726 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.916593    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:45.919684 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.919627    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:10:45.919836 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.919779    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:10:45.919836 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.919796    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bnq4k\""
Jul 02 23:10:45.934172 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.934146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5tkh"]
Jul 02 23:10:45.934296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.934190    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgr7p"]
Jul 02 23:10:45.934296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.934249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:45.937636 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.937611    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:10:45.937772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.937659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:10:45.937772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.937716    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7f7m\""
Jul 02 23:10:45.937772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:45.937724    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:10:46.094006 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.093969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqr5\" (UniqueName: \"kubernetes.io/projected/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-kube-api-access-fkqr5\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.094201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.094035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62277ec7-af6d-4cc6-bd68-1923a99a3984-cert\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.094201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.094125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-config-volume\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.094201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.094164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.094201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.094191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-tmp-dir\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.094355 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.094270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vxw\" (UniqueName: \"kubernetes.io/projected/62277ec7-af6d-4cc6-bd68-1923a99a3984-kube-api-access-75vxw\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.195251 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62277ec7-af6d-4cc6-bd68-1923a99a3984-cert\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.195414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-config-volume\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.195414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.195414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-tmp-dir\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.195414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vxw\" (UniqueName: \"kubernetes.io/projected/62277ec7-af6d-4cc6-bd68-1923a99a3984-kube-api-access-75vxw\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.195414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqr5\" (UniqueName: \"kubernetes.io/projected/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-kube-api-access-fkqr5\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.195672 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:46.195469    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:46.195672 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:46.195543    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:10:46.695522483 +0000 UTC m=+34.679590824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:46.195951 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.195921    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-tmp-dir\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.196074 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.196014    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-config-volume\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.200278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.200130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62277ec7-af6d-4cc6-bd68-1923a99a3984-cert\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.207267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.207244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqr5\" (UniqueName: \"kubernetes.io/projected/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-kube-api-access-fkqr5\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.207380 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.207334    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vxw\" (UniqueName: \"kubernetes.io/projected/62277ec7-af6d-4cc6-bd68-1923a99a3984-kube-api-access-75vxw\") pod \"ingress-canary-pgr7p\" (UID: \"62277ec7-af6d-4cc6-bd68-1923a99a3984\") " pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.244329 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.244298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgr7p"
Jul 02 23:10:46.463665 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.463559    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgr7p"]
Jul 02 23:10:46.467394 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:46.467358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62277ec7_af6d_4cc6_bd68_1923a99a3984.slice/crio-4f79e5eb215461935b3025a81dc16d7f1c140eb5f5e0988e56df9eeb80092bc4 WatchSource:0}: Error finding container 4f79e5eb215461935b3025a81dc16d7f1c140eb5f5e0988e56df9eeb80092bc4: Status 404 returned error can't find the container with id 4f79e5eb215461935b3025a81dc16d7f1c140eb5f5e0988e56df9eeb80092bc4
Jul 02 23:10:46.698670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.698629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:46.698865 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:46.698747    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:46.698865 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:46.698812    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:10:47.698796601 +0000 UTC m=+35.682864938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:46.805975 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:46.805871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgr7p" event={"ID":"62277ec7-af6d-4cc6-bd68-1923a99a3984","Type":"ContainerStarted","Data":"4f79e5eb215461935b3025a81dc16d7f1c140eb5f5e0988e56df9eeb80092bc4"}
Jul 02 23:10:47.529394 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.529358    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:10:47.529954 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.529399    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:10:47.529954 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.529363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:10:47.532830 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.532796    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:10:47.534219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.534194    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:10:47.534315 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.534231    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp9kj\""
Jul 02 23:10:47.534372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.534327    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:10:47.534372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.534339    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:10:47.534372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.534356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flmt2\""
Jul 02 23:10:47.705174 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:47.705140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:47.705377 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:47.705280    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:47.705440 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:47.705375    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:10:49.705352921 +0000 UTC m=+37.689421264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:48.709331 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.709291    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"]
Jul 02 23:10:48.732497 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.732463    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:48.735950 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.735924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"]
Jul 02 23:10:48.739578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.739540    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"]
Jul 02 23:10:48.744446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.744274    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:48.744446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.744287    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:48.744446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.744334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 23:10:48.744446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.744364    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c2znl\""
Jul 02 23:10:48.758549 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.758518    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"
Jul 02 23:10:48.761820 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.761797    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kssbx\""
Jul 02 23:10:48.782970 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.782938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"]
Jul 02 23:10:48.828536 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.828099    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:10:48.840705 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.840673    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7jqsn"]
Jul 02 23:10:48.840872 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.840791    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:48.844520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.844489    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 23:10:48.844645 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.844632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4dq8g\""
Jul 02 23:10:48.845011 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.844994    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 23:10:48.845437 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.845419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 23:10:48.851288 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.851267    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 23:10:48.861505 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.861472    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:10:48.861655 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.861522    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7jqsn"]
Jul 02 23:10:48.861655 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.861612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:48.877189 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.877122    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 23:10:48.877189 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.877122    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:48.877404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.877278    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fnzvh\""
Jul 02 23:10:48.877511 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.877490    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:48.877618 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.877527    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 23:10:48.881514 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.881496    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 23:10:48.914606 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.914566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:48.914794 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.914613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdggm\" (UniqueName: \"kubernetes.io/projected/eb2d4188-2a11-4504-871b-540e48059965-kube-api-access-wdggm\") pod \"network-check-source-989f8b8dc-978lh\" (UID: \"eb2d4188-2a11-4504-871b-540e48059965\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"
Jul 02 23:10:48.914794 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.914719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvqr\" (UniqueName: \"kubernetes.io/projected/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-kube-api-access-wmvqr\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:48.926286 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.926249    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"]
Jul 02 23:10:48.949157 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.949119    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tb462"]
Jul 02 23:10:48.949336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.949261    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:48.952560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.952528    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 23:10:48.952938 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.952912    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rm8ww\""
Jul 02 23:10:48.953087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.953038    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 23:10:48.971375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.971304    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"]
Jul 02 23:10:48.971375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.971345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tb462"]
Jul 02 23:10:48.971547 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.971429    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:48.974241 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.974215    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 23:10:48.974375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.974219    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 23:10:48.974561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.974545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:10:48.974808 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.974795    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:10:48.974864 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.974812    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rhsfv\""
Jul 02 23:10:48.981829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:48.981808    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 23:10:49.015131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/856cca8d-8432-428a-80d2-5f79a4e3bfb7-serving-cert\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.015131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98m78\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvqr\" (UniqueName: \"kubernetes.io/projected/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-kube-api-access-wmvqr\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-config\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9npl8\" (UniqueName: \"kubernetes.io/projected/856cca8d-8432-428a-80d2-5f79a4e3bfb7-kube-api-access-9npl8\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-trusted-ca\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:49.015535 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.015535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdggm\" (UniqueName: \"kubernetes.io/projected/eb2d4188-2a11-4504-871b-540e48059965-kube-api-access-wdggm\") pod \"network-check-source-989f8b8dc-978lh\" (UID: \"eb2d4188-2a11-4504-871b-540e48059965\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"
Jul 02 23:10:49.015728 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.015633    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:10:49.015728 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.015690    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls podName:26656dea-3eb8-4f8c-9bdb-3fb83acd41f8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:49.515675808 +0000 UTC m=+37.499744146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wdrn2" (UID: "26656dea-3eb8-4f8c-9bdb-3fb83acd41f8") : secret "samples-operator-tls" not found
Jul 02 23:10:49.033901 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.033852    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdggm\" (UniqueName: \"kubernetes.io/projected/eb2d4188-2a11-4504-871b-540e48059965-kube-api-access-wdggm\") pod \"network-check-source-989f8b8dc-978lh\" (UID: \"eb2d4188-2a11-4504-871b-540e48059965\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"
Jul 02 23:10:49.034024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.033939    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvqr\" (UniqueName: \"kubernetes.io/projected/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-kube-api-access-wmvqr\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:49.070248 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.070213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"
Jul 02 23:10:49.116700 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93fa6e10-3c85-42c6-b646-353a7cae8347-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.116700 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.116920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9npl8\" (UniqueName: \"kubernetes.io/projected/856cca8d-8432-428a-80d2-5f79a4e3bfb7-kube-api-access-9npl8\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.116920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqlc\" (UniqueName: \"kubernetes.io/projected/94bbf191-9ad4-470e-b37d-ce062fcffbfc-kube-api-access-8tqlc\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.116920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.116920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-config\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.116920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/856cca8d-8432-428a-80d2-5f79a4e3bfb7-serving-cert\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-snapshots\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.116983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-trusted-ca\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.117112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94bbf191-9ad4-470e-b37d-ce062fcffbfc-serving-cert\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98m78\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.117225    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.117239    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74579dc9df-zz57c: secret "image-registry-tls" not found
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-tmp\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.117274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.117360 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.117290    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls podName:90ff175e-a136-4ddb-a530-5cc925267a51 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:49.617272738 +0000 UTC m=+37.601341090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls") pod "image-registry-74579dc9df-zz57c" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51") : secret "image-registry-tls" not found
Jul 02 23:10:49.118294 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118166    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.118294 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118218    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-config\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.118490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118318    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.118490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/856cca8d-8432-428a-80d2-5f79a4e3bfb7-trusted-ca\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.118490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.118490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.118435    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.120342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.120284    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/856cca8d-8432-428a-80d2-5f79a4e3bfb7-serving-cert\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.120590 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.120566    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.120789 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.120771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.127528 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.127466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98m78\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.127836 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.127792    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9npl8\" (UniqueName: \"kubernetes.io/projected/856cca8d-8432-428a-80d2-5f79a4e3bfb7-kube-api-access-9npl8\") pod \"console-operator-68b757fb67-7jqsn\" (UID: \"856cca8d-8432-428a-80d2-5f79a4e3bfb7\") " pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.128032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.127845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.171828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.171790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:49.219492 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-tmp\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.219492 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219500    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.219725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93fa6e10-3c85-42c6-b646-353a7cae8347-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.219725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.219725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqlc\" (UniqueName: \"kubernetes.io/projected/94bbf191-9ad4-470e-b37d-ce062fcffbfc-kube-api-access-8tqlc\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.219725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-snapshots\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.219940 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.219940 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.219810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94bbf191-9ad4-470e-b37d-ce062fcffbfc-serving-cert\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.220035 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.220004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-tmp\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.220321 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.220293    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:10:49.220428 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.220383    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:49.720362157 +0000 UTC m=+37.704430495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:10:49.220509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.220422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/93fa6e10-3c85-42c6-b646-353a7cae8347-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.220626 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.220604    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94bbf191-9ad4-470e-b37d-ce062fcffbfc-snapshots\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.221084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.221058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.222732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.222679    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94bbf191-9ad4-470e-b37d-ce062fcffbfc-serving-cert\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.228758 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.228738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bbf191-9ad4-470e-b37d-ce062fcffbfc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.231558 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.231535    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqlc\" (UniqueName: \"kubernetes.io/projected/94bbf191-9ad4-470e-b37d-ce062fcffbfc-kube-api-access-8tqlc\") pod \"insights-operator-5c847dcfc4-tb462\" (UID: \"94bbf191-9ad4-470e-b37d-ce062fcffbfc\") " pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.280404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.280366    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-tb462"
Jul 02 23:10:49.522925 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.522814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:49.523105 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.523003    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:10:49.523105 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.523081    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls podName:26656dea-3eb8-4f8c-9bdb-3fb83acd41f8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:50.523060229 +0000 UTC m=+38.507128573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wdrn2" (UID: "26656dea-3eb8-4f8c-9bdb-3fb83acd41f8") : secret "samples-operator-tls" not found
Jul 02 23:10:49.624205 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.624164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:49.624374 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.624342    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:10:49.624374 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.624364    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74579dc9df-zz57c: secret "image-registry-tls" not found
Jul 02 23:10:49.624483 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.624439    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls podName:90ff175e-a136-4ddb-a530-5cc925267a51 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:50.624414637 +0000 UTC m=+38.608482989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls") pod "image-registry-74579dc9df-zz57c" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51") : secret "image-registry-tls" not found
Jul 02 23:10:49.725026 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.724986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:49.725470 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:49.725130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:49.725470 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.725164    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:10:49.725470 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.725250    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:49.725470 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.725253    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:50.725232773 +0000 UTC m=+38.709301117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:10:49.725470 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:49.725309    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:10:53.725295171 +0000 UTC m=+41.709363514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:50.413287 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.413056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-978lh"]
Jul 02 23:10:50.416195 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:50.416165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2d4188_2a11_4504_871b_540e48059965.slice/crio-44b0e1e69d2785051ce1b111747629a91072ee9bdc81c0c105e0eb19dd4df28d WatchSource:0}: Error finding container 44b0e1e69d2785051ce1b111747629a91072ee9bdc81c0c105e0eb19dd4df28d: Status 404 returned error can't find the container with id 44b0e1e69d2785051ce1b111747629a91072ee9bdc81c0c105e0eb19dd4df28d
Jul 02 23:10:50.437539 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.437509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tb462"]
Jul 02 23:10:50.439330 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.439308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7jqsn"]
Jul 02 23:10:50.440760 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:50.440736    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bbf191_9ad4_470e_b37d_ce062fcffbfc.slice/crio-861e110abedcd3d7822b9e8001cb58b0c17285a78d8e4c3fa765bfbb20e37fcf WatchSource:0}: Error finding container 861e110abedcd3d7822b9e8001cb58b0c17285a78d8e4c3fa765bfbb20e37fcf: Status 404 returned error can't find the container with id 861e110abedcd3d7822b9e8001cb58b0c17285a78d8e4c3fa765bfbb20e37fcf
Jul 02 23:10:50.441308 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:10:50.441285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856cca8d_8432_428a_80d2_5f79a4e3bfb7.slice/crio-9a847a9058a057195cd198c8fb9fe09d0e8fdb33503696a7fb50d62fe68ff87e WatchSource:0}: Error finding container 9a847a9058a057195cd198c8fb9fe09d0e8fdb33503696a7fb50d62fe68ff87e: Status 404 returned error can't find the container with id 9a847a9058a057195cd198c8fb9fe09d0e8fdb33503696a7fb50d62fe68ff87e
Jul 02 23:10:50.536071 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.536029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:50.536236 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.536213    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:10:50.536317 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.536305    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls podName:26656dea-3eb8-4f8c-9bdb-3fb83acd41f8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:52.53628201 +0000 UTC m=+40.520350373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wdrn2" (UID: "26656dea-3eb8-4f8c-9bdb-3fb83acd41f8") : secret "samples-operator-tls" not found
Jul 02 23:10:50.637168 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.637135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:50.637310 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.637291    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:10:50.637344 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.637310    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74579dc9df-zz57c: secret "image-registry-tls" not found
Jul 02 23:10:50.637396 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.637379    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls podName:90ff175e-a136-4ddb-a530-5cc925267a51 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:52.637363188 +0000 UTC m=+40.621431531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls") pod "image-registry-74579dc9df-zz57c" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51") : secret "image-registry-tls" not found
Jul 02 23:10:50.737619 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.737533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:50.738215 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.737673    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:10:50.738215 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:50.737742    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:52.73772654 +0000 UTC m=+40.721794878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:10:50.817488 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.817449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgr7p" event={"ID":"62277ec7-af6d-4cc6-bd68-1923a99a3984","Type":"ContainerStarted","Data":"e7fd600f3059406db21c31e1e74c512eadfd4eab7e781fad727f07ae15e4d26e"}
Jul 02 23:10:50.818646 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.818623    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tb462" event={"ID":"94bbf191-9ad4-470e-b37d-ce062fcffbfc","Type":"ContainerStarted","Data":"861e110abedcd3d7822b9e8001cb58b0c17285a78d8e4c3fa765bfbb20e37fcf"}
Jul 02 23:10:50.819750 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.819731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" event={"ID":"856cca8d-8432-428a-80d2-5f79a4e3bfb7","Type":"ContainerStarted","Data":"9a847a9058a057195cd198c8fb9fe09d0e8fdb33503696a7fb50d62fe68ff87e"}
Jul 02 23:10:50.822385 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.822351    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="77406907fa03bc5012a0fe15675002ec64e1b67c11b2e3afca9092915d2c6482" exitCode=0
Jul 02 23:10:50.822487 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.822414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"77406907fa03bc5012a0fe15675002ec64e1b67c11b2e3afca9092915d2c6482"}
Jul 02 23:10:50.823668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.823644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh" event={"ID":"eb2d4188-2a11-4504-871b-540e48059965","Type":"ContainerStarted","Data":"44b0e1e69d2785051ce1b111747629a91072ee9bdc81c0c105e0eb19dd4df28d"}
Jul 02 23:10:50.837961 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:50.837910    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pgr7p" podStartSLOduration=2.063665592 podStartE2EDuration="5.837896775s" totalImagesPullingTime="3.774231183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:50.836474746 +0000 UTC m=+38.820543106" watchObservedRunningTime="2026-07-02 23:10:50.837896775 +0000 UTC m=+38.821965125"
Jul 02 23:10:51.828762 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:51.828731    2573 generic.go:356] "Generic (PLEG): container finished" podID="656ca62d-f422-4a93-a688-16fc089444ee" containerID="e93a0a2a67280f386f143f2fd598b181bef1e8a3323abbabe4e2b83f4fa10bb6" exitCode=0
Jul 02 23:10:51.829410 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:51.828810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerDied","Data":"e93a0a2a67280f386f143f2fd598b181bef1e8a3323abbabe4e2b83f4fa10bb6"}
Jul 02 23:10:52.552365 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:52.552086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:52.552560 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.552286    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:10:52.552641 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.552618    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls podName:26656dea-3eb8-4f8c-9bdb-3fb83acd41f8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.552595325 +0000 UTC m=+44.536663682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wdrn2" (UID: "26656dea-3eb8-4f8c-9bdb-3fb83acd41f8") : secret "samples-operator-tls" not found
Jul 02 23:10:52.653158 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:52.653118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:52.653346 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.653258    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:10:52.653346 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.653284    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74579dc9df-zz57c: secret "image-registry-tls" not found
Jul 02 23:10:52.653455 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.653360    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls podName:90ff175e-a136-4ddb-a530-5cc925267a51 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.65333889 +0000 UTC m=+44.637407242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls") pod "image-registry-74579dc9df-zz57c" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51") : secret "image-registry-tls" not found
Jul 02 23:10:52.754118 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:52.754079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:52.754295 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.754274    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:10:52.754366 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:52.754356    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.7543383 +0000 UTC m=+44.738406641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:10:52.836281 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:52.836205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" event={"ID":"656ca62d-f422-4a93-a688-16fc089444ee","Type":"ContainerStarted","Data":"453e5c6e933a613fe88cc8ccd07ff988b00e374e244dcf9ca0fd419d01a0f3d6"}
Jul 02 23:10:52.871848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:52.871789    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lg4ts" podStartSLOduration=11.928598513 podStartE2EDuration="39.871771225s" totalImagesPullingTime="27.943172712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:52.869935174 +0000 UTC m=+40.854003560" watchObservedRunningTime="2026-07-02 23:10:52.871771225 +0000 UTC m=+40.855839606"
Jul 02 23:10:53.761871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:53.761828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:10:53.762097 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:53.762012    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:53.762097 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:53.762093    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:11:01.762072967 +0000 UTC m=+49.746141322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:55.844583 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.844547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tb462" event={"ID":"94bbf191-9ad4-470e-b37d-ce062fcffbfc","Type":"ContainerStarted","Data":"5bcda3e2d7b10532f0032a3d1276e05b8fef174c0f87d2ca2aa3f8f0aaa275f2"}
Jul 02 23:10:55.846398 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.846375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/0.log"
Jul 02 23:10:55.846519 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.846412    2573 generic.go:356] "Generic (PLEG): container finished" podID="856cca8d-8432-428a-80d2-5f79a4e3bfb7" containerID="27869b5645f976b41d33327546d21afffa044d05a4d270394c74c6a546582e9f" exitCode=255
Jul 02 23:10:55.846519 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.846445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" event={"ID":"856cca8d-8432-428a-80d2-5f79a4e3bfb7","Type":"ContainerDied","Data":"27869b5645f976b41d33327546d21afffa044d05a4d270394c74c6a546582e9f"}
Jul 02 23:10:55.846724 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.846706    2573 scope.go:117] "RemoveContainer" containerID="27869b5645f976b41d33327546d21afffa044d05a4d270394c74c6a546582e9f"
Jul 02 23:10:55.848183 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.848162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh" event={"ID":"eb2d4188-2a11-4504-871b-540e48059965","Type":"ContainerStarted","Data":"31e3a89e0a040301705214bae07c843c8fbe748fceaef3a5ecef5d3924ea1883"}
Jul 02 23:10:55.862446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.862400    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-tb462" podStartSLOduration=3.3811536110000002 podStartE2EDuration="7.862382745s" totalImagesPullingTime="4.481229134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:55.860627884 +0000 UTC m=+43.844696245" watchObservedRunningTime="2026-07-02 23:10:55.862382745 +0000 UTC m=+43.846451135"
Jul 02 23:10:55.875581 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:55.875523    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-978lh" podStartSLOduration=3.360456738 podStartE2EDuration="7.87550569s" totalImagesPullingTime="4.515048952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:55.874999359 +0000 UTC m=+43.859067720" watchObservedRunningTime="2026-07-02 23:10:55.87550569 +0000 UTC m=+43.859574046"
Jul 02 23:10:56.325284 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.325245    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x6drk"]
Jul 02 23:10:56.340134 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.340104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.347447 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.347426    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:10:56.348130 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.348113    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgtgg\""
Jul 02 23:10:56.348215 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.348140    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:10:56.362695 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.362662    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6drk"]
Jul 02 23:10:56.385034 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.384994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.385192 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.385050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/232b25fb-bcb6-48d4-83dc-504abbd8196e-data-volume\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.385192 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.385133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.385192 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.385173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/232b25fb-bcb6-48d4-83dc-504abbd8196e-crio-socket\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.385351 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.385307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l995\" (UniqueName: \"kubernetes.io/projected/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-api-access-8l995\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486239 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/232b25fb-bcb6-48d4-83dc-504abbd8196e-data-volume\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486432 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486432 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.486318    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.486432 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.486385    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.986365119 +0000 UTC m=+44.970433457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.486599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/232b25fb-bcb6-48d4-83dc-504abbd8196e-crio-socket\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l995\" (UniqueName: \"kubernetes.io/projected/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-api-access-8l995\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486714 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486599    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/232b25fb-bcb6-48d4-83dc-504abbd8196e-data-volume\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486714 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.486635    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/232b25fb-bcb6-48d4-83dc-504abbd8196e-crio-socket\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.486714 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.486673    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.486804 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.486734    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.986719585 +0000 UTC m=+44.970787925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.497181 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.497145    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l995\" (UniqueName: \"kubernetes.io/projected/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-api-access-8l995\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.587946 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.587836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:10:56.588152 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.588008    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:10:56.588152 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.588078    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls podName:26656dea-3eb8-4f8c-9bdb-3fb83acd41f8 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.588062426 +0000 UTC m=+52.572130764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wdrn2" (UID: "26656dea-3eb8-4f8c-9bdb-3fb83acd41f8") : secret "samples-operator-tls" not found
Jul 02 23:10:56.688932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.688901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:10:56.689098 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.689044    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:10:56.689098 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.689061    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74579dc9df-zz57c: secret "image-registry-tls" not found
Jul 02 23:10:56.689163 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.689118    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls podName:90ff175e-a136-4ddb-a530-5cc925267a51 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.68910048 +0000 UTC m=+52.673168830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls") pod "image-registry-74579dc9df-zz57c" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51") : secret "image-registry-tls" not found
Jul 02 23:10:56.789936 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.789862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:10:56.790112 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.789997    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:10:56.790112 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.790072    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.790053237 +0000 UTC m=+52.774121593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:10:56.852391 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.852315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:10:56.852752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.852682    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/0.log"
Jul 02 23:10:56.852752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.852713    2573 generic.go:356] "Generic (PLEG): container finished" podID="856cca8d-8432-428a-80d2-5f79a4e3bfb7" containerID="c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52" exitCode=255
Jul 02 23:10:56.852832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.852806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" event={"ID":"856cca8d-8432-428a-80d2-5f79a4e3bfb7","Type":"ContainerDied","Data":"c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52"}
Jul 02 23:10:56.852877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.852866    2573 scope.go:117] "RemoveContainer" containerID="27869b5645f976b41d33327546d21afffa044d05a4d270394c74c6a546582e9f"
Jul 02 23:10:56.853095 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.853073    2573 scope.go:117] "RemoveContainer" containerID="c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52"
Jul 02 23:10:56.853302 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.853277    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7jqsn_openshift-console-operator(856cca8d-8432-428a-80d2-5f79a4e3bfb7)\"" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" podUID="856cca8d-8432-428a-80d2-5f79a4e3bfb7"
Jul 02 23:10:56.992912 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.992837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.993126 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:56.992942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:56.993126 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.993016    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.993126 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.993056    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.993126 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.993115    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.993093676 +0000 UTC m=+45.977162021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.993126 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:56.993129    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.993123124 +0000 UTC m=+45.977191462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:57.857320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:57.857293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:10:57.857691 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:57.857615    2573 scope.go:117] "RemoveContainer" containerID="c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52"
Jul 02 23:10:57.857783 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:57.857764    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7jqsn_openshift-console-operator(856cca8d-8432-428a-80d2-5f79a4e3bfb7)\"" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" podUID="856cca8d-8432-428a-80d2-5f79a4e3bfb7"
Jul 02 23:10:58.002547 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:58.002498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:58.002547 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:58.002544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:10:58.002775 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:58.002672    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:58.002775 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:58.002756    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:58.002849 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:58.002758    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:00.002736452 +0000 UTC m=+47.986804790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:58.002849 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:58.002835    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:00.002824403 +0000 UTC m=+47.986892741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:58.886801 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:58.886776    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9s79s_ba0af08b-e746-4406-b9c7-82d95e148d7f/dns-node-resolver/0.log"
Jul 02 23:10:59.173005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:59.172904    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:59.173005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:59.172976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:10:59.173312 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:59.173300    2573 scope.go:117] "RemoveContainer" containerID="c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52"
Jul 02 23:10:59.173496 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:10:59.173477    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7jqsn_openshift-console-operator(856cca8d-8432-428a-80d2-5f79a4e3bfb7)\"" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" podUID="856cca8d-8432-428a-80d2-5f79a4e3bfb7"
Jul 02 23:10:59.886119 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:10:59.886086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9k7w2_2c3a5902-591b-46e5-bb6f-4742af23c689/node-ca/0.log"
Jul 02 23:11:00.020234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:00.020183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:00.020654 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:00.020253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:00.020654 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:00.020351    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:00.020654 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:00.020415    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.02040132 +0000 UTC m=+52.004469663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:00.020654 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:00.020351    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:00.020654 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:00.020482    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.020471379 +0000 UTC m=+52.004539730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:00.687234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:00.687198    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgr7p_62277ec7-af6d-4cc6-bd68-1923a99a3984/serve-healthcheck-canary/0.log"
Jul 02 23:11:01.837946 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:01.837904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:01.838355 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:01.837988    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:01.838355 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:01.838051    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls podName:dd10af0f-6cf4-4a44-81fd-0663aedfa57a nodeName:}" failed. No retries permitted until 2026-07-02 23:11:17.838034888 +0000 UTC m=+65.822103227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls") pod "dns-default-d5tkh" (UID: "dd10af0f-6cf4-4a44-81fd-0663aedfa57a") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:04.059541 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.059487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:04.059976 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.059558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:04.059976 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.059630    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:04.059976 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.059650    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:04.059976 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.059699    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.059682344 +0000 UTC m=+60.043750683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:04.059976 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.059715    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls podName:232b25fb-bcb6-48d4-83dc-504abbd8196e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.059708712 +0000 UTC m=+60.043777050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6drk" (UID: "232b25fb-bcb6-48d4-83dc-504abbd8196e") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:04.665116 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.665073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:11:04.667786 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.667751    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26656dea-3eb8-4f8c-9bdb-3fb83acd41f8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wdrn2\" (UID: \"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:11:04.766366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.766317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:04.768691 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.768668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"image-registry-74579dc9df-zz57c\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") " pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:04.867336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.867297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:11:04.867543 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.867469    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:04.867607 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:04.867570    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert podName:93fa6e10-3c85-42c6-b646-353a7cae8347 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:20.867547513 +0000 UTC m=+68.851615868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k49wk" (UID: "93fa6e10-3c85-42c6-b646-353a7cae8347") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:04.946752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:04.946725    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"
Jul 02 23:11:05.051618 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.051584    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:05.072298 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.072273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2"]
Jul 02 23:11:05.180861 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.180781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:11:05.183225 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:05.183198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ff175e_a136_4ddb_a530_5cc925267a51.slice/crio-ef06b5778b401215a9315c98350d56492d39c3637a275c559e33367ca981c396 WatchSource:0}: Error finding container ef06b5778b401215a9315c98350d56492d39c3637a275c559e33367ca981c396: Status 404 returned error can't find the container with id ef06b5778b401215a9315c98350d56492d39c3637a275c559e33367ca981c396
Jul 02 23:11:05.881357 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.881324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2" event={"ID":"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8","Type":"ContainerStarted","Data":"dc8b51c09ab4a788b448013f9abdd4321741a1b0e8c3eb43ec1b27b2c20e80c1"}
Jul 02 23:11:05.883034 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.883007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" event={"ID":"90ff175e-a136-4ddb-a530-5cc925267a51","Type":"ContainerStarted","Data":"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"}
Jul 02 23:11:05.883176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.883054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" event={"ID":"90ff175e-a136-4ddb-a530-5cc925267a51","Type":"ContainerStarted","Data":"ef06b5778b401215a9315c98350d56492d39c3637a275c559e33367ca981c396"}
Jul 02 23:11:05.883310 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.883287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:05.904222 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:05.904162    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" podStartSLOduration=17.904138392 podStartE2EDuration="17.904138392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:05.903160452 +0000 UTC m=+53.887228826" watchObservedRunningTime="2026-07-02 23:11:05.904138392 +0000 UTC m=+53.888206754"
Jul 02 23:11:07.896030 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:07.895988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2" event={"ID":"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8","Type":"ContainerStarted","Data":"3ae61e406a6b9ffba697d656d017097bc2549a7c6ec2bde30844453739178b9f"}
Jul 02 23:11:07.896438 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:07.896099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2" event={"ID":"26656dea-3eb8-4f8c-9bdb-3fb83acd41f8","Type":"ContainerStarted","Data":"c1ee6e5499c22bc4baa0ff4cbd9b9565641197d15864d8f9b00ea33197373bfe"}
Jul 02 23:11:07.917171 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:07.917116    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wdrn2" podStartSLOduration=18.166299398 podStartE2EDuration="19.917101013s" totalImagesPullingTime="1.750801615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:07.916663368 +0000 UTC m=+55.900731728" watchObservedRunningTime="2026-07-02 23:11:07.917101013 +0000 UTC m=+55.901169373"
Jul 02 23:11:11.529101 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:11.529068    2573 scope.go:117] "RemoveContainer" containerID="c8401ef082867c2030ff2eb5b2df9158a9df0132ae98b9e981c783de23d71b52"
Jul 02 23:11:11.911479 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:11.911402    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:11:11.911620 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:11.911481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" event={"ID":"856cca8d-8432-428a-80d2-5f79a4e3bfb7","Type":"ContainerStarted","Data":"58747376b2add552561b4d5cb2e6cb74b499c8ea3fe7a58bef9007c1ffcce317"}
Jul 02 23:11:11.911771 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:11.911756    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:11:11.930173 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:11.930117    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn" podStartSLOduration=19.449528571 podStartE2EDuration="23.930100477s" totalImagesPullingTime="4.480571906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:11.929635714 +0000 UTC m=+59.913704073" watchObservedRunningTime="2026-07-02 23:11:11.930100477 +0000 UTC m=+59.914168837"
Jul 02 23:11:12.132707 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.132668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:12.132906 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.132720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:12.133360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.133332    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/232b25fb-bcb6-48d4-83dc-504abbd8196e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:12.135161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.135137    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/232b25fb-bcb6-48d4-83dc-504abbd8196e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6drk\" (UID: \"232b25fb-bcb6-48d4-83dc-504abbd8196e\") " pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:12.249356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.249316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6drk"
Jul 02 23:11:12.392759 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.392730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6drk"]
Jul 02 23:11:12.395872 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:12.395844    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232b25fb_bcb6_48d4_83dc_504abbd8196e.slice/crio-bf8d67242ab09d30692ba1426f18cdbb48c8746ad06cf30c4ce91251f27fd717 WatchSource:0}: Error finding container bf8d67242ab09d30692ba1426f18cdbb48c8746ad06cf30c4ce91251f27fd717: Status 404 returned error can't find the container with id bf8d67242ab09d30692ba1426f18cdbb48c8746ad06cf30c4ce91251f27fd717
Jul 02 23:11:12.881497 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.881464    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-7jqsn"
Jul 02 23:11:12.919946 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:12.919903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6drk" event={"ID":"232b25fb-bcb6-48d4-83dc-504abbd8196e","Type":"ContainerStarted","Data":"bf8d67242ab09d30692ba1426f18cdbb48c8746ad06cf30c4ce91251f27fd717"}
Jul 02 23:11:13.815131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:13.815103    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh4wr"
Jul 02 23:11:15.586058 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.586021    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"]
Jul 02 23:11:15.625124 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.625096    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"]
Jul 02 23:11:15.625301 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.625251    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.628660 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.628626    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 23:11:15.628825 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.628801    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:11:15.630186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.630044    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:11:15.630186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.630071    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 23:11:15.630186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.630135    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 23:11:15.630186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.630176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:11:15.630454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.630214    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 23:11:15.652145 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.652115    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:11:15.763743 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.763953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.763953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5w4\" (UniqueName: \"kubernetes.io/projected/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-kube-api-access-2n5w4\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.763953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.763953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.763953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.763946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5w4\" (UniqueName: \"kubernetes.io/projected/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-kube-api-access-2n5w4\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.865518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.865399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.866499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.866436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.868325 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.868300    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.868432 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.868344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-ca\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.868432 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.868356    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.868520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.868481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.875221 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.875194    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5w4\" (UniqueName: \"kubernetes.io/projected/7d4834bc-bf85-4e8a-9195-b08e7e6d84fc-kube-api-access-2n5w4\") pod \"cluster-proxy-proxy-agent-7566cc79b7-ct2dn\" (UID: \"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:15.945006 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:15.944971    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"
Jul 02 23:11:16.695201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:16.695168    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn"]
Jul 02 23:11:16.698568 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:16.698537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d4834bc_bf85_4e8a_9195_b08e7e6d84fc.slice/crio-bf417f0d903d5f999b0cc09145c5bb3b19bfbb9b55a6d98c4cd416482a6a961b WatchSource:0}: Error finding container bf417f0d903d5f999b0cc09145c5bb3b19bfbb9b55a6d98c4cd416482a6a961b: Status 404 returned error can't find the container with id bf417f0d903d5f999b0cc09145c5bb3b19bfbb9b55a6d98c4cd416482a6a961b
Jul 02 23:11:16.938308 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:16.938276    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6drk" event={"ID":"232b25fb-bcb6-48d4-83dc-504abbd8196e","Type":"ContainerStarted","Data":"005eb7c4c7da34ad3b34797fe58c74fdd2a29e42a9783aa1b6c5b9cc6e1f47c3"}
Jul 02 23:11:16.939512 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:16.939473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn" event={"ID":"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc","Type":"ContainerStarted","Data":"bf417f0d903d5f999b0cc09145c5bb3b19bfbb9b55a6d98c4cd416482a6a961b"}
Jul 02 23:11:17.280802 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.280770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:11:17.283848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.283825    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:17.293523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.293498    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef9dea4-06a4-4fd9-9321-ba5296b61b59-metrics-certs\") pod \"network-metrics-daemon-zj9d7\" (UID: \"2ef9dea4-06a4-4fd9-9321-ba5296b61b59\") " pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:11:17.381895 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.381852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:11:17.385228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.385207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:17.394950 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.394923    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e76d6b91-105e-4eb3-9942-40d5e59a2c4f-original-pull-secret\") pod \"global-pull-secret-syncer-hwdkt\" (UID: \"e76d6b91-105e-4eb3-9942-40d5e59a2c4f\") " pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:11:17.483053 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.482972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:11:17.485564 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.485541    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzttz\" (UniqueName: \"kubernetes.io/projected/45bafc54-d8c7-4f45-b075-85853e493b72-kube-api-access-qzttz\") pod \"network-check-target-cskmv\" (UID: \"45bafc54-d8c7-4f45-b075-85853e493b72\") " pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:11:17.542342 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.542305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwdkt"
Jul 02 23:11:17.553269 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.553244    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp9kj\""
Jul 02 23:11:17.560040 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.560019    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flmt2\""
Jul 02 23:11:17.561043 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.561024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:11:17.567531 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.567510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zj9d7"
Jul 02 23:11:17.736218 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.736135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cskmv"]
Jul 02 23:11:17.741369 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:17.741337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bafc54_d8c7_4f45_b075_85853e493b72.slice/crio-ce07b64ba1c152541341120c7e4b5a31c2f8608a1c78254cba6eb26acf9d9c98 WatchSource:0}: Error finding container ce07b64ba1c152541341120c7e4b5a31c2f8608a1c78254cba6eb26acf9d9c98: Status 404 returned error can't find the container with id ce07b64ba1c152541341120c7e4b5a31c2f8608a1c78254cba6eb26acf9d9c98
Jul 02 23:11:17.741976 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.741952    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwdkt"]
Jul 02 23:11:17.745248 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:17.745227    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76d6b91_105e_4eb3_9942_40d5e59a2c4f.slice/crio-149ab686aafc932c568bdbf35094fbdd3d44037c7e4a19659d50ff56230e1ebd WatchSource:0}: Error finding container 149ab686aafc932c568bdbf35094fbdd3d44037c7e4a19659d50ff56230e1ebd: Status 404 returned error can't find the container with id 149ab686aafc932c568bdbf35094fbdd3d44037c7e4a19659d50ff56230e1ebd
Jul 02 23:11:17.759379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.759302    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zj9d7"]
Jul 02 23:11:17.763051 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:17.763010    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef9dea4_06a4_4fd9_9321_ba5296b61b59.slice/crio-be15ba968c7b46604c75f0013f9cb529091b3e3ecf291fb00b42f318e09088e4 WatchSource:0}: Error finding container be15ba968c7b46604c75f0013f9cb529091b3e3ecf291fb00b42f318e09088e4: Status 404 returned error can't find the container with id be15ba968c7b46604c75f0013f9cb529091b3e3ecf291fb00b42f318e09088e4
Jul 02 23:11:17.887693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.887655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:17.893136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.891155    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd10af0f-6cf4-4a44-81fd-0663aedfa57a-metrics-tls\") pod \"dns-default-d5tkh\" (UID: \"dd10af0f-6cf4-4a44-81fd-0663aedfa57a\") " pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:17.946443 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.946397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zj9d7" event={"ID":"2ef9dea4-06a4-4fd9-9321-ba5296b61b59","Type":"ContainerStarted","Data":"be15ba968c7b46604c75f0013f9cb529091b3e3ecf291fb00b42f318e09088e4"}
Jul 02 23:11:17.948151 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.948063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwdkt" event={"ID":"e76d6b91-105e-4eb3-9942-40d5e59a2c4f","Type":"ContainerStarted","Data":"149ab686aafc932c568bdbf35094fbdd3d44037c7e4a19659d50ff56230e1ebd"}
Jul 02 23:11:17.951146 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.950765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cskmv" event={"ID":"45bafc54-d8c7-4f45-b075-85853e493b72","Type":"ContainerStarted","Data":"852e717d3f5390a0288c7bbd1bf23d8e3e751da37fa675081e6264eb5ac8def9"}
Jul 02 23:11:17.951146 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.950812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cskmv" event={"ID":"45bafc54-d8c7-4f45-b075-85853e493b72","Type":"ContainerStarted","Data":"ce07b64ba1c152541341120c7e4b5a31c2f8608a1c78254cba6eb26acf9d9c98"}
Jul 02 23:11:17.951652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.951594    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:11:17.954398 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.954340    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6drk" event={"ID":"232b25fb-bcb6-48d4-83dc-504abbd8196e","Type":"ContainerStarted","Data":"3bff1752593afb7cf66c54405ab14860e87bf9528cab56f9d3a5fc2511ab5710"}
Jul 02 23:11:17.987711 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:17.987577    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cskmv" podStartSLOduration=64.98755301 podStartE2EDuration="1m4.98755301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:17.986943445 +0000 UTC m=+65.971011807" watchObservedRunningTime="2026-07-02 23:11:17.98755301 +0000 UTC m=+65.971621370"
Jul 02 23:11:18.032981 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:18.032949    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bnq4k\""
Jul 02 23:11:18.040611 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:18.040579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:18.212962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:18.212853    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5tkh"]
Jul 02 23:11:18.222948 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:18.222901    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd10af0f_6cf4_4a44_81fd_0663aedfa57a.slice/crio-93850bd2ecb0524a210075fa532ddf318bad47857292f5c497265fdea29b9306 WatchSource:0}: Error finding container 93850bd2ecb0524a210075fa532ddf318bad47857292f5c497265fdea29b9306: Status 404 returned error can't find the container with id 93850bd2ecb0524a210075fa532ddf318bad47857292f5c497265fdea29b9306
Jul 02 23:11:18.979394 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:18.979356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5tkh" event={"ID":"dd10af0f-6cf4-4a44-81fd-0663aedfa57a","Type":"ContainerStarted","Data":"93850bd2ecb0524a210075fa532ddf318bad47857292f5c497265fdea29b9306"}
Jul 02 23:11:20.915183 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:20.915139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:11:20.917940 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:20.917911    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93fa6e10-3c85-42c6-b646-353a7cae8347-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k49wk\" (UID: \"93fa6e10-3c85-42c6-b646-353a7cae8347\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:11:21.063734 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:21.063695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rm8ww\""
Jul 02 23:11:21.071306 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:21.071274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"
Jul 02 23:11:25.320057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:25.319959    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k49wk"]
Jul 02 23:11:25.497451 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:25.497325    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93fa6e10_3c85_42c6_b646_353a7cae8347.slice/crio-dad47c7b6c434c49ac862ec0f2fda9ea847c0f11989d388c86a71b17c2327fb0 WatchSource:0}: Error finding container dad47c7b6c434c49ac862ec0f2fda9ea847c0f11989d388c86a71b17c2327fb0: Status 404 returned error can't find the container with id dad47c7b6c434c49ac862ec0f2fda9ea847c0f11989d388c86a71b17c2327fb0
Jul 02 23:11:25.660744 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:25.660711    2573 patch_prober.go:28] interesting pod/image-registry-74579dc9df-zz57c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 23:11:25.660929 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:25.660770    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:11:26.007829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.007586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5tkh" event={"ID":"dd10af0f-6cf4-4a44-81fd-0663aedfa57a","Type":"ContainerStarted","Data":"4c794ea5b083b1dbc13af4fea6054d8646c5be3bb1f0f8a07c062a0f12646630"}
Jul 02 23:11:26.007829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.007683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5tkh" event={"ID":"dd10af0f-6cf4-4a44-81fd-0663aedfa57a","Type":"ContainerStarted","Data":"5ee458532a7a89a3bc359e11762ef6a89d29e34c74e7056fe0845adabe4b279a"}
Jul 02 23:11:26.007829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.007713    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:26.009197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.009168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk" event={"ID":"93fa6e10-3c85-42c6-b646-353a7cae8347","Type":"ContainerStarted","Data":"dad47c7b6c434c49ac862ec0f2fda9ea847c0f11989d388c86a71b17c2327fb0"}
Jul 02 23:11:26.011313 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.011282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6drk" event={"ID":"232b25fb-bcb6-48d4-83dc-504abbd8196e","Type":"ContainerStarted","Data":"4d08e6ce222c7b8971cb7c792e747b8247c951e3ed06e3a52adf226443f1aadb"}
Jul 02 23:11:26.013692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.013663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn" event={"ID":"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc","Type":"ContainerStarted","Data":"a2ae17b17854c0bb15c745f751ffe5976a36134a747280d07835170e7a7b0e8f"}
Jul 02 23:11:26.013815 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.013705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn" event={"ID":"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc","Type":"ContainerStarted","Data":"f7af4ee64a1eaba8377a10214835e8e15cb263576eb511fbc711c398769c87b8"}
Jul 02 23:11:26.013815 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.013724    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn" event={"ID":"7d4834bc-bf85-4e8a-9195-b08e7e6d84fc","Type":"ContainerStarted","Data":"2db5d636a678184f0bd4c0dd72a63245e35831007a15dd22cd65dee90ccfc702"}
Jul 02 23:11:26.015720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.015691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zj9d7" event={"ID":"2ef9dea4-06a4-4fd9-9321-ba5296b61b59","Type":"ContainerStarted","Data":"a96468658469a068636dad8ea17e4915de4207a290b8402a64a3f41de442aed8"}
Jul 02 23:11:26.015824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.015738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zj9d7" event={"ID":"2ef9dea4-06a4-4fd9-9321-ba5296b61b59","Type":"ContainerStarted","Data":"5a31386e6d67fc4955e84d03604f6b77a9125b72e290d362966eff2d2f429890"}
Jul 02 23:11:26.017095 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.017077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwdkt" event={"ID":"e76d6b91-105e-4eb3-9942-40d5e59a2c4f","Type":"ContainerStarted","Data":"aa12f3ad46b87e3cadce74de9626081d7dca48868403293d6ce395150e7d4338"}
Jul 02 23:11:26.034328 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.034274    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d5tkh" podStartSLOduration=34.085568596 podStartE2EDuration="41.03425425s" totalImagesPullingTime="6.948685654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.033993191 +0000 UTC m=+74.018061552" watchObservedRunningTime="2026-07-02 23:11:26.03425425 +0000 UTC m=+74.018322610"
Jul 02 23:11:26.066574 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.066515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x6drk" podStartSLOduration=17.423687411 podStartE2EDuration="30.06649421s" totalImagesPullingTime="12.642806799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.066241294 +0000 UTC m=+74.050309656" watchObservedRunningTime="2026-07-02 23:11:26.06649421 +0000 UTC m=+74.050562572"
Jul 02 23:11:26.090046 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.089970    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zj9d7" podStartSLOduration=65.684803662 podStartE2EDuration="1m13.089947726s" totalImagesPullingTime="7.405144064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.088701246 +0000 UTC m=+74.072769605" watchObservedRunningTime="2026-07-02 23:11:26.089947726 +0000 UTC m=+74.074016087"
Jul 02 23:11:26.107496 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.107437    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hwdkt" podStartSLOduration=65.332853494 podStartE2EDuration="1m13.107421449s" totalImagesPullingTime="7.774567955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.105566441 +0000 UTC m=+74.089634801" watchObservedRunningTime="2026-07-02 23:11:26.107421449 +0000 UTC m=+74.091489809"
Jul 02 23:11:26.130132 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:26.130077    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7566cc79b7-ct2dn" podStartSLOduration=2.644571595 podStartE2EDuration="11.130060449s" totalImagesPullingTime="8.485488854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.127582326 +0000 UTC m=+74.111650686" watchObservedRunningTime="2026-07-02 23:11:26.130060449 +0000 UTC m=+74.114128808"
Jul 02 23:11:28.025526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:28.025487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk" event={"ID":"93fa6e10-3c85-42c6-b646-353a7cae8347","Type":"ContainerStarted","Data":"7fcf5a8b9c0dedb7c607d3e8fb5dee648efcbd79f2a8f2aa34668bc032620a0b"}
Jul 02 23:11:28.041552 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:28.041492    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k49wk" podStartSLOduration=38.371815985 podStartE2EDuration="40.041472982s" totalImagesPullingTime="1.669656997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:28.04122595 +0000 UTC m=+76.025294310" watchObservedRunningTime="2026-07-02 23:11:28.041472982 +0000 UTC m=+76.025541344"
Jul 02 23:11:35.656711 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:35.656596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:36.023765 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:36.023735    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d5tkh"
Jul 02 23:11:40.672655 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:40.672610    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" containerName="registry" containerID="cri-o://c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3" gracePeriod=30
Jul 02 23:11:40.913197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:40.913166    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:41.071853 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.071818    2573 generic.go:356] "Generic (PLEG): container finished" podID="90ff175e-a136-4ddb-a530-5cc925267a51" containerID="c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3" exitCode=0
Jul 02 23:11:41.072052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.071861    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74579dc9df-zz57c"
Jul 02 23:11:41.072052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.071912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" event={"ID":"90ff175e-a136-4ddb-a530-5cc925267a51","Type":"ContainerDied","Data":"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"}
Jul 02 23:11:41.072052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.071992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74579dc9df-zz57c" event={"ID":"90ff175e-a136-4ddb-a530-5cc925267a51","Type":"ContainerDied","Data":"ef06b5778b401215a9315c98350d56492d39c3637a275c559e33367ca981c396"}
Jul 02 23:11:41.072052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.072014    2573 scope.go:117] "RemoveContainer" containerID="c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"
Jul 02 23:11:41.074218 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074236    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98m78\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074307    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074328    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074466 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074466 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074466 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074435    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca\") pod \"90ff175e-a136-4ddb-a530-5cc925267a51\" (UID: \"90ff175e-a136-4ddb-a530-5cc925267a51\") "
Jul 02 23:11:41.074739 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.074693    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:11:41.075057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.075039    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:11:41.077546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.077364    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:41.077546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.077377    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:11:41.077546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.077470    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:11:41.077546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.077508    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:41.077873 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.077846    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78" (OuterVolumeSpecName: "kube-api-access-98m78") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "kube-api-access-98m78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:41.082460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.082317    2573 scope.go:117] "RemoveContainer" containerID="c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"
Jul 02 23:11:41.082747 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:41.082723    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3\": container with ID starting with c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3 not found: ID does not exist" containerID="c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"
Jul 02 23:11:41.082828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.082757    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3"} err="failed to get container status \"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3\": rpc error: code = NotFound desc = could not find container \"c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3\": container with ID starting with c860c82437403bb0528e182e79bc873be0b5ce9445524cf73d73a695318dbde3 not found: ID does not exist"
Jul 02 23:11:41.085064 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.085041    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "90ff175e-a136-4ddb-a530-5cc925267a51" (UID: "90ff175e-a136-4ddb-a530-5cc925267a51"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:11:41.175199 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175157    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-installation-pull-secrets\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175199 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175191    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-trusted-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175199 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175201    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90ff175e-a136-4ddb-a530-5cc925267a51-ca-trust-extracted\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175199 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175211    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98m78\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-kube-api-access-98m78\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175472 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175220    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90ff175e-a136-4ddb-a530-5cc925267a51-registry-certificates\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175472 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175227    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-bound-sa-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175472 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175235    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90ff175e-a136-4ddb-a530-5cc925267a51-registry-tls\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.175472 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.175244    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90ff175e-a136-4ddb-a530-5cc925267a51-image-registry-private-configuration\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:11:41.394758 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.394723    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:11:41.400972 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:41.400947    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74579dc9df-zz57c"]
Jul 02 23:11:42.533780 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:42.533745    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" path="/var/lib/kubelet/pods/90ff175e-a136-4ddb-a530-5cc925267a51/volumes"
Jul 02 23:11:44.191368 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.191337    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xgbnw"]
Jul 02 23:11:44.191738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.191562    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" containerName="registry"
Jul 02 23:11:44.191738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.191572    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" containerName="registry"
Jul 02 23:11:44.191738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.191622    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ff175e-a136-4ddb-a530-5cc925267a51" containerName="registry"
Jul 02 23:11:44.196567 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.196548    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.199575 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.199546    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:11:44.199799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.199784    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:11:44.200366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.200348    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:11:44.200596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.200576    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:11:44.201073 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.201060    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bdzrc\""
Jul 02 23:11:44.201524 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.201508    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:11:44.203175 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.203158    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:11:44.294651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4h8z\" (UniqueName: \"kubernetes.io/projected/a0ef4b39-9d90-4aae-ad09-3638b9470745-kube-api-access-c4h8z\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-sys\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-accelerators-collector-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-root\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-textfile\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.294855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-metrics-client-ca\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.295100 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.295100 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.294905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-wtmp\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.395960 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.395925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-root\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.395960 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.395962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-textfile\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.395985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-metrics-client-ca\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-wtmp\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4h8z\" (UniqueName: \"kubernetes.io/projected/a0ef4b39-9d90-4aae-ad09-3638b9470745-kube-api-access-c4h8z\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-sys\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396060    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-root\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396129    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-sys\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-accelerators-collector-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396199    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-wtmp\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396566 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:44.396277    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 23:11:44.396566 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:44.396351    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls podName:a0ef4b39-9d90-4aae-ad09-3638b9470745 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:44.896330022 +0000 UTC m=+92.880398360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls") pod "node-exporter-xgbnw" (UID: "a0ef4b39-9d90-4aae-ad09-3638b9470745") : secret "node-exporter-tls" not found
Jul 02 23:11:44.396566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396407    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-textfile\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-accelerators-collector-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.396721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.396668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef4b39-9d90-4aae-ad09-3638b9470745-metrics-client-ca\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.398393 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.398372    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.406990 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.406960    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4h8z\" (UniqueName: \"kubernetes.io/projected/a0ef4b39-9d90-4aae-ad09-3638b9470745-kube-api-access-c4h8z\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.900371 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.900331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:44.902557 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:44.902536    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0ef4b39-9d90-4aae-ad09-3638b9470745-node-exporter-tls\") pod \"node-exporter-xgbnw\" (UID: \"a0ef4b39-9d90-4aae-ad09-3638b9470745\") " pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:45.105955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:45.105918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xgbnw"
Jul 02 23:11:45.117369 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:45.117341    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ef4b39_9d90_4aae_ad09_3638b9470745.slice/crio-28899d08a539d2fa3fbd667d0ccb4f8d16b34a3622ba2464406671e1c1059ceb WatchSource:0}: Error finding container 28899d08a539d2fa3fbd667d0ccb4f8d16b34a3622ba2464406671e1c1059ceb: Status 404 returned error can't find the container with id 28899d08a539d2fa3fbd667d0ccb4f8d16b34a3622ba2464406671e1c1059ceb
Jul 02 23:11:46.091032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.090989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xgbnw" event={"ID":"a0ef4b39-9d90-4aae-ad09-3638b9470745","Type":"ContainerStarted","Data":"28899d08a539d2fa3fbd667d0ccb4f8d16b34a3622ba2464406671e1c1059ceb"}
Jul 02 23:11:46.230061 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.230026    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f54999797-kr4tg"]
Jul 02 23:11:46.233907 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.233864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.237079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237039    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 23:11:46.237195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237052    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 23:11:46.237195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237111    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4ge099knba8uq\""
Jul 02 23:11:46.237195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237128    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 23:11:46.237195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237159    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 23:11:46.237195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 23:11:46.237432 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.237053    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qjwsb\""
Jul 02 23:11:46.243590 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.243569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f54999797-kr4tg"]
Jul 02 23:11:46.309106 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-grpc-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309106 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/745d1524-e3e4-4f1c-9dbc-aafde524418c-metrics-client-ca\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-587j8\" (UniqueName: \"kubernetes.io/projected/745d1524-e3e4-4f1c-9dbc-aafde524418c-kube-api-access-587j8\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309495 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.309495 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.309427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.410799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-587j8\" (UniqueName: \"kubernetes.io/projected/745d1524-e3e4-4f1c-9dbc-aafde524418c-kube-api-access-587j8\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.410799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.410799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-grpc-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/745d1524-e3e4-4f1c-9dbc-aafde524418c-metrics-client-ca\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.410972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.411783 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.411755    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/745d1524-e3e4-4f1c-9dbc-aafde524418c-metrics-client-ca\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.413649 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.413623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.413753 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.413696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-grpc-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.413862 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.413825    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.413996 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.413965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.414040 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.413990    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.414219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.414203    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/745d1524-e3e4-4f1c-9dbc-aafde524418c-secret-thanos-querier-tls\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.419670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.419649    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-587j8\" (UniqueName: \"kubernetes.io/projected/745d1524-e3e4-4f1c-9dbc-aafde524418c-kube-api-access-587j8\") pod \"thanos-querier-f54999797-kr4tg\" (UID: \"745d1524-e3e4-4f1c-9dbc-aafde524418c\") " pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.590950 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.590912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:46.724282 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:46.724233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f54999797-kr4tg"]
Jul 02 23:11:46.727951 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:46.727924    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745d1524_e3e4_4f1c_9dbc_aafde524418c.slice/crio-164132179e35445de86e27928dcfbd93714a31896160fa63eaac1ba476e5368f WatchSource:0}: Error finding container 164132179e35445de86e27928dcfbd93714a31896160fa63eaac1ba476e5368f: Status 404 returned error can't find the container with id 164132179e35445de86e27928dcfbd93714a31896160fa63eaac1ba476e5368f
Jul 02 23:11:47.096370 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:47.096333    2573 generic.go:356] "Generic (PLEG): container finished" podID="a0ef4b39-9d90-4aae-ad09-3638b9470745" containerID="6e201fd5a46d7b748a2a7d9c5c600718e8a5582865e2648f64287fba8a9d11c0" exitCode=0
Jul 02 23:11:47.096799 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:47.096432    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xgbnw" event={"ID":"a0ef4b39-9d90-4aae-ad09-3638b9470745","Type":"ContainerDied","Data":"6e201fd5a46d7b748a2a7d9c5c600718e8a5582865e2648f64287fba8a9d11c0"}
Jul 02 23:11:47.097705 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:47.097677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"164132179e35445de86e27928dcfbd93714a31896160fa63eaac1ba476e5368f"}
Jul 02 23:11:48.108203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.108159    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xgbnw" event={"ID":"a0ef4b39-9d90-4aae-ad09-3638b9470745","Type":"ContainerStarted","Data":"3edd0e011deed48ceb135018b252d8aa0af0f890c2a47829cd8b930d618c94f4"}
Jul 02 23:11:48.108681 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.108270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xgbnw" event={"ID":"a0ef4b39-9d90-4aae-ad09-3638b9470745","Type":"ContainerStarted","Data":"92923a2e7a77e8aaa053b7d0518a1544b8b31a8676853dca410455ed00dd9357"}
Jul 02 23:11:48.138446 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.138393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xgbnw" podStartSLOduration=3.0839613 podStartE2EDuration="4.138374517s" totalImagesPullingTime="988.823275ms" totalInitContainerRuntime="65.589942ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:48.137424901 +0000 UTC m=+96.121493261" watchObservedRunningTime="2026-07-02 23:11:48.138374517 +0000 UTC m=+96.122442878"
Jul 02 23:11:48.435543 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.435511    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68d749d85f-b4khj"]
Jul 02 23:11:48.438879 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.438856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.442270 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.442242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3sptgskp8mseb\""
Jul 02 23:11:48.442382 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.442242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 23:11:48.443117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.443085    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 23:11:48.443583 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.443563    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rrl79\""
Jul 02 23:11:48.443677 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.443586    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 23:11:48.443677 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.443609    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 23:11:48.469497 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.469451    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68d749d85f-b4khj"]
Jul 02 23:11:48.526258 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526216    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-metrics-server-audit-profiles\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526413 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-client-certs\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526413 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5716dca4-9e26-4d85-8f45-57aa1501cd53-audit-log\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526413 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-tls\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-client-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.526560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.526529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tll\" (UniqueName: \"kubernetes.io/projected/5716dca4-9e26-4d85-8f45-57aa1501cd53-kube-api-access-w6tll\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627268 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-client-certs\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5716dca4-9e26-4d85-8f45-57aa1501cd53-audit-log\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-tls\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627634 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627567    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-client-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627634 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tll\" (UniqueName: \"kubernetes.io/projected/5716dca4-9e26-4d85-8f45-57aa1501cd53-kube-api-access-w6tll\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-metrics-server-audit-profiles\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.627788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.627697    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5716dca4-9e26-4d85-8f45-57aa1501cd53-audit-log\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.628309 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.628224    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.628763 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.628718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5716dca4-9e26-4d85-8f45-57aa1501cd53-metrics-server-audit-profiles\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.630803 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.630779    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-client-ca-bundle\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.630933 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.630910    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-client-certs\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.631185 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.631168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5716dca4-9e26-4d85-8f45-57aa1501cd53-secret-metrics-server-tls\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.636963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.636876    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tll\" (UniqueName: \"kubernetes.io/projected/5716dca4-9e26-4d85-8f45-57aa1501cd53-kube-api-access-w6tll\") pod \"metrics-server-68d749d85f-b4khj\" (UID: \"5716dca4-9e26-4d85-8f45-57aa1501cd53\") " pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.748871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.748845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:11:48.895671 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.895640    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"]
Jul 02 23:11:48.898835 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.898815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:48.900143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.900118    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68d749d85f-b4khj"]
Jul 02 23:11:48.901616 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.901583    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-htd54\""
Jul 02 23:11:48.901616 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.901587    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 23:11:48.903089 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:48.903057    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5716dca4_9e26_4d85_8f45_57aa1501cd53.slice/crio-e92c6584ef2e0cc597ecd7db60d8f34960c152a115595957983d1b503e1e4c7f WatchSource:0}: Error finding container e92c6584ef2e0cc597ecd7db60d8f34960c152a115595957983d1b503e1e4c7f: Status 404 returned error can't find the container with id e92c6584ef2e0cc597ecd7db60d8f34960c152a115595957983d1b503e1e4c7f
Jul 02 23:11:48.912145 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.912034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"]
Jul 02 23:11:48.931380 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.931132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:48.931380 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.931207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf89\" (UniqueName: \"kubernetes.io/projected/6fb07652-da2a-4521-9f0e-a97e294e862d-kube-api-access-sqf89\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:48.982043 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:48.981974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cskmv"
Jul 02 23:11:49.031791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.031755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.031959 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.031804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf89\" (UniqueName: \"kubernetes.io/projected/6fb07652-da2a-4521-9f0e-a97e294e862d-kube-api-access-sqf89\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.031959 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:49.031935    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 23:11:49.032085 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:11:49.032015    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert podName:6fb07652-da2a-4521-9f0e-a97e294e862d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:49.531993145 +0000 UTC m=+97.516061504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-kb4pq" (UID: "6fb07652-da2a-4521-9f0e-a97e294e862d") : secret "monitoring-plugin-cert" not found
Jul 02 23:11:49.040911 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.040855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf89\" (UniqueName: \"kubernetes.io/projected/6fb07652-da2a-4521-9f0e-a97e294e862d-kube-api-access-sqf89\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.114611 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.114575    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"ac7918bed8219dab24c4187683a92c0041778f760a38e056fcd13d5e1a70b47a"}
Jul 02 23:11:49.115063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.114666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"d286405c2fa1057162f9c1573b97a3bf66383f4ea0dcbf63f4199fd29f1ac7c0"}
Jul 02 23:11:49.115063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.114698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"39928c5811e24ad3d7b624284b5c51d9d0969a50d547e8173b5d749ce30646db"}
Jul 02 23:11:49.115781 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.115759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj" event={"ID":"5716dca4-9e26-4d85-8f45-57aa1501cd53","Type":"ContainerStarted","Data":"e92c6584ef2e0cc597ecd7db60d8f34960c152a115595957983d1b503e1e4c7f"}
Jul 02 23:11:49.535595 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.535557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.537910 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.537873    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fb07652-da2a-4521-9f0e-a97e294e862d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kb4pq\" (UID: \"6fb07652-da2a-4521-9f0e-a97e294e862d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.808814 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.808699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:49.975912 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:49.975865    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"]
Jul 02 23:11:49.978397 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:11:49.978366    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb07652_da2a_4521_9f0e_a97e294e862d.slice/crio-e4ab9e32f81632577c1bf68fa6898ce5613cf92f997e89de5e8f722700017fb1 WatchSource:0}: Error finding container e4ab9e32f81632577c1bf68fa6898ce5613cf92f997e89de5e8f722700017fb1: Status 404 returned error can't find the container with id e4ab9e32f81632577c1bf68fa6898ce5613cf92f997e89de5e8f722700017fb1
Jul 02 23:11:50.122376 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:50.122284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq" event={"ID":"6fb07652-da2a-4521-9f0e-a97e294e862d","Type":"ContainerStarted","Data":"e4ab9e32f81632577c1bf68fa6898ce5613cf92f997e89de5e8f722700017fb1"}
Jul 02 23:11:51.128396 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:51.128367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"53069ba9a513af4fdc44c2ed062aaa276fcec35690551f9c79791779011096aa"}
Jul 02 23:11:52.134781 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.134743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"a2b3057cb77866da852cd75679f055b208b24c6df0d6a73debef936e1e1cd98b"}
Jul 02 23:11:52.135175 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.134814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" event={"ID":"745d1524-e3e4-4f1c-9dbc-aafde524418c","Type":"ContainerStarted","Data":"147190333ea9a14f9c7bd3b0a9243ae2c93a87aa9fb25a8110200ce1693b5ff5"}
Jul 02 23:11:52.136318 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.136297    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj" event={"ID":"5716dca4-9e26-4d85-8f45-57aa1501cd53","Type":"ContainerStarted","Data":"3e62fd7b173846da749dadc2c3fea0f4bef312a6167fd1e4ef9ee06ce75df66e"}
Jul 02 23:11:52.138879 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.138858    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:52.179772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.179719    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg" podStartSLOduration=2.139982716 podStartE2EDuration="6.179695534s" totalImagesPullingTime="4.039712818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:52.178498549 +0000 UTC m=+100.162566909" watchObservedRunningTime="2026-07-02 23:11:52.179695534 +0000 UTC m=+100.163763895"
Jul 02 23:11:52.216469 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:52.216412    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj" podStartSLOduration=1.371101688 podStartE2EDuration="4.216392714s" totalImagesPullingTime="2.845291026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:52.216292249 +0000 UTC m=+100.200360609" watchObservedRunningTime="2026-07-02 23:11:52.216392714 +0000 UTC m=+100.200461074"
Jul 02 23:11:53.141505 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:53.141450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq" event={"ID":"6fb07652-da2a-4521-9f0e-a97e294e862d","Type":"ContainerStarted","Data":"8d3491163c7ef634efcaa7ebb5f812c05f239999481e9314a1999f5a3c7c71db"}
Jul 02 23:11:53.141973 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:53.141919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:53.146482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:53.146461    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq"
Jul 02 23:11:53.147846 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:53.147825    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f54999797-kr4tg"
Jul 02 23:11:53.159948 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:11:53.159799    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kb4pq" podStartSLOduration=3.022829124 podStartE2EDuration="5.159783411s" totalImagesPullingTime="2.136954287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:53.158541066 +0000 UTC m=+101.142609429" watchObservedRunningTime="2026-07-02 23:11:53.159783411 +0000 UTC m=+101.143851774"
Jul 02 23:12:01.171186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:01.171097    2573 generic.go:356] "Generic (PLEG): container finished" podID="94bbf191-9ad4-470e-b37d-ce062fcffbfc" containerID="5bcda3e2d7b10532f0032a3d1276e05b8fef174c0f87d2ca2aa3f8f0aaa275f2" exitCode=0
Jul 02 23:12:01.171186 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:01.171170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tb462" event={"ID":"94bbf191-9ad4-470e-b37d-ce062fcffbfc","Type":"ContainerDied","Data":"5bcda3e2d7b10532f0032a3d1276e05b8fef174c0f87d2ca2aa3f8f0aaa275f2"}
Jul 02 23:12:01.171609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:01.171536    2573 scope.go:117] "RemoveContainer" containerID="5bcda3e2d7b10532f0032a3d1276e05b8fef174c0f87d2ca2aa3f8f0aaa275f2"
Jul 02 23:12:02.176870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:02.176840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tb462" event={"ID":"94bbf191-9ad4-470e-b37d-ce062fcffbfc","Type":"ContainerStarted","Data":"ad4d186d8696042c2a9a5b031a0bf7be49138ae028bcfe3438d2efca6de76706"}
Jul 02 23:12:08.749073 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:08.749017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:12:08.749493 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:08.749098    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:12:28.755094 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:28.755065    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:12:28.758710 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:12:28.758692    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68d749d85f-b4khj"
Jul 02 23:14:42.974270 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.974178    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"]
Jul 02 23:14:42.977308 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.977285    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:42.980136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.980108    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:14:42.980136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.980128    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 23:14:42.981296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.981280    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f7znn\""
Jul 02 23:14:42.987024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:42.987002    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"]
Jul 02 23:14:43.121264 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.121219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllld\" (UniqueName: \"kubernetes.io/projected/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-kube-api-access-wllld\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.121437 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.121286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.221804 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.221763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wllld\" (UniqueName: \"kubernetes.io/projected/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-kube-api-access-wllld\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.222003 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.221825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.222202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.222187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.230768 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.230696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllld\" (UniqueName: \"kubernetes.io/projected/a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba-kube-api-access-wllld\") pod \"openshift-lws-operator-fd8ccff4c-9krsq\" (UID: \"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.286427 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.286394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"
Jul 02 23:14:43.422416 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.422391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq"]
Jul 02 23:14:43.424565 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:14:43.424540    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda78a20c3_ecbd_4f3a_aa9e_b032ee85ecba.slice/crio-ce470da16edf6e46dc0ae8c4b0672a16b97ee9808e1eea9fe6a52e156df8c185 WatchSource:0}: Error finding container ce470da16edf6e46dc0ae8c4b0672a16b97ee9808e1eea9fe6a52e156df8c185: Status 404 returned error can't find the container with id ce470da16edf6e46dc0ae8c4b0672a16b97ee9808e1eea9fe6a52e156df8c185
Jul 02 23:14:43.760098 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:43.760062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq" event={"ID":"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba","Type":"ContainerStarted","Data":"ce470da16edf6e46dc0ae8c4b0672a16b97ee9808e1eea9fe6a52e156df8c185"}
Jul 02 23:14:48.782269 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:48.782229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq" event={"ID":"a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba","Type":"ContainerStarted","Data":"28d4b61c4678251c36a40782cd1809521f95c783304bf1742b088cd97ec72455"}
Jul 02 23:14:48.814577 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:14:48.814515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9krsq" podStartSLOduration=2.324298892 podStartE2EDuration="6.814494964s" totalImagesPullingTime="4.490196072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:48.814110189 +0000 UTC m=+276.798178574" watchObservedRunningTime="2026-07-02 23:14:48.814494964 +0000 UTC m=+276.798563325"
Jul 02 23:15:05.486815 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.486775    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"]
Jul 02 23:15:05.490556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.490533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.493412 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.493384    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:15:05.493537 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.493445    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n47wn\""
Jul 02 23:15:05.493706 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.493687    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:15:05.493900 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.493867    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:15:05.494025 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.494011    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:15:05.514068 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.514044    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"]
Jul 02 23:15:05.598524 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.598481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.598524 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.598521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2565m\" (UniqueName: \"kubernetes.io/projected/2eb311b8-1629-4877-821a-d975bd40956f-kube-api-access-2565m\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.598788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.598543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.598788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.598630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.598788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.598667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.699756 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.699715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.699756 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.699754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2565m\" (UniqueName: \"kubernetes.io/projected/2eb311b8-1629-4877-821a-d975bd40956f-kube-api-access-2565m\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.700025 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.699776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.700025 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.699844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.700025 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.699869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.700333 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.700305    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.702173 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.702141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb311b8-1629-4877-821a-d975bd40956f-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.702276 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.702197    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.702334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.702270    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2eb311b8-1629-4877-821a-d975bd40956f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.743977 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.743855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2565m\" (UniqueName: \"kubernetes.io/projected/2eb311b8-1629-4877-821a-d975bd40956f-kube-api-access-2565m\") pod \"opendatahub-operator-controller-manager-79946c878f-rf6rw\" (UID: \"2eb311b8-1629-4877-821a-d975bd40956f\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.800832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.800791    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:05.944526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:05.944500    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"]
Jul 02 23:15:05.946970 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:05.946944    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb311b8_1629_4877_821a_d975bd40956f.slice/crio-38d77f3fea700cf1588e00216f901637176c1bec1956946b60aefe336c69b02b WatchSource:0}: Error finding container 38d77f3fea700cf1588e00216f901637176c1bec1956946b60aefe336c69b02b: Status 404 returned error can't find the container with id 38d77f3fea700cf1588e00216f901637176c1bec1956946b60aefe336c69b02b
Jul 02 23:15:06.853906 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:06.853841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw" event={"ID":"2eb311b8-1629-4877-821a-d975bd40956f","Type":"ContainerStarted","Data":"38d77f3fea700cf1588e00216f901637176c1bec1956946b60aefe336c69b02b"}
Jul 02 23:15:09.869094 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:09.869053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw" event={"ID":"2eb311b8-1629-4877-821a-d975bd40956f","Type":"ContainerStarted","Data":"fcac93ffec1ba4d444d2a0b2d62fbc7833e50d04bc7402a33410a09f69789178"}
Jul 02 23:15:10.874673 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:10.874637    2573 generic.go:356] "Generic (PLEG): container finished" podID="2eb311b8-1629-4877-821a-d975bd40956f" containerID="fcac93ffec1ba4d444d2a0b2d62fbc7833e50d04bc7402a33410a09f69789178" exitCode=0
Jul 02 23:15:10.875062 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:10.874723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw" event={"ID":"2eb311b8-1629-4877-821a-d975bd40956f","Type":"ContainerDied","Data":"fcac93ffec1ba4d444d2a0b2d62fbc7833e50d04bc7402a33410a09f69789178"}
Jul 02 23:15:11.880819 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:11.880784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw" event={"ID":"2eb311b8-1629-4877-821a-d975bd40956f","Type":"ContainerStarted","Data":"d34e310984e2a74abd4b938ad6885df895687c0f7a41a001e08ac5ddab9950ab"}
Jul 02 23:15:11.881211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:11.880901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:11.907698 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:11.907642    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw" podStartSLOduration=2.562580065 podStartE2EDuration="6.907626327s" totalImagesPullingTime="3.267166564s" totalInitContainerRuntime="1.077879698s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:11.906811422 +0000 UTC m=+299.890879781" watchObservedRunningTime="2026-07-02 23:15:11.907626327 +0000 UTC m=+299.891694686"
Jul 02 23:15:12.419196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:12.419168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:15:12.419395 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:12.419368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:15:12.429374 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:12.429352    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:15:22.887262 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:22.887230    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-rf6rw"
Jul 02 23:15:25.335372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.335339    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"]
Jul 02 23:15:25.338195 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.338177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.341403 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.341379    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:15:25.341403 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.341385    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-55t4w\""
Jul 02 23:15:25.342829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.342805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:15:25.342829 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.342821    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 23:15:25.358847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.358817    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 23:15:25.360462 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.360438    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"]
Jul 02 23:15:25.436549 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.436516    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r6hgs"]
Jul 02 23:15:25.439316 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.439289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.450336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.450297    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ckg7f\""
Jul 02 23:15:25.450488 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.450356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 23:15:25.456824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.456796    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r6hgs"]
Jul 02 23:15:25.463397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.463370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df13bb5-1732-4863-886f-aac4648e6f6f-tmp\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.463557 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.463409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6df13bb5-1732-4863-886f-aac4648e6f6f-tls-certs\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.463557 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.463438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js5sf\" (UniqueName: \"kubernetes.io/projected/6df13bb5-1732-4863-886f-aac4648e6f6f-kube-api-access-js5sf\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.564916 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.564833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7bjl\" (UniqueName: \"kubernetes.io/projected/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-kube-api-access-q7bjl\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.565117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.564926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df13bb5-1732-4863-886f-aac4648e6f6f-tmp\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.565117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.564952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.565117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.564974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6df13bb5-1732-4863-886f-aac4648e6f6f-tls-certs\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.565117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.564991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js5sf\" (UniqueName: \"kubernetes.io/projected/6df13bb5-1732-4863-886f-aac4648e6f6f-kube-api-access-js5sf\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.567554 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.567528    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6df13bb5-1732-4863-886f-aac4648e6f6f-tmp\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.567707 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.567574    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6df13bb5-1732-4863-886f-aac4648e6f6f-tls-certs\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.575722 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.575686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js5sf\" (UniqueName: \"kubernetes.io/projected/6df13bb5-1732-4863-886f-aac4648e6f6f-kube-api-access-js5sf\") pod \"kube-auth-proxy-86c4d5658d-8rbjm\" (UID: \"6df13bb5-1732-4863-886f-aac4648e6f6f\") " pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.649955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.649849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"
Jul 02 23:15:25.666036 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.666001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7bjl\" (UniqueName: \"kubernetes.io/projected/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-kube-api-access-q7bjl\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.666201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.666104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.666777 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:15:25.666753    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 02 23:15:25.666931 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:15:25.666846    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert podName:3f98a7ce-4cb2-418d-a71d-bb5f57b34c39 nodeName:}" failed. No retries permitted until 2026-07-02 23:15:26.166824409 +0000 UTC m=+314.150892747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert") pod "odh-model-controller-7998c67dc4-r6hgs" (UID: "3f98a7ce-4cb2-418d-a71d-bb5f57b34c39") : secret "odh-model-controller-webhook-cert" not found
Jul 02 23:15:25.688029 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.688001    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7bjl\" (UniqueName: \"kubernetes.io/projected/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-kube-api-access-q7bjl\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:25.800011 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.799987    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm"]
Jul 02 23:15:25.802207 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:25.802176    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df13bb5_1732_4863_886f_aac4648e6f6f.slice/crio-b11609d326c7e12ebb54272def95d4fe7cd5ff813dfb615237259407fe66f2e1 WatchSource:0}: Error finding container b11609d326c7e12ebb54272def95d4fe7cd5ff813dfb615237259407fe66f2e1: Status 404 returned error can't find the container with id b11609d326c7e12ebb54272def95d4fe7cd5ff813dfb615237259407fe66f2e1
Jul 02 23:15:25.804025 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.804007    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:15:25.940849 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:25.940809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm" event={"ID":"6df13bb5-1732-4863-886f-aac4648e6f6f","Type":"ContainerStarted","Data":"b11609d326c7e12ebb54272def95d4fe7cd5ff813dfb615237259407fe66f2e1"}
Jul 02 23:15:26.171131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.171083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:26.173726 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.173699    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f98a7ce-4cb2-418d-a71d-bb5f57b34c39-cert\") pod \"odh-model-controller-7998c67dc4-r6hgs\" (UID: \"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39\") " pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:26.351863 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.351767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:26.496261 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.496228    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r6hgs"]
Jul 02 23:15:26.498305 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:26.498272    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f98a7ce_4cb2_418d_a71d_bb5f57b34c39.slice/crio-748b155b02fc9e88b1b5ed0503a37b373acb9a54108f1f5420d035e79cddcc93 WatchSource:0}: Error finding container 748b155b02fc9e88b1b5ed0503a37b373acb9a54108f1f5420d035e79cddcc93: Status 404 returned error can't find the container with id 748b155b02fc9e88b1b5ed0503a37b373acb9a54108f1f5420d035e79cddcc93
Jul 02 23:15:26.645915 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.645810    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:26.648521 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.648502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.651384 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.651360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 23:15:26.651523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.651380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 23:15:26.651523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.651358    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 23:15:26.651683 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.651664    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 23:15:26.651928 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.651913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w8gbr\""
Jul 02 23:15:26.662778 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.662749    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:26.777200 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777390 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777390 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zh6t\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777390 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777558 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777558 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.777558 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.777513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878467 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878467 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878467 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878467 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878467 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zh6t\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.878727 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.878503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.879109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.879079    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.881407 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.881382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.881510 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.881393    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.881510 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.881450    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.881603 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.881588    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.888813 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.888787    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.889077 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.889057    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zh6t\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t\") pod \"istiod-openshift-gateway-7574459656-4r2pk\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:26.948721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.948682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs" event={"ID":"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39","Type":"ContainerStarted","Data":"748b155b02fc9e88b1b5ed0503a37b373acb9a54108f1f5420d035e79cddcc93"}
Jul 02 23:15:26.963037 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:26.963006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:27.118388 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:27.118360    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:27.120612 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:27.120580    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda099bf08_89ae_47a3_99f5_ee99a11626bc.slice/crio-756c56ec4efe7b1941f03bb7b3b0c59be752bb74a647d3e7ee2b8110aaa21f27 WatchSource:0}: Error finding container 756c56ec4efe7b1941f03bb7b3b0c59be752bb74a647d3e7ee2b8110aaa21f27: Status 404 returned error can't find the container with id 756c56ec4efe7b1941f03bb7b3b0c59be752bb74a647d3e7ee2b8110aaa21f27
Jul 02 23:15:27.955580 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:27.955539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" event={"ID":"a099bf08-89ae-47a3-99f5-ee99a11626bc","Type":"ContainerStarted","Data":"756c56ec4efe7b1941f03bb7b3b0c59be752bb74a647d3e7ee2b8110aaa21f27"}
Jul 02 23:15:30.973452 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:30.973407    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm" event={"ID":"6df13bb5-1732-4863-886f-aac4648e6f6f","Type":"ContainerStarted","Data":"abc46c3da06b6895709294430e9b471a6c04dc058d870760e88317b41327630e"}
Jul 02 23:15:30.975590 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:30.975558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs" event={"ID":"3f98a7ce-4cb2-418d-a71d-bb5f57b34c39","Type":"ContainerStarted","Data":"dcd4f30e73e094450216155bc79feaeffb3630ba7d1aa656cbd690d70230b409"}
Jul 02 23:15:30.975733 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:30.975665    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:31.000485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:31.000426    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86c4d5658d-8rbjm" podStartSLOduration=1.769155145 podStartE2EDuration="6.000406064s" totalImagesPullingTime="4.231250919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:30.999253886 +0000 UTC m=+318.983322246" watchObservedRunningTime="2026-07-02 23:15:31.000406064 +0000 UTC m=+318.984474424"
Jul 02 23:15:31.022178 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:31.022118    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs" podStartSLOduration=2.486721448 podStartE2EDuration="6.022096763s" totalImagesPullingTime="3.535375315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:31.01958912 +0000 UTC m=+319.003657479" watchObservedRunningTime="2026-07-02 23:15:31.022096763 +0000 UTC m=+319.006165125"
Jul 02 23:15:34.278527 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:34.278490    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:34.278777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:34.278558    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:35.004197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.004155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" event={"ID":"a099bf08-89ae-47a3-99f5-ee99a11626bc","Type":"ContainerStarted","Data":"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"}
Jul 02 23:15:35.004417 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.004260    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:35.006079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.006054    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4r2pk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:15:35.006191 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.006100    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:15:35.913531 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.913462    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" podStartSLOduration=2.758826935 podStartE2EDuration="9.91344301s" totalImagesPullingTime="7.154616075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:35.174608699 +0000 UTC m=+323.158677072" watchObservedRunningTime="2026-07-02 23:15:35.91344301 +0000 UTC m=+323.897511369"
Jul 02 23:15:35.913955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.913628    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"]
Jul 02 23:15:35.916569 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.916549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:35.930843 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.930816    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4px4l\""
Jul 02 23:15:35.973166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:35.973136    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"]
Jul 02 23:15:36.009059 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.009026    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:36.060813 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpcv\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-kube-api-access-xgpcv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.060976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.061056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.061141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.061307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.061178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162569 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.162764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpcv\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-kube-api-access-xgpcv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163044 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163044 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163044 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.162863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163190 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.163087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163271 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.163248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163385 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.163359    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163655 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.163581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.163922 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.163901    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.165613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.165592    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.165840 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.165820    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.181321 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.181296    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpcv\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-kube-api-access-xgpcv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.207538 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.207507    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e43978-edef-4de5-ad82-71c6f59c3e7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4s25m5\" (UID: \"d1e43978-edef-4de5-ad82-71c6f59c3e7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.226677 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.226642    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:36.425225 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:36.425195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"]
Jul 02 23:15:36.427079 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:36.427052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e43978_edef_4de5_ad82_71c6f59c3e7d.slice/crio-4c9fdb923829917db3728353c8fa769c3930c78385013c133ff64c9f53766d46 WatchSource:0}: Error finding container 4c9fdb923829917db3728353c8fa769c3930c78385013c133ff64c9f53766d46: Status 404 returned error can't find the container with id 4c9fdb923829917db3728353c8fa769c3930c78385013c133ff64c9f53766d46
Jul 02 23:15:37.015817 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:37.015760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5" event={"ID":"d1e43978-edef-4de5-ad82-71c6f59c3e7d","Type":"ContainerStarted","Data":"4c9fdb923829917db3728353c8fa769c3930c78385013c133ff64c9f53766d46"}
Jul 02 23:15:38.907984 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:38.907949    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:38.908257 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:38.908018    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:38.908257 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:38.908046    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:39.027294 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.027260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5" event={"ID":"d1e43978-edef-4de5-ad82-71c6f59c3e7d","Type":"ContainerStarted","Data":"6b46291ea222844e77647221968903d734385f5af49d1b8e99b60619a187cddc"}
Jul 02 23:15:39.053103 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.053072    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"]
Jul 02 23:15:39.056344 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.056327    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.064099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.064077    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xsh8g\""
Jul 02 23:15:39.075391 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.075363    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 23:15:39.106530 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.106495    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"]
Jul 02 23:15:39.114758 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.114234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.122547 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.122524    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kczx5\""
Jul 02 23:15:39.122675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.122525    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 23:15:39.146926 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.146878    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"]
Jul 02 23:15:39.160717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.160633    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"]
Jul 02 23:15:39.172752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.172692    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5" podStartSLOduration=1.6941975820000001 podStartE2EDuration="4.17267371s" totalImagesPullingTime="2.478476128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:39.172235555 +0000 UTC m=+327.156303928" watchObservedRunningTime="2026-07-02 23:15:39.17267371 +0000 UTC m=+327.156742072"
Jul 02 23:15:39.192402 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.192368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxn4\" (UniqueName: \"kubernetes.io/projected/69583d64-afda-4a7a-845b-07a184acba23-kube-api-access-qzxn4\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.192596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.192425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69583d64-afda-4a7a-845b-07a184acba23-cert\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.192596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.192497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597r7\" (UniqueName: \"kubernetes.io/projected/014a75de-865f-4580-88c4-cbece1fdc654-kube-api-access-597r7\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.192596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.192549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.227143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.227111    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:39.228286 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.228263    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4s25m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 02 23:15:39.228401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.228308    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5" podUID="d1e43978-edef-4de5-ad82-71c6f59c3e7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 02 23:15:39.293300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.293263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxn4\" (UniqueName: \"kubernetes.io/projected/69583d64-afda-4a7a-845b-07a184acba23-kube-api-access-qzxn4\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.293461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.293322    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69583d64-afda-4a7a-845b-07a184acba23-cert\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.293461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.293363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597r7\" (UniqueName: \"kubernetes.io/projected/014a75de-865f-4580-88c4-cbece1fdc654-kube-api-access-597r7\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.293461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.293398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.293640 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:15:39.293489    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 02 23:15:39.293640 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:15:39.293540    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert podName:014a75de-865f-4580-88c4-cbece1fdc654 nodeName:}" failed. No retries permitted until 2026-07-02 23:15:39.793525322 +0000 UTC m=+327.777593659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert") pod "llmisvc-controller-manager-777c6bd7d5-gnh58" (UID: "014a75de-865f-4580-88c4-cbece1fdc654") : secret "llmisvc-webhook-server-cert" not found
Jul 02 23:15:39.295830 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.295803    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69583d64-afda-4a7a-845b-07a184acba23-cert\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.310529 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.310501    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxn4\" (UniqueName: \"kubernetes.io/projected/69583d64-afda-4a7a-845b-07a184acba23-kube-api-access-qzxn4\") pod \"kserve-controller-manager-d6f4b65b8-fjbsr\" (UID: \"69583d64-afda-4a7a-845b-07a184acba23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.313095 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.313070    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597r7\" (UniqueName: \"kubernetes.io/projected/014a75de-865f-4580-88c4-cbece1fdc654-kube-api-access-597r7\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.366749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.366716    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:39.527192 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.527169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"]
Jul 02 23:15:39.528412 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:39.528389    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69583d64_afda_4a7a_845b_07a184acba23.slice/crio-1ace2b9457bffd0926d006c1fb9c7669cd50a044a26e0072767c7ba79bb06457 WatchSource:0}: Error finding container 1ace2b9457bffd0926d006c1fb9c7669cd50a044a26e0072767c7ba79bb06457: Status 404 returned error can't find the container with id 1ace2b9457bffd0926d006c1fb9c7669cd50a044a26e0072767c7ba79bb06457
Jul 02 23:15:39.797832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.797795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:39.800168 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:39.800148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/014a75de-865f-4580-88c4-cbece1fdc654-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gnh58\" (UID: \"014a75de-865f-4580-88c4-cbece1fdc654\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:40.025480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.025441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:40.032604 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.032565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr" event={"ID":"69583d64-afda-4a7a-845b-07a184acba23","Type":"ContainerStarted","Data":"1ace2b9457bffd0926d006c1fb9c7669cd50a044a26e0072767c7ba79bb06457"}
Jul 02 23:15:40.062630 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.062558    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:40.062837 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.062789    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerName="discovery" containerID="cri-o://edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c" gracePeriod=30
Jul 02 23:15:40.168561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.168535    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"]
Jul 02 23:15:40.169964 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:15:40.169928    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod014a75de_865f_4580_88c4_cbece1fdc654.slice/crio-c15a45b7be3c8f64cc33fa3913020be23454a0685a908c8a35c664176cb4983c WatchSource:0}: Error finding container c15a45b7be3c8f64cc33fa3913020be23454a0685a908c8a35c664176cb4983c: Status 404 returned error can't find the container with id c15a45b7be3c8f64cc33fa3913020be23454a0685a908c8a35c664176cb4983c
Jul 02 23:15:40.233039 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.232397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:40.309984 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.309937    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:40.404289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404205    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404296    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zh6t\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404475    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404533    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404591    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs\") pod \"a099bf08-89ae-47a3-99f5-ee99a11626bc\" (UID: \"a099bf08-89ae-47a3-99f5-ee99a11626bc\") "
Jul 02 23:15:40.404933 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404703    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:15:40.404933 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.404917    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-ca-configmap\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.407266 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407235    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t" (OuterVolumeSpecName: "kube-api-access-4zh6t") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "kube-api-access-4zh6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:15:40.407383 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407364    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs" (OuterVolumeSpecName: "local-certs") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:15:40.407451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407404    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:15:40.407501 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407449    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:15:40.407501 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407464    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:15:40.407606 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.407583    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts" (OuterVolumeSpecName: "cacerts") pod "a099bf08-89ae-47a3-99f5-ee99a11626bc" (UID: "a099bf08-89ae-47a3-99f5-ee99a11626bc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:15:40.506183 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506147    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-csr-dns-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.506183 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506182    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zh6t\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-kube-api-access-4zh6t\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.506404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506198    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.506404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506213    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-cacerts\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.506404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506227    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a099bf08-89ae-47a3-99f5-ee99a11626bc-istio-kubeconfig\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:40.506404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:40.506238    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a099bf08-89ae-47a3-99f5-ee99a11626bc-local-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:15:41.039315 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.039193    2573 generic.go:356] "Generic (PLEG): container finished" podID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerID="edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c" exitCode=0
Jul 02 23:15:41.039315 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.039282    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"
Jul 02 23:15:41.039875 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.039327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" event={"ID":"a099bf08-89ae-47a3-99f5-ee99a11626bc","Type":"ContainerDied","Data":"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"}
Jul 02 23:15:41.039875 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.039415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk" event={"ID":"a099bf08-89ae-47a3-99f5-ee99a11626bc","Type":"ContainerDied","Data":"756c56ec4efe7b1941f03bb7b3b0c59be752bb74a647d3e7ee2b8110aaa21f27"}
Jul 02 23:15:41.039875 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.039446    2573 scope.go:117] "RemoveContainer" containerID="edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"
Jul 02 23:15:41.041827 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.041795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58" event={"ID":"014a75de-865f-4580-88c4-cbece1fdc654","Type":"ContainerStarted","Data":"c15a45b7be3c8f64cc33fa3913020be23454a0685a908c8a35c664176cb4983c"}
Jul 02 23:15:41.042138 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.042091    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:41.043203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.043182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4s25m5"
Jul 02 23:15:41.078507 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.078470    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:41.094578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.094550    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4r2pk"]
Jul 02 23:15:41.278897 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.278674    2573 scope.go:117] "RemoveContainer" containerID="edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"
Jul 02 23:15:41.279178 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:15:41.279151    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c\": container with ID starting with edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c not found: ID does not exist" containerID="edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"
Jul 02 23:15:41.279275 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.279194    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c"} err="failed to get container status \"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c\": rpc error: code = NotFound desc = could not find container \"edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c\": container with ID starting with edcbe67e99c5a9bdfbbefa6877092e0147cac2669a70de0ac5d70353f973e58c not found: ID does not exist"
Jul 02 23:15:41.983672 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:41.983638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-r6hgs"
Jul 02 23:15:42.537017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:42.536982    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" path="/var/lib/kubelet/pods/a099bf08-89ae-47a3-99f5-ee99a11626bc/volumes"
Jul 02 23:15:44.058776 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.058734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr" event={"ID":"69583d64-afda-4a7a-845b-07a184acba23","Type":"ContainerStarted","Data":"cf28b344354a615cdcc972ec75ed6fe859601bfab79a03bb69c1dd653cde7d42"}
Jul 02 23:15:44.059252 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.058848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:15:44.060259 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.060235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58" event={"ID":"014a75de-865f-4580-88c4-cbece1fdc654","Type":"ContainerStarted","Data":"1f6bb75c8cb5ca0812d59a5c7593218ec75f20034a433d49fa187155f6885b9b"}
Jul 02 23:15:44.060378 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.060363    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:15:44.079679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.079624    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr" podStartSLOduration=2.592345854 podStartE2EDuration="6.079608958s" totalImagesPullingTime="3.487263104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:44.078669429 +0000 UTC m=+332.062737788" watchObservedRunningTime="2026-07-02 23:15:44.079608958 +0000 UTC m=+332.063677319"
Jul 02 23:15:44.103957 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:15:44.103901    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58" podStartSLOduration=2.928961223 podStartE2EDuration="6.103871741s" totalImagesPullingTime="3.174910518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:44.101624898 +0000 UTC m=+332.085693255" watchObservedRunningTime="2026-07-02 23:15:44.103871741 +0000 UTC m=+332.087940155"
Jul 02 23:16:15.066536 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:15.066505    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gnh58"
Jul 02 23:16:15.069500 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:15.069481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fjbsr"
Jul 02 23:16:26.161098 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.161061    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:26.161451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.161400    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerName="discovery"
Jul 02 23:16:26.161451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.161411    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerName="discovery"
Jul 02 23:16:26.161525 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.161479    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a099bf08-89ae-47a3-99f5-ee99a11626bc" containerName="discovery"
Jul 02 23:16:26.170398 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.170372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:26.173318 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.173290    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:16:26.174845 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.174823    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zdtzc\""
Jul 02 23:16:26.175206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.174833    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:16:26.175604 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.175581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:26.297811 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.297773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xc7\" (UniqueName: \"kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7\") pod \"kuadrant-operator-catalog-hkssf\" (UID: \"69ae0bbc-7089-4415-bfca-b2e5879735f7\") " pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:26.398242 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.398212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xc7\" (UniqueName: \"kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7\") pod \"kuadrant-operator-catalog-hkssf\" (UID: \"69ae0bbc-7089-4415-bfca-b2e5879735f7\") " pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:26.407123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.407090    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xc7\" (UniqueName: \"kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7\") pod \"kuadrant-operator-catalog-hkssf\" (UID: \"69ae0bbc-7089-4415-bfca-b2e5879735f7\") " pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:26.482335 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.482302    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:26.537431 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.537407    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:26.611034 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.611011    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:26.612727 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:16:26.612701    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ae0bbc_7089_4415_bfca_b2e5879735f7.slice/crio-93cce3a94d7ee29dbd81123c6c48d94d9826234dad96cd7c9e1e68bfd6c211b4 WatchSource:0}: Error finding container 93cce3a94d7ee29dbd81123c6c48d94d9826234dad96cd7c9e1e68bfd6c211b4: Status 404 returned error can't find the container with id 93cce3a94d7ee29dbd81123c6c48d94d9826234dad96cd7c9e1e68bfd6c211b4
Jul 02 23:16:26.746081 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.746001    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t4jt"]
Jul 02 23:16:26.748860 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.748843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:26.757042 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.757016    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t4jt"]
Jul 02 23:16:26.802764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.802726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4fd\" (UniqueName: \"kubernetes.io/projected/dca2760b-09cd-4493-a1cc-60073ad626a5-kube-api-access-8t4fd\") pod \"kuadrant-operator-catalog-8t4jt\" (UID: \"dca2760b-09cd-4493-a1cc-60073ad626a5\") " pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:26.904084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.904051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4fd\" (UniqueName: \"kubernetes.io/projected/dca2760b-09cd-4493-a1cc-60073ad626a5-kube-api-access-8t4fd\") pod \"kuadrant-operator-catalog-8t4jt\" (UID: \"dca2760b-09cd-4493-a1cc-60073ad626a5\") " pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:26.912554 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:26.912524    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4fd\" (UniqueName: \"kubernetes.io/projected/dca2760b-09cd-4493-a1cc-60073ad626a5-kube-api-access-8t4fd\") pod \"kuadrant-operator-catalog-8t4jt\" (UID: \"dca2760b-09cd-4493-a1cc-60073ad626a5\") " pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:27.058591 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:27.058503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:27.191926 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:27.191902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t4jt"]
Jul 02 23:16:27.193834 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:16:27.193808    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca2760b_09cd_4493_a1cc_60073ad626a5.slice/crio-0c0b3e23d863ced46fd335e588d5bc17ef22910cdb70cae62857619928ba7872 WatchSource:0}: Error finding container 0c0b3e23d863ced46fd335e588d5bc17ef22910cdb70cae62857619928ba7872: Status 404 returned error can't find the container with id 0c0b3e23d863ced46fd335e588d5bc17ef22910cdb70cae62857619928ba7872
Jul 02 23:16:27.250696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:27.250664    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt" event={"ID":"dca2760b-09cd-4493-a1cc-60073ad626a5","Type":"ContainerStarted","Data":"0c0b3e23d863ced46fd335e588d5bc17ef22910cdb70cae62857619928ba7872"}
Jul 02 23:16:27.251732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:27.251705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" event={"ID":"69ae0bbc-7089-4415-bfca-b2e5879735f7","Type":"ContainerStarted","Data":"93cce3a94d7ee29dbd81123c6c48d94d9826234dad96cd7c9e1e68bfd6c211b4"}
Jul 02 23:16:29.262925 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.262869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt" event={"ID":"dca2760b-09cd-4493-a1cc-60073ad626a5","Type":"ContainerStarted","Data":"d1ab6a0df5e7bba4e479e0928f70869c9804f7d26b2d7259e9c41811d22abd13"}
Jul 02 23:16:29.264439 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.264411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" event={"ID":"69ae0bbc-7089-4415-bfca-b2e5879735f7","Type":"ContainerStarted","Data":"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"}
Jul 02 23:16:29.264553 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.264445    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" podUID="69ae0bbc-7089-4415-bfca-b2e5879735f7" containerName="registry-server" containerID="cri-o://876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6" gracePeriod=2
Jul 02 23:16:29.280696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.280634    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt" podStartSLOduration=1.706951629 podStartE2EDuration="3.280612405s" totalImagesPullingTime="1.573660776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:29.27980954 +0000 UTC m=+377.263877901" watchObservedRunningTime="2026-07-02 23:16:29.280612405 +0000 UTC m=+377.264680766"
Jul 02 23:16:29.298943 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.298870    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" podStartSLOduration=1.14482412 podStartE2EDuration="3.298851821s" totalImagesPullingTime="2.154027701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:29.298224968 +0000 UTC m=+377.282293329" watchObservedRunningTime="2026-07-02 23:16:29.298851821 +0000 UTC m=+377.282920375"
Jul 02 23:16:29.509545 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.509517    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:29.628070 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.627989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64xc7\" (UniqueName: \"kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7\") pod \"69ae0bbc-7089-4415-bfca-b2e5879735f7\" (UID: \"69ae0bbc-7089-4415-bfca-b2e5879735f7\") "
Jul 02 23:16:29.630273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.630247    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7" (OuterVolumeSpecName: "kube-api-access-64xc7") pod "69ae0bbc-7089-4415-bfca-b2e5879735f7" (UID: "69ae0bbc-7089-4415-bfca-b2e5879735f7"). InnerVolumeSpecName "kube-api-access-64xc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:16:29.729197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:29.729160    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64xc7\" (UniqueName: \"kubernetes.io/projected/69ae0bbc-7089-4415-bfca-b2e5879735f7-kube-api-access-64xc7\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:16:30.270220 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.270189    2573 generic.go:356] "Generic (PLEG): container finished" podID="69ae0bbc-7089-4415-bfca-b2e5879735f7" containerID="876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6" exitCode=0
Jul 02 23:16:30.270623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.270235    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hkssf"
Jul 02 23:16:30.270623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.270273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" event={"ID":"69ae0bbc-7089-4415-bfca-b2e5879735f7","Type":"ContainerDied","Data":"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"}
Jul 02 23:16:30.270623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.270320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hkssf" event={"ID":"69ae0bbc-7089-4415-bfca-b2e5879735f7","Type":"ContainerDied","Data":"93cce3a94d7ee29dbd81123c6c48d94d9826234dad96cd7c9e1e68bfd6c211b4"}
Jul 02 23:16:30.270623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.270340    2573 scope.go:117] "RemoveContainer" containerID="876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"
Jul 02 23:16:30.279374 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.279357    2573 scope.go:117] "RemoveContainer" containerID="876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"
Jul 02 23:16:30.279638 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:16:30.279620    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6\": container with ID starting with 876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6 not found: ID does not exist" containerID="876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"
Jul 02 23:16:30.279704 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.279645    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6"} err="failed to get container status \"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6\": rpc error: code = NotFound desc = could not find container \"876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6\": container with ID starting with 876329b05815c9e7d869296697fbec631a9de3c4add06d1117ed5c3493c890b6 not found: ID does not exist"
Jul 02 23:16:30.291339 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.291310    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:30.295436 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.295410    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hkssf"]
Jul 02 23:16:30.539840 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:30.539754    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ae0bbc-7089-4415-bfca-b2e5879735f7" path="/var/lib/kubelet/pods/69ae0bbc-7089-4415-bfca-b2e5879735f7/volumes"
Jul 02 23:16:37.059518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:37.059481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:37.059949 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:37.059574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:37.081795 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:37.081768    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:37.326057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:37.325988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8t4jt"
Jul 02 23:16:58.416270 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.416237    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"]
Jul 02 23:16:58.416693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.416574    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ae0bbc-7089-4415-bfca-b2e5879735f7" containerName="registry-server"
Jul 02 23:16:58.416693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.416585    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ae0bbc-7089-4415-bfca-b2e5879735f7" containerName="registry-server"
Jul 02 23:16:58.416693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.416642    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="69ae0bbc-7089-4415-bfca-b2e5879735f7" containerName="registry-server"
Jul 02 23:16:58.419763 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.419743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:16:58.422561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.422537    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 23:16:58.422661 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.422595    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kwg2x\""
Jul 02 23:16:58.430919 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.430895    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"]
Jul 02 23:16:58.473376 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.473338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhqv\" (UniqueName: \"kubernetes.io/projected/5893d752-e8bd-462e-a8ca-3787ffdba037-kube-api-access-6rhqv\") pod \"dns-operator-controller-manager-864dd78c4c-x7tk6\" (UID: \"5893d752-e8bd-462e-a8ca-3787ffdba037\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:16:58.574088 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.574046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhqv\" (UniqueName: \"kubernetes.io/projected/5893d752-e8bd-462e-a8ca-3787ffdba037-kube-api-access-6rhqv\") pod \"dns-operator-controller-manager-864dd78c4c-x7tk6\" (UID: \"5893d752-e8bd-462e-a8ca-3787ffdba037\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:16:58.589288 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.589260    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhqv\" (UniqueName: \"kubernetes.io/projected/5893d752-e8bd-462e-a8ca-3787ffdba037-kube-api-access-6rhqv\") pod \"dns-operator-controller-manager-864dd78c4c-x7tk6\" (UID: \"5893d752-e8bd-462e-a8ca-3787ffdba037\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:16:58.729797 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.729766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:16:58.864338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:58.864314    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"]
Jul 02 23:16:58.866735 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:16:58.866708    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5893d752_e8bd_462e_a8ca_3787ffdba037.slice/crio-3dc0e0ff5c86f2b5bb2edb1815a1ac2d497019b82c896cb3e486f6fac45a7d05 WatchSource:0}: Error finding container 3dc0e0ff5c86f2b5bb2edb1815a1ac2d497019b82c896cb3e486f6fac45a7d05: Status 404 returned error can't find the container with id 3dc0e0ff5c86f2b5bb2edb1815a1ac2d497019b82c896cb3e486f6fac45a7d05
Jul 02 23:16:59.397658 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:16:59.397628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6" event={"ID":"5893d752-e8bd-462e-a8ca-3787ffdba037","Type":"ContainerStarted","Data":"3dc0e0ff5c86f2b5bb2edb1815a1ac2d497019b82c896cb3e486f6fac45a7d05"}
Jul 02 23:17:01.408802 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:01.408767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6" event={"ID":"5893d752-e8bd-462e-a8ca-3787ffdba037","Type":"ContainerStarted","Data":"b6493f1c0c169adae29e8abc44248174e73fc89bf50ed437e3df57c067c5258a"}
Jul 02 23:17:01.409203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:01.408914    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:17:01.426992 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:01.426943    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6" podStartSLOduration=1.698380343 podStartE2EDuration="3.426925419s" totalImagesPullingTime="1.728545076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:01.425681192 +0000 UTC m=+409.409749556" watchObservedRunningTime="2026-07-02 23:17:01.426925419 +0000 UTC m=+409.410993779"
Jul 02 23:17:02.501954 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.501909    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"]
Jul 02 23:17:02.509818 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.509793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:02.513206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.513185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ngjmv\""
Jul 02 23:17:02.517443 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.517423    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"]
Jul 02 23:17:02.608447 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.608413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t772z\" (UniqueName: \"kubernetes.io/projected/5898b7eb-2a14-4cde-9607-2ceed1c54bf9-kube-api-access-t772z\") pod \"authorino-operator-75cc8d5cb7-smfwb\" (UID: \"5898b7eb-2a14-4cde-9607-2ceed1c54bf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:02.709566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.709527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t772z\" (UniqueName: \"kubernetes.io/projected/5898b7eb-2a14-4cde-9607-2ceed1c54bf9-kube-api-access-t772z\") pod \"authorino-operator-75cc8d5cb7-smfwb\" (UID: \"5898b7eb-2a14-4cde-9607-2ceed1c54bf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:02.719136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.719111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t772z\" (UniqueName: \"kubernetes.io/projected/5898b7eb-2a14-4cde-9607-2ceed1c54bf9-kube-api-access-t772z\") pod \"authorino-operator-75cc8d5cb7-smfwb\" (UID: \"5898b7eb-2a14-4cde-9607-2ceed1c54bf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:02.820985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.820867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:02.951550 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:02.951527    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"]
Jul 02 23:17:02.953763 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:02.953739    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5898b7eb_2a14_4cde_9607_2ceed1c54bf9.slice/crio-e3e403189d38080b4d1e3459c7c3afbf9189702f04bb55e4d23be2550fedfdd5 WatchSource:0}: Error finding container e3e403189d38080b4d1e3459c7c3afbf9189702f04bb55e4d23be2550fedfdd5: Status 404 returned error can't find the container with id e3e403189d38080b4d1e3459c7c3afbf9189702f04bb55e4d23be2550fedfdd5
Jul 02 23:17:03.419106 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:03.419070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb" event={"ID":"5898b7eb-2a14-4cde-9607-2ceed1c54bf9","Type":"ContainerStarted","Data":"e3e403189d38080b4d1e3459c7c3afbf9189702f04bb55e4d23be2550fedfdd5"}
Jul 02 23:17:05.431833 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.431793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb" event={"ID":"5898b7eb-2a14-4cde-9607-2ceed1c54bf9","Type":"ContainerStarted","Data":"96cc9d090ad7d2112e9a36035ad754ef739d440ebb3a3a04ed96e2b4374557ce"}
Jul 02 23:17:05.432229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.431874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:05.450020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.449972    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb" podStartSLOduration=1.269100938 podStartE2EDuration="3.449957863s" totalImagesPullingTime="2.180856925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:05.447584386 +0000 UTC m=+413.431652747" watchObservedRunningTime="2026-07-02 23:17:05.449957863 +0000 UTC m=+413.434026222"
Jul 02 23:17:05.792967 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.792877    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"]
Jul 02 23:17:05.796203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.796188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:05.807578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.807554    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sr5xs\""
Jul 02 23:17:05.820267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.820243    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"]
Jul 02 23:17:05.837110 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.837077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljdm\" (UniqueName: \"kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm\") pod \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" (UID: \"1e355ce7-3963-4d98-81ea-29e3831f0f47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:05.938020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.937984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljdm\" (UniqueName: \"kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm\") pod \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" (UID: \"1e355ce7-3963-4d98-81ea-29e3831f0f47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:05.946689 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:05.946664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljdm\" (UniqueName: \"kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm\") pod \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" (UID: \"1e355ce7-3963-4d98-81ea-29e3831f0f47\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:06.106362 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:06.106274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:06.249661 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:06.249635    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"]
Jul 02 23:17:06.251607 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:06.251581    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e355ce7_3963_4d98_81ea_29e3831f0f47.slice/crio-c64e0de3c3a1bfb81054315b0c82460527bc1f93b1069d827c0d84ab05518843 WatchSource:0}: Error finding container c64e0de3c3a1bfb81054315b0c82460527bc1f93b1069d827c0d84ab05518843: Status 404 returned error can't find the container with id c64e0de3c3a1bfb81054315b0c82460527bc1f93b1069d827c0d84ab05518843
Jul 02 23:17:06.437532 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:06.437501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz" event={"ID":"1e355ce7-3963-4d98-81ea-29e3831f0f47","Type":"ContainerStarted","Data":"c64e0de3c3a1bfb81054315b0c82460527bc1f93b1069d827c0d84ab05518843"}
Jul 02 23:17:08.449087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:08.449047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz" event={"ID":"1e355ce7-3963-4d98-81ea-29e3831f0f47","Type":"ContainerStarted","Data":"56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7"}
Jul 02 23:17:08.449459 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:08.449138    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:08.497638 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:08.497588    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz" podStartSLOduration=1.8212443299999999 podStartE2EDuration="3.497573461s" totalImagesPullingTime="1.676329131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:08.493345548 +0000 UTC m=+416.477413907" watchObservedRunningTime="2026-07-02 23:17:08.497573461 +0000 UTC m=+416.481641821"
Jul 02 23:17:10.469072 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.469042    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"]
Jul 02 23:17:10.472475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.472459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.475610 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.475588    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tspvk\""
Jul 02 23:17:10.486778 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.486755    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"]
Jul 02 23:17:10.576230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.576192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flbwb\" (UniqueName: \"kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.576434 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.576246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.677075 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.677033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flbwb\" (UniqueName: \"kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.677263 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.677091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.677487 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.677466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.686724 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.686702    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flbwb\" (UniqueName: \"kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.783775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.783684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:10.916593 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:10.916569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"]
Jul 02 23:17:10.918771 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:10.918743    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bea88b7_9d1a_4853_8d34_269b6eaa25d6.slice/crio-e47812f3704cfb25a1aed559d12ea78296736a538e54d4ec3271c4cb21a62440 WatchSource:0}: Error finding container e47812f3704cfb25a1aed559d12ea78296736a538e54d4ec3271c4cb21a62440: Status 404 returned error can't find the container with id e47812f3704cfb25a1aed559d12ea78296736a538e54d4ec3271c4cb21a62440
Jul 02 23:17:11.463465 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:11.463433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5" event={"ID":"1bea88b7-9d1a-4853-8d34-269b6eaa25d6","Type":"ContainerStarted","Data":"e47812f3704cfb25a1aed559d12ea78296736a538e54d4ec3271c4cb21a62440"}
Jul 02 23:17:12.416243 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:12.416214    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x7tk6"
Jul 02 23:17:15.486340 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:15.486301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5" event={"ID":"1bea88b7-9d1a-4853-8d34-269b6eaa25d6","Type":"ContainerStarted","Data":"e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e"}
Jul 02 23:17:15.486727 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:15.486388    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:15.512170 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:15.512121    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5" podStartSLOduration=1.148307481 podStartE2EDuration="5.512103815s" totalImagesPullingTime="4.363796334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:15.510124695 +0000 UTC m=+423.494193055" watchObservedRunningTime="2026-07-02 23:17:15.512103815 +0000 UTC m=+423.496172176"
Jul 02 23:17:16.440309 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:16.440278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-smfwb"
Jul 02 23:17:18.161871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.161830    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"]
Jul 02 23:17:18.165381 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.165362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.168077 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.168053    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 23:17:18.168416 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.168399    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 23:17:18.168686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.168669    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-txngp\""
Jul 02 23:17:18.173356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.173336    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"]
Jul 02 23:17:18.242867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.242817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk86v\" (UniqueName: \"kubernetes.io/projected/3d361d5f-7526-4909-82e3-144fa0460c6b-kube-api-access-fk86v\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.243101 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.243056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.243166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.243113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d361d5f-7526-4909-82e3-144fa0460c6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.344169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.344127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk86v\" (UniqueName: \"kubernetes.io/projected/3d361d5f-7526-4909-82e3-144fa0460c6b-kube-api-access-fk86v\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.344363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.344180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.344363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.344214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d361d5f-7526-4909-82e3-144fa0460c6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.344491 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:18.344368    2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 02 23:17:18.344491 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:18.344457    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert podName:3d361d5f-7526-4909-82e3-144fa0460c6b nodeName:}" failed. No retries permitted until 2026-07-02 23:17:18.844437703 +0000 UTC m=+426.828506052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-f5zxh" (UID: "3d361d5f-7526-4909-82e3-144fa0460c6b") : secret "plugin-serving-cert" not found
Jul 02 23:17:18.345041 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.345020    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d361d5f-7526-4909-82e3-144fa0460c6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.352515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.352491    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk86v\" (UniqueName: \"kubernetes.io/projected/3d361d5f-7526-4909-82e3-144fa0460c6b-kube-api-access-fk86v\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.848413 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.848377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:18.851119 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:18.851092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d361d5f-7526-4909-82e3-144fa0460c6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f5zxh\" (UID: \"3d361d5f-7526-4909-82e3-144fa0460c6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:19.075841 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:19.075805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"
Jul 02 23:17:19.205315 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:19.205292    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh"]
Jul 02 23:17:19.207332 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:19.207307    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d361d5f_7526_4909_82e3_144fa0460c6b.slice/crio-d7afcb2ad74ea3371ba0fb81c363bb44a34099bcccf3883e9dab770bd8b22afd WatchSource:0}: Error finding container d7afcb2ad74ea3371ba0fb81c363bb44a34099bcccf3883e9dab770bd8b22afd: Status 404 returned error can't find the container with id d7afcb2ad74ea3371ba0fb81c363bb44a34099bcccf3883e9dab770bd8b22afd
Jul 02 23:17:19.455765 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:19.455739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:19.507271 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:19.507233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh" event={"ID":"3d361d5f-7526-4909-82e3-144fa0460c6b","Type":"ContainerStarted","Data":"d7afcb2ad74ea3371ba0fb81c363bb44a34099bcccf3883e9dab770bd8b22afd"}
Jul 02 23:17:26.494745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:26.494708    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:28.568538 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.568504    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"]
Jul 02 23:17:28.569046 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.568710    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" containerName="manager" containerID="cri-o://e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e" gracePeriod=2
Jul 02 23:17:28.607504 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.607464    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:28.611351 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.611321    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"]
Jul 02 23:17:28.633352 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.633305    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"]
Jul 02 23:17:28.633714 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.633638    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerName="manager" containerID="cri-o://56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7" gracePeriod=2
Jul 02 23:17:28.636118 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.636093    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"]
Jul 02 23:17:28.637745 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.637692    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:28.640590 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.640555    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:28.669250 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669215    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:28.669709 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669690    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" containerName="manager"
Jul 02 23:17:28.669798 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669712    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" containerName="manager"
Jul 02 23:17:28.669798 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669746    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerName="manager"
Jul 02 23:17:28.669798 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669752    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerName="manager"
Jul 02 23:17:28.669997 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669818    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" containerName="manager"
Jul 02 23:17:28.669997 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.669828    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerName="manager"
Jul 02 23:17:28.674560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.674524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.687833 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.687799    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"]
Jul 02 23:17:28.691685 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.691655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:28.707800 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.707722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:28.721689 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.721085    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"]
Jul 02 23:17:28.740231 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.740188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.740407 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.740234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwjh\" (UniqueName: \"kubernetes.io/projected/36d63807-8016-4d4b-a3b6-2fd26cf02421-kube-api-access-cdwjh\") pod \"limitador-operator-controller-manager-859d7b78bd-ml5f6\" (UID: \"36d63807-8016-4d4b-a3b6-2fd26cf02421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:28.740407 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.740324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gkkj\" (UniqueName: \"kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.755028 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.754517    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:28.760220 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.760182    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:28.763264 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.763227    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:28.798810 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:28.798768    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:28.841571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.841492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gkkj\" (UniqueName: \"kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.841745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.841580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.841745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.841602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwjh\" (UniqueName: \"kubernetes.io/projected/36d63807-8016-4d4b-a3b6-2fd26cf02421-kube-api-access-cdwjh\") pod \"limitador-operator-controller-manager-859d7b78bd-ml5f6\" (UID: \"36d63807-8016-4d4b-a3b6-2fd26cf02421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:28.842088 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.842065    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:28.863255 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.863224    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwjh\" (UniqueName: \"kubernetes.io/projected/36d63807-8016-4d4b-a3b6-2fd26cf02421-kube-api-access-cdwjh\") pod \"limitador-operator-controller-manager-859d7b78bd-ml5f6\" (UID: \"36d63807-8016-4d4b-a3b6-2fd26cf02421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:28.863429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:28.863281    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gkkj\" (UniqueName: \"kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ctwr7\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:29.016897 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:29.016855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:29.026960 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:29.026934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:30.455019 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:30.454966    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.31:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 23:17:40.800085 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:40.800054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"]
Jul 02 23:17:40.830072 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:40.830041    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:40.985485 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:40.985449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d63807_8016_4d4b_a3b6_2fd26cf02421.slice/crio-91ac32e583983a4510ea5455b68f809bbb55e801236e0381e1546d82626952b2 WatchSource:0}: Error finding container 91ac32e583983a4510ea5455b68f809bbb55e801236e0381e1546d82626952b2: Status 404 returned error can't find the container with id 91ac32e583983a4510ea5455b68f809bbb55e801236e0381e1546d82626952b2
Jul 02 23:17:40.986867 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:17:40.986842    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda193d32a_3966_45e2_8e3d_d9319403778b.slice/crio-da66edce5d25c592f9aad511cc1779b76c91fd9da1f86718b74b6a8352c1292c WatchSource:0}: Error finding container da66edce5d25c592f9aad511cc1779b76c91fd9da1f86718b74b6a8352c1292c: Status 404 returned error can't find the container with id da66edce5d25c592f9aad511cc1779b76c91fd9da1f86718b74b6a8352c1292c
Jul 02 23:17:41.020784 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.020756    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.023339 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.023302    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.037326 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.037303    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.039971 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.039941    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.042717 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.042685    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.153970 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.153936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flbwb\" (UniqueName: \"kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb\") pod \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") "
Jul 02 23:17:41.154135 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.154019    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume\") pod \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\" (UID: \"1bea88b7-9d1a-4853-8d34-269b6eaa25d6\") "
Jul 02 23:17:41.154135 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.154082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bljdm\" (UniqueName: \"kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm\") pod \"1e355ce7-3963-4d98-81ea-29e3831f0f47\" (UID: \"1e355ce7-3963-4d98-81ea-29e3831f0f47\") "
Jul 02 23:17:41.154486 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.154461    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1bea88b7-9d1a-4853-8d34-269b6eaa25d6" (UID: "1bea88b7-9d1a-4853-8d34-269b6eaa25d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:17:41.155903 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.155867    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb" (OuterVolumeSpecName: "kube-api-access-flbwb") pod "1bea88b7-9d1a-4853-8d34-269b6eaa25d6" (UID: "1bea88b7-9d1a-4853-8d34-269b6eaa25d6"). InnerVolumeSpecName "kube-api-access-flbwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:17:41.156039 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.156023    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm" (OuterVolumeSpecName: "kube-api-access-bljdm") pod "1e355ce7-3963-4d98-81ea-29e3831f0f47" (UID: "1e355ce7-3963-4d98-81ea-29e3831f0f47"). InnerVolumeSpecName "kube-api-access-bljdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:17:41.255271 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.255236    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bljdm\" (UniqueName: \"kubernetes.io/projected/1e355ce7-3963-4d98-81ea-29e3831f0f47-kube-api-access-bljdm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:17:41.255560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.255540    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flbwb\" (UniqueName: \"kubernetes.io/projected/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-kube-api-access-flbwb\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:17:41.255608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.255575    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bea88b7-9d1a-4853-8d34-269b6eaa25d6-extensions-socket-volume\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:17:41.625641 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.625555    2573 generic.go:356] "Generic (PLEG): container finished" podID="1e355ce7-3963-4d98-81ea-29e3831f0f47" containerID="56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7" exitCode=0
Jul 02 23:17:41.625641 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.625596    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.625847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.625652    2573 scope.go:117] "RemoveContainer" containerID="56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7"
Jul 02 23:17:41.628749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.628219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh" event={"ID":"3d361d5f-7526-4909-82e3-144fa0460c6b","Type":"ContainerStarted","Data":"6defba6db0d812293dc7bb737a98773461b58c4bb957405bdb4a32c56d053cde"}
Jul 02 23:17:41.630514 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.630355    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.631527 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.631403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" event={"ID":"a193d32a-3966-45e2-8e3d-d9319403778b","Type":"ContainerStarted","Data":"cdf37c35dda9f739dd1f219039168bdf64964eda20528b79f67747b136e761e1"}
Jul 02 23:17:41.631527 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.631454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" event={"ID":"a193d32a-3966-45e2-8e3d-d9319403778b","Type":"ContainerStarted","Data":"da66edce5d25c592f9aad511cc1779b76c91fd9da1f86718b74b6a8352c1292c"}
Jul 02 23:17:41.631711 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.631528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:41.633628 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.633604    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.634098 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.634058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6" event={"ID":"36d63807-8016-4d4b-a3b6-2fd26cf02421","Type":"ContainerStarted","Data":"1f6f82d635cef68ba8a14675b400b8f13686f2d92bffe2fe09a1586ecfd1d529"}
Jul 02 23:17:41.634173 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.634129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:17:41.634173 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.634156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6" event={"ID":"36d63807-8016-4d4b-a3b6-2fd26cf02421","Type":"ContainerStarted","Data":"91ac32e583983a4510ea5455b68f809bbb55e801236e0381e1546d82626952b2"}
Jul 02 23:17:41.635598 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.635576    2573 generic.go:356] "Generic (PLEG): container finished" podID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" containerID="e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e" exitCode=0
Jul 02 23:17:41.635665 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.635624    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.638000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.637795    2573 scope.go:117] "RemoveContainer" containerID="56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7"
Jul 02 23:17:41.638098 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.638078    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7\": container with ID starting with 56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7 not found: ID does not exist" containerID="56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7"
Jul 02 23:17:41.638144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.638105    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7"} err="failed to get container status \"56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7\": rpc error: code = NotFound desc = could not find container \"56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7\": container with ID starting with 56ed37e6b36c68945b3deb9f1b2ab97d0a97fc35a72e8dce464c63140edaaab7 not found: ID does not exist"
Jul 02 23:17:41.638144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.638122    2573 scope.go:117] "RemoveContainer" containerID="e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e"
Jul 02 23:17:41.646439 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.646422    2573 scope.go:117] "RemoveContainer" containerID="e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e"
Jul 02 23:17:41.647101 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.647078    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e\": container with ID starting with e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e not found: ID does not exist" containerID="e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e"
Jul 02 23:17:41.647222 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.647110    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e"} err="failed to get container status \"e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e\": rpc error: code = NotFound desc = could not find container \"e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e\": container with ID starting with e0844e106a16c20cf14e7ba8eeeec6b27a523318b7876e32296ea5d79686f08e not found: ID does not exist"
Jul 02 23:17:41.671796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.671749    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" podStartSLOduration=13.671733585 podStartE2EDuration="13.671733585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:41.671158826 +0000 UTC m=+449.655227185" watchObservedRunningTime="2026-07-02 23:17:41.671733585 +0000 UTC m=+449.655801983"
Jul 02 23:17:41.674072 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.674047    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.676567 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.676546    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.700474 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.700425    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f5zxh" podStartSLOduration=1.7205802239999999 podStartE2EDuration="23.700409028s" totalImagesPullingTime="21.979828804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:41.700060363 +0000 UTC m=+449.684128734" watchObservedRunningTime="2026-07-02 23:17:41.700409028 +0000 UTC m=+449.684477388"
Jul 02 23:17:41.703335 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.703312    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:41.705661 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:41.705642    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:41.748508 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:41.748452    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6" podStartSLOduration=13.748434702 podStartE2EDuration="13.748434702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:41.746826488 +0000 UTC m=+449.730894849" watchObservedRunningTime="2026-07-02 23:17:41.748434702 +0000 UTC m=+449.732503063"
Jul 02 23:17:42.532765 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:42.532721    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqpxz\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqpxz"
Jul 02 23:17:42.534329 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:42.534308    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" path="/var/lib/kubelet/pods/1bea88b7-9d1a-4853-8d34-269b6eaa25d6/volumes"
Jul 02 23:17:42.534627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:42.534616    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e355ce7-3963-4d98-81ea-29e3831f0f47" path="/var/lib/kubelet/pods/1e355ce7-3963-4d98-81ea-29e3831f0f47/volumes"
Jul 02 23:17:42.535095 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:17:42.535074    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dvg5\" is forbidden: User \"system:node:ip-10-0-141-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-125.ec2.internal' and this object" podUID="1bea88b7-9d1a-4853-8d34-269b6eaa25d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dvg5"
Jul 02 23:17:46.495852 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.495814    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:46.496281 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.496025    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" podUID="a193d32a-3966-45e2-8e3d-d9319403778b" containerName="manager" containerID="cri-o://cdf37c35dda9f739dd1f219039168bdf64964eda20528b79f67747b136e761e1" gracePeriod=10
Jul 02 23:17:46.498162 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.498137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:46.661678 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.661647    2573 generic.go:356] "Generic (PLEG): container finished" podID="a193d32a-3966-45e2-8e3d-d9319403778b" containerID="cdf37c35dda9f739dd1f219039168bdf64964eda20528b79f67747b136e761e1" exitCode=0
Jul 02 23:17:46.661851 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.661721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" event={"ID":"a193d32a-3966-45e2-8e3d-d9319403778b","Type":"ContainerDied","Data":"cdf37c35dda9f739dd1f219039168bdf64964eda20528b79f67747b136e761e1"}
Jul 02 23:17:46.743836 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.743813    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:46.906466 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.906380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume\") pod \"a193d32a-3966-45e2-8e3d-d9319403778b\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") "
Jul 02 23:17:46.906623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.906478    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gkkj\" (UniqueName: \"kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj\") pod \"a193d32a-3966-45e2-8e3d-d9319403778b\" (UID: \"a193d32a-3966-45e2-8e3d-d9319403778b\") "
Jul 02 23:17:46.906734 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.906712    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a193d32a-3966-45e2-8e3d-d9319403778b" (UID: "a193d32a-3966-45e2-8e3d-d9319403778b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:17:46.908601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:46.908573    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj" (OuterVolumeSpecName: "kube-api-access-5gkkj") pod "a193d32a-3966-45e2-8e3d-d9319403778b" (UID: "a193d32a-3966-45e2-8e3d-d9319403778b"). InnerVolumeSpecName "kube-api-access-5gkkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:17:47.007176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.007140    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a193d32a-3966-45e2-8e3d-d9319403778b-extensions-socket-volume\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:17:47.007176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.007170    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gkkj\" (UniqueName: \"kubernetes.io/projected/a193d32a-3966-45e2-8e3d-d9319403778b-kube-api-access-5gkkj\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:17:47.667613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.667588    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"
Jul 02 23:17:47.667613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.667600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7" event={"ID":"a193d32a-3966-45e2-8e3d-d9319403778b","Type":"ContainerDied","Data":"da66edce5d25c592f9aad511cc1779b76c91fd9da1f86718b74b6a8352c1292c"}
Jul 02 23:17:47.668132 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.667654    2573 scope.go:117] "RemoveContainer" containerID="cdf37c35dda9f739dd1f219039168bdf64964eda20528b79f67747b136e761e1"
Jul 02 23:17:47.693203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.693150    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:47.698914 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:47.698871    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ctwr7"]
Jul 02 23:17:48.534012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:48.533980    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a193d32a-3966-45e2-8e3d-d9319403778b" path="/var/lib/kubelet/pods/a193d32a-3966-45e2-8e3d-d9319403778b/volumes"
Jul 02 23:17:52.645268 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:17:52.645239    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ml5f6"
Jul 02 23:18:02.987941 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:02.987865    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"]
Jul 02 23:18:02.988601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:02.988347    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a193d32a-3966-45e2-8e3d-d9319403778b" containerName="manager"
Jul 02 23:18:02.988601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:02.988364    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a193d32a-3966-45e2-8e3d-d9319403778b" containerName="manager"
Jul 02 23:18:02.988601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:02.988481    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a193d32a-3966-45e2-8e3d-d9319403778b" containerName="manager"
Jul 02 23:18:02.997052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:02.997024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.000295 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.000270    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-twzln\""
Jul 02 23:18:03.012607 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.012577    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"]
Jul 02 23:18:03.047201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvjx\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-kube-api-access-2tvjx\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.047540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.047517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvjx\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-kube-api-access-2tvjx\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148774 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148774 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148774 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148704    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.148948 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.149005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.148962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.149339 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.149316    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.151033 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.151015    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.151423 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.151402    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.161064 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.161043    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.161344 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.161327    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvjx\" (UniqueName: \"kubernetes.io/projected/3cfd6a21-d50c-44c9-8887-1a4784a58d7c-kube-api-access-2tvjx\") pod \"maas-default-gateway-openshift-default-56654dcf7-xts26\" (UID: \"3cfd6a21-d50c-44c9-8887-1a4784a58d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.307620 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.307529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:03.457503 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.457482    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"]
Jul 02 23:18:03.459522 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:03.459483    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfd6a21_d50c_44c9_8887_1a4784a58d7c.slice/crio-9122fca6700eac8d6aecccf010e3f0fe1191aa535201848bbd78dd206e965ae9 WatchSource:0}: Error finding container 9122fca6700eac8d6aecccf010e3f0fe1191aa535201848bbd78dd206e965ae9: Status 404 returned error can't find the container with id 9122fca6700eac8d6aecccf010e3f0fe1191aa535201848bbd78dd206e965ae9
Jul 02 23:18:03.461601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.461569    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:18:03.461671 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.461635    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:18:03.461671 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.461664    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:18:03.748847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.748815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" event={"ID":"3cfd6a21-d50c-44c9-8887-1a4784a58d7c","Type":"ContainerStarted","Data":"59ef3c9ec7b284793107135d8fabbf30534cd9d4a6786c4445112e4c2f8f8cd3"}
Jul 02 23:18:03.749034 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.748869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" event={"ID":"3cfd6a21-d50c-44c9-8887-1a4784a58d7c","Type":"ContainerStarted","Data":"9122fca6700eac8d6aecccf010e3f0fe1191aa535201848bbd78dd206e965ae9"}
Jul 02 23:18:03.772472 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:03.772424    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" podStartSLOduration=1.7724053610000001 podStartE2EDuration="1.772405361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:03.771594972 +0000 UTC m=+471.755663331" watchObservedRunningTime="2026-07-02 23:18:03.772405361 +0000 UTC m=+471.756473724"
Jul 02 23:18:04.308685 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.308651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:04.313531 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.313509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:04.753573 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.753540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:04.754486 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.754466    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:18:04.868900 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.868859    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:04.908475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.908442    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:04.908636 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.908558    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:04.916022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.915744    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 23:18:04.965748 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.965712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45npn\" (UniqueName: \"kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:04.965921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.965775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:04.980916 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:04.980871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:05.066771 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.066672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45npn\" (UniqueName: \"kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:05.066771 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.066736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:05.067393 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.067368    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:05.077609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.077580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45npn\" (UniqueName: \"kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn\") pod \"limitador-limitador-64c94fd64f-bqgzd\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:05.219069 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.219030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:05.386720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.386694    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:05.388977 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:05.388951    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831c40e9_9256_4443_af1b_bcbce0ad391a.slice/crio-cd6dd4456b5f3edb656e4bb6378a6def3a4e1761e45cf360c03b60e9f3271b93 WatchSource:0}: Error finding container cd6dd4456b5f3edb656e4bb6378a6def3a4e1761e45cf360c03b60e9f3271b93: Status 404 returned error can't find the container with id cd6dd4456b5f3edb656e4bb6378a6def3a4e1761e45cf360c03b60e9f3271b93
Jul 02 23:18:05.760381 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.760347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" event={"ID":"831c40e9-9256-4443-af1b-bcbce0ad391a","Type":"ContainerStarted","Data":"cd6dd4456b5f3edb656e4bb6378a6def3a4e1761e45cf360c03b60e9f3271b93"}
Jul 02 23:18:05.815631 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.815593    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:05.973858 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.973823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:05.974062 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.973946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:05.976820 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:05.976798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bbmch\""
Jul 02 23:18:06.075523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.075448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92w9c\" (UniqueName: \"kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c\") pod \"authorino-58cd955675-9fc89\" (UID: \"017814ff-0ad4-4990-b1dc-f0b960775700\") " pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:06.176409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.176373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92w9c\" (UniqueName: \"kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c\") pod \"authorino-58cd955675-9fc89\" (UID: \"017814ff-0ad4-4990-b1dc-f0b960775700\") " pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:06.191463 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.191433    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92w9c\" (UniqueName: \"kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c\") pod \"authorino-58cd955675-9fc89\" (UID: \"017814ff-0ad4-4990-b1dc-f0b960775700\") " pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:06.283970 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.283934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:06.439653 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.439631    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:06.441229 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:06.441194    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod017814ff_0ad4_4990_b1dc_f0b960775700.slice/crio-681c5865468f82f93246b50bd69edd17302595ffb27ebe1aa8e427688b5d88ea WatchSource:0}: Error finding container 681c5865468f82f93246b50bd69edd17302595ffb27ebe1aa8e427688b5d88ea: Status 404 returned error can't find the container with id 681c5865468f82f93246b50bd69edd17302595ffb27ebe1aa8e427688b5d88ea
Jul 02 23:18:06.769004 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:06.768954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fc89" event={"ID":"017814ff-0ad4-4990-b1dc-f0b960775700","Type":"ContainerStarted","Data":"681c5865468f82f93246b50bd69edd17302595ffb27ebe1aa8e427688b5d88ea"}
Jul 02 23:18:10.963752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:10.963697    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:11.799540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.799501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" event={"ID":"831c40e9-9256-4443-af1b-bcbce0ad391a","Type":"ContainerStarted","Data":"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"}
Jul 02 23:18:11.799714 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.799599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:11.801292 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.801264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fc89" event={"ID":"017814ff-0ad4-4990-b1dc-f0b960775700","Type":"ContainerStarted","Data":"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"}
Jul 02 23:18:11.801435 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.801299    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9fc89" podUID="017814ff-0ad4-4990-b1dc-f0b960775700" containerName="authorino" containerID="cri-o://2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab" gracePeriod=30
Jul 02 23:18:11.818721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.818678    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" podStartSLOduration=1.6520459889999999 podStartE2EDuration="7.818662731s" totalImagesPullingTime="6.166616742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:11.81818558 +0000 UTC m=+479.802253950" watchObservedRunningTime="2026-07-02 23:18:11.818662731 +0000 UTC m=+479.802731090"
Jul 02 23:18:11.835844 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:11.835795    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9fc89" podStartSLOduration=1.719700402 podStartE2EDuration="6.835777695s" totalImagesPullingTime="5.116077293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:11.834217809 +0000 UTC m=+479.818286168" watchObservedRunningTime="2026-07-02 23:18:11.835777695 +0000 UTC m=+479.819846055"
Jul 02 23:18:12.052761 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.052737    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:12.133182 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.133095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92w9c\" (UniqueName: \"kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c\") pod \"017814ff-0ad4-4990-b1dc-f0b960775700\" (UID: \"017814ff-0ad4-4990-b1dc-f0b960775700\") "
Jul 02 23:18:12.135181 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.135159    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c" (OuterVolumeSpecName: "kube-api-access-92w9c") pod "017814ff-0ad4-4990-b1dc-f0b960775700" (UID: "017814ff-0ad4-4990-b1dc-f0b960775700"). InnerVolumeSpecName "kube-api-access-92w9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:12.233947 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.233909    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92w9c\" (UniqueName: \"kubernetes.io/projected/017814ff-0ad4-4990-b1dc-f0b960775700-kube-api-access-92w9c\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.807193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.807097    2573 generic.go:356] "Generic (PLEG): container finished" podID="017814ff-0ad4-4990-b1dc-f0b960775700" containerID="2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab" exitCode=0
Jul 02 23:18:12.807193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.807152    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fc89"
Jul 02 23:18:12.807193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.807180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fc89" event={"ID":"017814ff-0ad4-4990-b1dc-f0b960775700","Type":"ContainerDied","Data":"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"}
Jul 02 23:18:12.807465 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.807221    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fc89" event={"ID":"017814ff-0ad4-4990-b1dc-f0b960775700","Type":"ContainerDied","Data":"681c5865468f82f93246b50bd69edd17302595ffb27ebe1aa8e427688b5d88ea"}
Jul 02 23:18:12.807465 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.807241    2573 scope.go:117] "RemoveContainer" containerID="2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"
Jul 02 23:18:12.815686 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.815666    2573 scope.go:117] "RemoveContainer" containerID="2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"
Jul 02 23:18:12.815982 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:18:12.815962    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab\": container with ID starting with 2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab not found: ID does not exist" containerID="2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"
Jul 02 23:18:12.816058 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.815990    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab"} err="failed to get container status \"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab\": rpc error: code = NotFound desc = could not find container \"2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab\": container with ID starting with 2e813aed2dc9032b83619e56ca921f66f115125d35c84e086623b50e280ca9ab not found: ID does not exist"
Jul 02 23:18:12.823989 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.823964    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:12.828116 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:12.828098    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fc89"]
Jul 02 23:18:14.534766 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:14.534735    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="017814ff-0ad4-4990-b1dc-f0b960775700" path="/var/lib/kubelet/pods/017814ff-0ad4-4990-b1dc-f0b960775700/volumes"
Jul 02 23:18:21.959291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:21.959247    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:21.960052 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:21.959495    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" podUID="831c40e9-9256-4443-af1b-bcbce0ad391a" containerName="limitador" containerID="cri-o://af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900" gracePeriod=30
Jul 02 23:18:21.961939 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:21.961920    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:22.521334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.521270    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:22.619335 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.619304    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file\") pod \"831c40e9-9256-4443-af1b-bcbce0ad391a\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") "
Jul 02 23:18:22.619532 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.619420    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45npn\" (UniqueName: \"kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn\") pod \"831c40e9-9256-4443-af1b-bcbce0ad391a\" (UID: \"831c40e9-9256-4443-af1b-bcbce0ad391a\") "
Jul 02 23:18:22.619730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.619704    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file" (OuterVolumeSpecName: "config-file") pod "831c40e9-9256-4443-af1b-bcbce0ad391a" (UID: "831c40e9-9256-4443-af1b-bcbce0ad391a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:18:22.621753 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.621729    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn" (OuterVolumeSpecName: "kube-api-access-45npn") pod "831c40e9-9256-4443-af1b-bcbce0ad391a" (UID: "831c40e9-9256-4443-af1b-bcbce0ad391a"). InnerVolumeSpecName "kube-api-access-45npn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:22.720848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.720811    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/831c40e9-9256-4443-af1b-bcbce0ad391a-config-file\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:18:22.720848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.720841    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45npn\" (UniqueName: \"kubernetes.io/projected/831c40e9-9256-4443-af1b-bcbce0ad391a-kube-api-access-45npn\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:18:22.857104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.857018    2573 generic.go:356] "Generic (PLEG): container finished" podID="831c40e9-9256-4443-af1b-bcbce0ad391a" containerID="af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900" exitCode=0
Jul 02 23:18:22.857104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.857066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" event={"ID":"831c40e9-9256-4443-af1b-bcbce0ad391a","Type":"ContainerDied","Data":"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"}
Jul 02 23:18:22.857104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.857087    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"
Jul 02 23:18:22.857344 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.857132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bqgzd" event={"ID":"831c40e9-9256-4443-af1b-bcbce0ad391a","Type":"ContainerDied","Data":"cd6dd4456b5f3edb656e4bb6378a6def3a4e1761e45cf360c03b60e9f3271b93"}
Jul 02 23:18:22.857344 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.857154    2573 scope.go:117] "RemoveContainer" containerID="af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"
Jul 02 23:18:22.866260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.866242    2573 scope.go:117] "RemoveContainer" containerID="af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"
Jul 02 23:18:22.866529 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:18:22.866509    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900\": container with ID starting with af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900 not found: ID does not exist" containerID="af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"
Jul 02 23:18:22.866594 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.866542    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900"} err="failed to get container status \"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900\": rpc error: code = NotFound desc = could not find container \"af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900\": container with ID starting with af8181bdd925e35816a8a7a3dfdeb2172cb55db58e3355c43920da26101b2900 not found: ID does not exist"
Jul 02 23:18:22.881930 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.881901    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:22.887731 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:22.887708    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bqgzd"]
Jul 02 23:18:24.535678 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:24.535642    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831c40e9-9256-4443-af1b-bcbce0ad391a" path="/var/lib/kubelet/pods/831c40e9-9256-4443-af1b-bcbce0ad391a/volumes"
Jul 02 23:18:26.363548 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.363515    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-7ccrp"]
Jul 02 23:18:26.364104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364085    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831c40e9-9256-4443-af1b-bcbce0ad391a" containerName="limitador"
Jul 02 23:18:26.364157 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364107    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="831c40e9-9256-4443-af1b-bcbce0ad391a" containerName="limitador"
Jul 02 23:18:26.364157 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364135    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="017814ff-0ad4-4990-b1dc-f0b960775700" containerName="authorino"
Jul 02 23:18:26.364157 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364144    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="017814ff-0ad4-4990-b1dc-f0b960775700" containerName="authorino"
Jul 02 23:18:26.364246 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364234    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="831c40e9-9256-4443-af1b-bcbce0ad391a" containerName="limitador"
Jul 02 23:18:26.364280 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.364247    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="017814ff-0ad4-4990-b1dc-f0b960775700" containerName="authorino"
Jul 02 23:18:26.368759 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.368739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.371670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.371649    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 23:18:26.371858 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.371839    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zjrc\""
Jul 02 23:18:26.375627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.375600    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7ccrp"]
Jul 02 23:18:26.458336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.458301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddc0c614-1680-4d08-ba43-9e737b0a12e4-data\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.458551 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.458364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9gm\" (UniqueName: \"kubernetes.io/projected/ddc0c614-1680-4d08-ba43-9e737b0a12e4-kube-api-access-pg9gm\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.559320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.559288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9gm\" (UniqueName: \"kubernetes.io/projected/ddc0c614-1680-4d08-ba43-9e737b0a12e4-kube-api-access-pg9gm\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.559482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.559376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddc0c614-1680-4d08-ba43-9e737b0a12e4-data\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.559699 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.559684    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddc0c614-1680-4d08-ba43-9e737b0a12e4-data\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.578709 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.578682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9gm\" (UniqueName: \"kubernetes.io/projected/ddc0c614-1680-4d08-ba43-9e737b0a12e4-kube-api-access-pg9gm\") pod \"postgres-69fb4594cf-7ccrp\" (UID: \"ddc0c614-1680-4d08-ba43-9e737b0a12e4\") " pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.681499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.681465    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:26.814146 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.814119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7ccrp"]
Jul 02 23:18:26.815549 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:26.815513    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc0c614_1680_4d08_ba43_9e737b0a12e4.slice/crio-e4b12fd1eb34ce2f864ef8e8feefe91d5b2c18794e8281692406952b64477097 WatchSource:0}: Error finding container e4b12fd1eb34ce2f864ef8e8feefe91d5b2c18794e8281692406952b64477097: Status 404 returned error can't find the container with id e4b12fd1eb34ce2f864ef8e8feefe91d5b2c18794e8281692406952b64477097
Jul 02 23:18:26.879384 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:26.879349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7ccrp" event={"ID":"ddc0c614-1680-4d08-ba43-9e737b0a12e4","Type":"ContainerStarted","Data":"e4b12fd1eb34ce2f864ef8e8feefe91d5b2c18794e8281692406952b64477097"}
Jul 02 23:18:31.907452 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:31.907355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7ccrp" event={"ID":"ddc0c614-1680-4d08-ba43-9e737b0a12e4","Type":"ContainerStarted","Data":"e30ae1a020ea4f6ecfdb10f0ae7920bb77ecb3f53d076a6c238d99ddf6ab1714"}
Jul 02 23:18:31.907811 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:31.907454    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:31.923373 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:31.923329    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-7ccrp" podStartSLOduration=1.10621944 podStartE2EDuration="5.923316099s" totalImagesPullingTime="4.817096659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:31.922877979 +0000 UTC m=+499.906946336" watchObservedRunningTime="2026-07-02 23:18:31.923316099 +0000 UTC m=+499.907384460"
Jul 02 23:18:37.941433 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:37.941404    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-7ccrp"
Jul 02 23:18:38.474266 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.474234    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:38.480670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.480652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:38.483269 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.483250    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bbmch\""
Jul 02 23:18:38.487831 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.487810    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:38.566054 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.566016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fdgb\" (UniqueName: \"kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb\") pod \"authorino-5d4b67c446-trdlz\" (UID: \"135e5baf-7acf-430d-af91-3e0db1fbf649\") " pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:38.666513 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.666476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fdgb\" (UniqueName: \"kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb\") pod \"authorino-5d4b67c446-trdlz\" (UID: \"135e5baf-7acf-430d-af91-3e0db1fbf649\") " pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:38.674727 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.674701    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fdgb\" (UniqueName: \"kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb\") pod \"authorino-5d4b67c446-trdlz\" (UID: \"135e5baf-7acf-430d-af91-3e0db1fbf649\") " pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:38.716990 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.716954    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:38.717239 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.717226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:38.749824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.749791    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:38.754304 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.754275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:38.764502 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.764475    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:38.854465 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.854441    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:38.857053 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:38.857029    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod135e5baf_7acf_430d_af91_3e0db1fbf649.slice/crio-6e2717f2d81cb6db485caf1ac23c4fb2fd48443113fc2eef3a0bc43a50c7a35b WatchSource:0}: Error finding container 6e2717f2d81cb6db485caf1ac23c4fb2fd48443113fc2eef3a0bc43a50c7a35b: Status 404 returned error can't find the container with id 6e2717f2d81cb6db485caf1ac23c4fb2fd48443113fc2eef3a0bc43a50c7a35b
Jul 02 23:18:38.868286 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.868265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwrxh\" (UniqueName: \"kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh\") pod \"authorino-fff68645-4kk9r\" (UID: \"6759401c-c8f2-4b55-a4f9-6ac9bd33e594\") " pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:38.941468 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.941432    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-trdlz" event={"ID":"135e5baf-7acf-430d-af91-3e0db1fbf649","Type":"ContainerStarted","Data":"6e2717f2d81cb6db485caf1ac23c4fb2fd48443113fc2eef3a0bc43a50c7a35b"}
Jul 02 23:18:38.969618 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.969586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwrxh\" (UniqueName: \"kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh\") pod \"authorino-fff68645-4kk9r\" (UID: \"6759401c-c8f2-4b55-a4f9-6ac9bd33e594\") " pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:38.978819 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:38.978741    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwrxh\" (UniqueName: \"kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh\") pod \"authorino-fff68645-4kk9r\" (UID: \"6759401c-c8f2-4b55-a4f9-6ac9bd33e594\") " pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:39.008313 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.008278    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:39.008539 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.008528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:39.037304 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.037268    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:18:39.041542 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.041516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.044211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.044187    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 23:18:39.050280 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.050235    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:18:39.140899 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.140858    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:39.142412 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:39.142375    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6759401c_c8f2_4b55_a4f9_6ac9bd33e594.slice/crio-65ef5b6f51599776068b9e5575f0377632c12e82c8363baa95e322a343e580cf WatchSource:0}: Error finding container 65ef5b6f51599776068b9e5575f0377632c12e82c8363baa95e322a343e580cf: Status 404 returned error can't find the container with id 65ef5b6f51599776068b9e5575f0377632c12e82c8363baa95e322a343e580cf
Jul 02 23:18:39.171123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.171093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.171244 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.171129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts96d\" (UniqueName: \"kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.272475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.272438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.272475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.272477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts96d\" (UniqueName: \"kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.274837 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.274813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.281123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.281100    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts96d\" (UniqueName: \"kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d\") pod \"authorino-5f4f87699c-zqq8b\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") " pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.353543 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.353503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:18:39.485703 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.485679    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:18:39.487675 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:39.487649    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cc3ba2b_c775_4d5d_921b_33d3c90ae3bd.slice/crio-db5e9462293c983189b47a763c1be1a237f96f8ba3e14c4e5be9b182a49755a7 WatchSource:0}: Error finding container db5e9462293c983189b47a763c1be1a237f96f8ba3e14c4e5be9b182a49755a7: Status 404 returned error can't find the container with id db5e9462293c983189b47a763c1be1a237f96f8ba3e14c4e5be9b182a49755a7
Jul 02 23:18:39.949114 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.949061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fff68645-4kk9r" event={"ID":"6759401c-c8f2-4b55-a4f9-6ac9bd33e594","Type":"ContainerStarted","Data":"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"}
Jul 02 23:18:39.949570 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.949091    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fff68645-4kk9r" podUID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" containerName="authorino" containerID="cri-o://5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed" gracePeriod=30
Jul 02 23:18:39.949570 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.949133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fff68645-4kk9r" event={"ID":"6759401c-c8f2-4b55-a4f9-6ac9bd33e594","Type":"ContainerStarted","Data":"65ef5b6f51599776068b9e5575f0377632c12e82c8363baa95e322a343e580cf"}
Jul 02 23:18:39.951286 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.951215    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-trdlz" event={"ID":"135e5baf-7acf-430d-af91-3e0db1fbf649","Type":"ContainerStarted","Data":"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"}
Jul 02 23:18:39.951422 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.951291    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-trdlz" podUID="135e5baf-7acf-430d-af91-3e0db1fbf649" containerName="authorino" containerID="cri-o://a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1" gracePeriod=30
Jul 02 23:18:39.953030 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.953007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" event={"ID":"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd","Type":"ContainerStarted","Data":"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"}
Jul 02 23:18:39.953159 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.953038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" event={"ID":"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd","Type":"ContainerStarted","Data":"db5e9462293c983189b47a763c1be1a237f96f8ba3e14c4e5be9b182a49755a7"}
Jul 02 23:18:39.964488 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.964437    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fff68645-4kk9r" podStartSLOduration=1.448794876 podStartE2EDuration="1.964417083s" totalImagesPullingTime="515.622207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:39.963236741 +0000 UTC m=+507.947305102" watchObservedRunningTime="2026-07-02 23:18:39.964417083 +0000 UTC m=+507.948485444"
Jul 02 23:18:39.977831 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.977783    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" podStartSLOduration=0.673691334 podStartE2EDuration="977.768949ms" totalImagesPullingTime="304.077615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:39.977021136 +0000 UTC m=+507.961089496" watchObservedRunningTime="2026-07-02 23:18:39.977768949 +0000 UTC m=+507.961837330"
Jul 02 23:18:39.992525 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:39.992477    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-trdlz" podStartSLOduration=1.665960766 podStartE2EDuration="1.992460883s" totalImagesPullingTime="326.500117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:39.991348467 +0000 UTC m=+507.975416827" watchObservedRunningTime="2026-07-02 23:18:39.992460883 +0000 UTC m=+507.976529242"
Jul 02 23:18:40.212184 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.212157    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:40.220042 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.220021    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:40.383116 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.383039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fdgb\" (UniqueName: \"kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb\") pod \"135e5baf-7acf-430d-af91-3e0db1fbf649\" (UID: \"135e5baf-7acf-430d-af91-3e0db1fbf649\") "
Jul 02 23:18:40.383116 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.383091    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwrxh\" (UniqueName: \"kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh\") pod \"6759401c-c8f2-4b55-a4f9-6ac9bd33e594\" (UID: \"6759401c-c8f2-4b55-a4f9-6ac9bd33e594\") "
Jul 02 23:18:40.385277 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.385241    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb" (OuterVolumeSpecName: "kube-api-access-4fdgb") pod "135e5baf-7acf-430d-af91-3e0db1fbf649" (UID: "135e5baf-7acf-430d-af91-3e0db1fbf649"). InnerVolumeSpecName "kube-api-access-4fdgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:40.385277 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.385270    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh" (OuterVolumeSpecName: "kube-api-access-fwrxh") pod "6759401c-c8f2-4b55-a4f9-6ac9bd33e594" (UID: "6759401c-c8f2-4b55-a4f9-6ac9bd33e594"). InnerVolumeSpecName "kube-api-access-fwrxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:40.484526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.484495    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fdgb\" (UniqueName: \"kubernetes.io/projected/135e5baf-7acf-430d-af91-3e0db1fbf649-kube-api-access-4fdgb\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:18:40.484526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.484521    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwrxh\" (UniqueName: \"kubernetes.io/projected/6759401c-c8f2-4b55-a4f9-6ac9bd33e594-kube-api-access-fwrxh\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:18:40.960566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.960470    2573 generic.go:356] "Generic (PLEG): container finished" podID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" containerID="5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed" exitCode=0
Jul 02 23:18:40.960566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.960511    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fff68645-4kk9r"
Jul 02 23:18:40.961143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.960562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fff68645-4kk9r" event={"ID":"6759401c-c8f2-4b55-a4f9-6ac9bd33e594","Type":"ContainerDied","Data":"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"}
Jul 02 23:18:40.961143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.960606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fff68645-4kk9r" event={"ID":"6759401c-c8f2-4b55-a4f9-6ac9bd33e594","Type":"ContainerDied","Data":"65ef5b6f51599776068b9e5575f0377632c12e82c8363baa95e322a343e580cf"}
Jul 02 23:18:40.961143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.960627    2573 scope.go:117] "RemoveContainer" containerID="5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"
Jul 02 23:18:40.962144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.961952    2573 generic.go:356] "Generic (PLEG): container finished" podID="135e5baf-7acf-430d-af91-3e0db1fbf649" containerID="a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1" exitCode=0
Jul 02 23:18:40.962144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.962010    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-trdlz"
Jul 02 23:18:40.962144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.962040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-trdlz" event={"ID":"135e5baf-7acf-430d-af91-3e0db1fbf649","Type":"ContainerDied","Data":"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"}
Jul 02 23:18:40.962144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.962078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-trdlz" event={"ID":"135e5baf-7acf-430d-af91-3e0db1fbf649","Type":"ContainerDied","Data":"6e2717f2d81cb6db485caf1ac23c4fb2fd48443113fc2eef3a0bc43a50c7a35b"}
Jul 02 23:18:40.970362 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.970342    2573 scope.go:117] "RemoveContainer" containerID="5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"
Jul 02 23:18:40.970621 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:18:40.970604    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed\": container with ID starting with 5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed not found: ID does not exist" containerID="5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"
Jul 02 23:18:40.970694 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.970629    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed"} err="failed to get container status \"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed\": rpc error: code = NotFound desc = could not find container \"5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed\": container with ID starting with 5deed3e491ade838816872f5f2515f0ed9f38fb150340b9917e7a6cdfcfbc4ed not found: ID does not exist"
Jul 02 23:18:40.970694 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.970646    2573 scope.go:117] "RemoveContainer" containerID="a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"
Jul 02 23:18:40.978322 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.978300    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:40.979337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.979321    2573 scope.go:117] "RemoveContainer" containerID="a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"
Jul 02 23:18:40.979661 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:18:40.979637    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1\": container with ID starting with a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1 not found: ID does not exist" containerID="a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"
Jul 02 23:18:40.979757 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.979667    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1"} err="failed to get container status \"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1\": rpc error: code = NotFound desc = could not find container \"a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1\": container with ID starting with a17b7447e61da6959acb320490e753bf933626975140dff45aced784d7e205b1 not found: ID does not exist"
Jul 02 23:18:40.981920 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.981900    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fff68645-4kk9r"]
Jul 02 23:18:40.995402 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.995369    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:40.999201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:40.999176    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-trdlz"]
Jul 02 23:18:42.535664 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:42.535635    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135e5baf-7acf-430d-af91-3e0db1fbf649" path="/var/lib/kubelet/pods/135e5baf-7acf-430d-af91-3e0db1fbf649/volumes"
Jul 02 23:18:42.536060 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:42.535986    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" path="/var/lib/kubelet/pods/6759401c-c8f2-4b55-a4f9-6ac9bd33e594/volumes"
Jul 02 23:18:44.779016 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.778975    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:18:44.779564 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779544    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" containerName="authorino"
Jul 02 23:18:44.779650 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779566    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" containerName="authorino"
Jul 02 23:18:44.779650 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779583    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135e5baf-7acf-430d-af91-3e0db1fbf649" containerName="authorino"
Jul 02 23:18:44.779650 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779590    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="135e5baf-7acf-430d-af91-3e0db1fbf649" containerName="authorino"
Jul 02 23:18:44.779795 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779678    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6759401c-c8f2-4b55-a4f9-6ac9bd33e594" containerName="authorino"
Jul 02 23:18:44.779795 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.779692    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="135e5baf-7acf-430d-af91-3e0db1fbf649" containerName="authorino"
Jul 02 23:18:44.820762 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.820722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:18:44.820943 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.820839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:44.825517 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.825494    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:18:44.826926 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.826878    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:18:44.827066 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.826908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xlvwv\""
Jul 02 23:18:44.921699 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.921662    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:18:44.927612 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.927587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7wl\" (UniqueName: \"kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:44.927762 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.927736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:44.934477 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.934455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:44.934825 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:44.934802    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:18:45.028147 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.028111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7wl\" (UniqueName: \"kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:45.028289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.028166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.028289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.028200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcb48\" (UniqueName: \"kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.028289 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.028257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:45.030604 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.030541    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:45.038832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.038808    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7wl\" (UniqueName: \"kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl\") pod \"maas-controller-97f59fbdc-87xg8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") " pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:45.128962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.128923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.129136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.128991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcb48\" (UniqueName: \"kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.131332 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.131302    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.131460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.131436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:45.139563 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.139541    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcb48\" (UniqueName: \"kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48\") pod \"maas-controller-56dc4c68dc-t7tfj\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") " pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.246690 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.246633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:45.302508 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.302468    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:18:45.303359 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:45.303337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc915efac_70d2_4f77_89ec_349f5196c3b8.slice/crio-d17cd0d6671899658d8c14c4d52badb720b8b155c464aecfab1b950e37da3e79 WatchSource:0}: Error finding container d17cd0d6671899658d8c14c4d52badb720b8b155c464aecfab1b950e37da3e79: Status 404 returned error can't find the container with id d17cd0d6671899658d8c14c4d52badb720b8b155c464aecfab1b950e37da3e79
Jul 02 23:18:45.409204 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.409175    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:18:45.410950 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:18:45.410916    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513dbe93_2263_41a5_b06d_82baf72878cd.slice/crio-f1ea6ca146407727265256b2bced9197a22ef6f164902fc2910d75e1c79b81b6 WatchSource:0}: Error finding container f1ea6ca146407727265256b2bced9197a22ef6f164902fc2910d75e1c79b81b6: Status 404 returned error can't find the container with id f1ea6ca146407727265256b2bced9197a22ef6f164902fc2910d75e1c79b81b6
Jul 02 23:18:45.992296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.992254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" event={"ID":"513dbe93-2263-41a5-b06d-82baf72878cd","Type":"ContainerStarted","Data":"f1ea6ca146407727265256b2bced9197a22ef6f164902fc2910d75e1c79b81b6"}
Jul 02 23:18:45.993872 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:45.993844    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97f59fbdc-87xg8" event={"ID":"c915efac-70d2-4f77-89ec-349f5196c3b8","Type":"ContainerStarted","Data":"d17cd0d6671899658d8c14c4d52badb720b8b155c464aecfab1b950e37da3e79"}
Jul 02 23:18:49.013513 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.013464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" event={"ID":"513dbe93-2263-41a5-b06d-82baf72878cd","Type":"ContainerStarted","Data":"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"}
Jul 02 23:18:49.014105 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.013562    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:18:49.014953 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.014928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97f59fbdc-87xg8" event={"ID":"c915efac-70d2-4f77-89ec-349f5196c3b8","Type":"ContainerStarted","Data":"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"}
Jul 02 23:18:49.015060 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.015047    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:18:49.035632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.035577    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" podStartSLOduration=2.387607144 podStartE2EDuration="5.035562039s" totalImagesPullingTime="2.647954895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:49.032658511 +0000 UTC m=+517.016726872" watchObservedRunningTime="2026-07-02 23:18:49.035562039 +0000 UTC m=+517.019630399"
Jul 02 23:18:49.049788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:18:49.049736    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-97f59fbdc-87xg8" podStartSLOduration=2.283571523 podStartE2EDuration="5.049721809s" totalImagesPullingTime="2.766150286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:49.049269568 +0000 UTC m=+517.033337942" watchObservedRunningTime="2026-07-02 23:18:49.049721809 +0000 UTC m=+517.033790169"
Jul 02 23:19:00.028319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.028288    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:19:00.028732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.028544    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:19:00.107363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.107323    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:19:00.107662 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.107610    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-97f59fbdc-87xg8" podUID="c915efac-70d2-4f77-89ec-349f5196c3b8" containerName="manager" containerID="cri-o://ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1" gracePeriod=30
Jul 02 23:19:00.358416 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.358391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:19:00.467079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.467038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d7wl\" (UniqueName: \"kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl\") pod \"c915efac-70d2-4f77-89ec-349f5196c3b8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") "
Jul 02 23:19:00.467252 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.467088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert\") pod \"c915efac-70d2-4f77-89ec-349f5196c3b8\" (UID: \"c915efac-70d2-4f77-89ec-349f5196c3b8\") "
Jul 02 23:19:00.469292 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.469259    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl" (OuterVolumeSpecName: "kube-api-access-7d7wl") pod "c915efac-70d2-4f77-89ec-349f5196c3b8" (UID: "c915efac-70d2-4f77-89ec-349f5196c3b8"). InnerVolumeSpecName "kube-api-access-7d7wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:19:00.469292 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.469264    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c915efac-70d2-4f77-89ec-349f5196c3b8" (UID: "c915efac-70d2-4f77-89ec-349f5196c3b8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:19:00.568356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.568317    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d7wl\" (UniqueName: \"kubernetes.io/projected/c915efac-70d2-4f77-89ec-349f5196c3b8-kube-api-access-7d7wl\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:19:00.568356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:00.568347    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c915efac-70d2-4f77-89ec-349f5196c3b8-webhook-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:19:01.085688 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.085649    2573 generic.go:356] "Generic (PLEG): container finished" podID="c915efac-70d2-4f77-89ec-349f5196c3b8" containerID="ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1" exitCode=0
Jul 02 23:19:01.086117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.085698    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97f59fbdc-87xg8"
Jul 02 23:19:01.086117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.085715    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97f59fbdc-87xg8" event={"ID":"c915efac-70d2-4f77-89ec-349f5196c3b8","Type":"ContainerDied","Data":"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"}
Jul 02 23:19:01.086117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.085768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97f59fbdc-87xg8" event={"ID":"c915efac-70d2-4f77-89ec-349f5196c3b8","Type":"ContainerDied","Data":"d17cd0d6671899658d8c14c4d52badb720b8b155c464aecfab1b950e37da3e79"}
Jul 02 23:19:01.086117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.085798    2573 scope.go:117] "RemoveContainer" containerID="ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"
Jul 02 23:19:01.094312 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.094288    2573 scope.go:117] "RemoveContainer" containerID="ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"
Jul 02 23:19:01.094576 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:19:01.094556    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1\": container with ID starting with ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1 not found: ID does not exist" containerID="ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"
Jul 02 23:19:01.094649 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.094584    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1"} err="failed to get container status \"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1\": rpc error: code = NotFound desc = could not find container \"ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1\": container with ID starting with ec266a97c89d94086b769b954e045185faf234c8398feb9a8f09bdbb94bb3ff1 not found: ID does not exist"
Jul 02 23:19:01.104826 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.104793    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:19:01.110761 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:01.110737    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-97f59fbdc-87xg8"]
Jul 02 23:19:02.535242 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:02.535210    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c915efac-70d2-4f77-89ec-349f5196c3b8" path="/var/lib/kubelet/pods/c915efac-70d2-4f77-89ec-349f5196c3b8/volumes"
Jul 02 23:19:21.917453 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.917420    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-rpmfr"]
Jul 02 23:19:21.917955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.917798    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c915efac-70d2-4f77-89ec-349f5196c3b8" containerName="manager"
Jul 02 23:19:21.917955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.917808    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c915efac-70d2-4f77-89ec-349f5196c3b8" containerName="manager"
Jul 02 23:19:21.917955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.917870    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c915efac-70d2-4f77-89ec-349f5196c3b8" containerName="manager"
Jul 02 23:19:21.924911 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.924863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:21.928227 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.928198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lmt9g\""
Jul 02 23:19:21.928627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.928458    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 23:19:21.931786 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.931760    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-rpmfr"]
Jul 02 23:19:21.959832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.959801    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p2snj"]
Jul 02 23:19:21.963585 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.963562    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:21.993742 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:21.993676    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p2snj"]
Jul 02 23:19:22.057652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.057615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpbq\" (UniqueName: \"kubernetes.io/projected/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-kube-api-access-kbpbq\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.057824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.057668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.057824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.057710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvln\" (UniqueName: \"kubernetes.io/projected/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-kube-api-access-sgvln\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.057824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.057760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-plugins-config-volume\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.159177 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.159126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvln\" (UniqueName: \"kubernetes.io/projected/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-kube-api-access-sgvln\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.159351 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.159223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-plugins-config-volume\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.159351 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.159298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpbq\" (UniqueName: \"kubernetes.io/projected/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-kube-api-access-kbpbq\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.159464 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.159351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.160176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.160140    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-plugins-config-volume\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.160575 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.160551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.170537 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.170469    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvln\" (UniqueName: \"kubernetes.io/projected/c7e2ec90-a59b-4d21-99c1-e86a0868b82f-kube-api-access-sgvln\") pod \"payload-processing-58f86c7798-rpmfr\" (UID: \"c7e2ec90-a59b-4d21-99c1-e86a0868b82f\") " pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.170673 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.170651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpbq\" (UniqueName: \"kubernetes.io/projected/4f3b7264-eaf9-4f4f-96b6-209aafde8c59-kube-api-access-kbpbq\") pod \"payload-pre-processing-7964457696-p2snj\" (UID: \"4f3b7264-eaf9-4f4f-96b6-209aafde8c59\") " pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.238795 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.238758    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:22.273868 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.273828    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:22.392720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.392255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-rpmfr"]
Jul 02 23:19:22.437290 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:22.437244    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p2snj"]
Jul 02 23:19:22.442559 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:19:22.442470    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3b7264_eaf9_4f4f_96b6_209aafde8c59.slice/crio-1adf5e36379588c35685c0f870f2d20fb0a88db6a364e2ebe01229a1b59b0e2d WatchSource:0}: Error finding container 1adf5e36379588c35685c0f870f2d20fb0a88db6a364e2ebe01229a1b59b0e2d: Status 404 returned error can't find the container with id 1adf5e36379588c35685c0f870f2d20fb0a88db6a364e2ebe01229a1b59b0e2d
Jul 02 23:19:23.196128 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:23.196088    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr" event={"ID":"c7e2ec90-a59b-4d21-99c1-e86a0868b82f","Type":"ContainerStarted","Data":"0c4e22e8b9bb4b08db5fc5f2dd421aa9283fc5b764edf4ca9b4e267d095510d7"}
Jul 02 23:19:23.197827 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:23.197798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj" event={"ID":"4f3b7264-eaf9-4f4f-96b6-209aafde8c59","Type":"ContainerStarted","Data":"1adf5e36379588c35685c0f870f2d20fb0a88db6a364e2ebe01229a1b59b0e2d"}
Jul 02 23:19:24.204368 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.204335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj" event={"ID":"4f3b7264-eaf9-4f4f-96b6-209aafde8c59","Type":"ContainerStarted","Data":"d041f44be9f1a5d0dae257e4bfab0bb8fc79993bc094b21e6c3b1ec1f4944b93"}
Jul 02 23:19:24.204790 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.204399    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:24.205899 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.205864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr" event={"ID":"c7e2ec90-a59b-4d21-99c1-e86a0868b82f","Type":"ContainerStarted","Data":"8e2c8d753a2d84efc57f0b4f6c5c1f41bb8e74df0f15795a69f242abf53474b1"}
Jul 02 23:19:24.206019 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.205990    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:24.223073 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.223025    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj" podStartSLOduration=1.667574391 podStartE2EDuration="3.223007926s" totalImagesPullingTime="1.555433535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:24.221309344 +0000 UTC m=+552.205377707" watchObservedRunningTime="2026-07-02 23:19:24.223007926 +0000 UTC m=+552.207076285"
Jul 02 23:19:24.242828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:24.242706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr" podStartSLOduration=1.646692098 podStartE2EDuration="3.242684298s" totalImagesPullingTime="1.5959922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:24.24005219 +0000 UTC m=+552.224120551" watchObservedRunningTime="2026-07-02 23:19:24.242684298 +0000 UTC m=+552.226752661"
Jul 02 23:19:29.233944 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.233916    2573 generic.go:356] "Generic (PLEG): container finished" podID="3cfd6a21-d50c-44c9-8887-1a4784a58d7c" containerID="59ef3c9ec7b284793107135d8fabbf30534cd9d4a6786c4445112e4c2f8f8cd3" exitCode=0
Jul 02 23:19:29.234329 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.233970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" event={"ID":"3cfd6a21-d50c-44c9-8887-1a4784a58d7c","Type":"ContainerDied","Data":"59ef3c9ec7b284793107135d8fabbf30534cd9d4a6786c4445112e4c2f8f8cd3"}
Jul 02 23:19:29.234375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.234347    2573 scope.go:117] "RemoveContainer" containerID="59ef3c9ec7b284793107135d8fabbf30534cd9d4a6786c4445112e4c2f8f8cd3"
Jul 02 23:19:29.235314 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.235277    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:19:29.235411 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.235361    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:19:29.235477 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:29.235409    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:19:30.245015 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:30.244074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" event={"ID":"3cfd6a21-d50c-44c9-8887-1a4784a58d7c","Type":"ContainerStarted","Data":"d36857b9a48b34639bd7e675810d6344aa5750de8310810c0d05e824350cfae7"}
Jul 02 23:19:30.308676 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:30.308640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:19:30.309731 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:30.309704    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xts26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 02 23:19:30.309844 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:30.309753    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" podUID="3cfd6a21-d50c-44c9-8887-1a4784a58d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 02 23:19:31.308087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:31.308051    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xts26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 02 23:19:31.308473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:31.308104    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" podUID="3cfd6a21-d50c-44c9-8887-1a4784a58d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 02 23:19:32.308319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:32.308280    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xts26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 02 23:19:32.308713 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:32.308337    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" podUID="3cfd6a21-d50c-44c9-8887-1a4784a58d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 02 23:19:33.308696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:33.308658    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xts26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 02 23:19:33.309136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:33.308716    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26" podUID="3cfd6a21-d50c-44c9-8887-1a4784a58d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 02 23:19:34.312613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:34.312584    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:19:34.313099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:34.312989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:19:34.313551 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:34.313533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xts26"
Jul 02 23:19:35.212111 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:35.212079    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-rpmfr"
Jul 02 23:19:35.212287 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:35.212159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-p2snj"
Jul 02 23:19:38.912010 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.911977    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"]
Jul 02 23:19:38.915494 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.915474    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.918632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.918615    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:19:38.918923 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.918908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-djwms\""
Jul 02 23:19:38.920070 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.920049    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 02 23:19:38.920156 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.920074    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:19:38.921340 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef56577-d5db-4232-b836-823ef43538f9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.921454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75t8c\" (UniqueName: \"kubernetes.io/projected/3ef56577-d5db-4232-b836-823ef43538f9-kube-api-access-75t8c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.921454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.921578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.921578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.921578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.921552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:38.927375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:38.927352    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"]
Jul 02 23:19:39.021996 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.021960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef56577-d5db-4232-b836-823ef43538f9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75t8c\" (UniqueName: \"kubernetes.io/projected/3ef56577-d5db-4232-b836-823ef43538f9-kube-api-access-75t8c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022480    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022546 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022781 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022557    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.022781 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.022719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.024557 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.024535    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef56577-d5db-4232-b836-823ef43538f9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.024806 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.024787    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef56577-d5db-4232-b836-823ef43538f9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.031316 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.031291    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75t8c\" (UniqueName: \"kubernetes.io/projected/3ef56577-d5db-4232-b836-823ef43538f9-kube-api-access-75t8c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h\" (UID: \"3ef56577-d5db-4232-b836-823ef43538f9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.227697 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.227657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:39.400762 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:39.400735    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"]
Jul 02 23:19:39.403561 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:19:39.403516    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef56577_d5db_4232_b836_823ef43538f9.slice/crio-6f6ae2dc0c5e669a48e848102476109ed4a9b5619a9e6ce42267a8a4cc380cb0 WatchSource:0}: Error finding container 6f6ae2dc0c5e669a48e848102476109ed4a9b5619a9e6ce42267a8a4cc380cb0: Status 404 returned error can't find the container with id 6f6ae2dc0c5e669a48e848102476109ed4a9b5619a9e6ce42267a8a4cc380cb0
Jul 02 23:19:40.309035 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:40.308995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h" event={"ID":"3ef56577-d5db-4232-b836-823ef43538f9","Type":"ContainerStarted","Data":"6f6ae2dc0c5e669a48e848102476109ed4a9b5619a9e6ce42267a8a4cc380cb0"}
Jul 02 23:19:41.315170 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:41.315133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h" event={"ID":"3ef56577-d5db-4232-b836-823ef43538f9","Type":"ContainerStarted","Data":"cff8cc2d7396b8c1d7f05d2063984b13a1360abde82d491d7f2ec87928c5c911"}
Jul 02 23:19:41.335498 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:41.335439    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h" podStartSLOduration=2.311178163 podStartE2EDuration="3.335422545s" totalImagesPullingTime="1.024244382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:41.332749649 +0000 UTC m=+569.316818013" watchObservedRunningTime="2026-07-02 23:19:41.335422545 +0000 UTC m=+569.319490905"
Jul 02 23:19:49.228600 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:49.228563    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:49.229167 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:49.228654    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:49.241391 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:49.241366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:19:49.366454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:19:49.366422    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h"
Jul 02 23:20:09.486967 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.486930    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"]
Jul 02 23:20:09.490442 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.490423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.493435 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.493418    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 23:20:09.501783 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.501756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"]
Jul 02 23:20:09.605288 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.605482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.605482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.605482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.605482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.605482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.605431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zq8\" (UniqueName: \"kubernetes.io/projected/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-kube-api-access-z6zq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706455 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zq8\" (UniqueName: \"kubernetes.io/projected/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-kube-api-access-z6zq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.706670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.706594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.707056 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.707033    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.707115 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.707095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.707155 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.707115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.708794 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.708767    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.708958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.708940    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.714383 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.714357    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zq8\" (UniqueName: \"kubernetes.io/projected/03a48cfc-6a5d-4c0a-8814-85e92aa176f0-kube-api-access-z6zq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dfpkn\" (UID: \"03a48cfc-6a5d-4c0a-8814-85e92aa176f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.802356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.802259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:09.939143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:09.939106    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"]
Jul 02 23:20:09.940668 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:20:09.940636    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a48cfc_6a5d_4c0a_8814_85e92aa176f0.slice/crio-5aecfbafbffe25ff4c4529742821fe7eec8801d170b4d332de6a6bacac837f19 WatchSource:0}: Error finding container 5aecfbafbffe25ff4c4529742821fe7eec8801d170b4d332de6a6bacac837f19: Status 404 returned error can't find the container with id 5aecfbafbffe25ff4c4529742821fe7eec8801d170b4d332de6a6bacac837f19
Jul 02 23:20:10.462732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:10.462701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn" event={"ID":"03a48cfc-6a5d-4c0a-8814-85e92aa176f0","Type":"ContainerStarted","Data":"abd18569e106df91d0013425dcf85e3b80ca9fc1808eb02e90f72fad5697a93d"}
Jul 02 23:20:10.462938 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:10.462750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn" event={"ID":"03a48cfc-6a5d-4c0a-8814-85e92aa176f0","Type":"ContainerStarted","Data":"5aecfbafbffe25ff4c4529742821fe7eec8801d170b4d332de6a6bacac837f19"}
Jul 02 23:20:10.480523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:10.480475    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn" podStartSLOduration=1.3147365500000001 podStartE2EDuration="1.48045828s" totalImagesPullingTime="165.72173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:10.478913963 +0000 UTC m=+598.462982325" watchObservedRunningTime="2026-07-02 23:20:10.48045828 +0000 UTC m=+598.464526639"
Jul 02 23:20:12.452053 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:12.452022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:20:12.452458 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:12.452175    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:20:19.802828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:19.802784    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:19.803491 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:19.802864    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:19.815158 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:19.815131    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:20:20.536580 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:20:20.536545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dfpkn"
Jul 02 23:21:39.975488 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:39.975448    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bd84998d-6sj79"]
Jul 02 23:21:39.979107 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:39.979084    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:39.986806 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:39.986383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd84998d-6sj79"]
Jul 02 23:21:40.040167 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.040129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qghk7\" (UniqueName: \"kubernetes.io/projected/f8ed5f81-f329-48c9-9d4b-d638fecc5644-kube-api-access-qghk7\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.040167 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.040168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8ed5f81-f329-48c9-9d4b-d638fecc5644-tls-cert\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.141215 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.141179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8ed5f81-f329-48c9-9d4b-d638fecc5644-tls-cert\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.141393 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.141304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghk7\" (UniqueName: \"kubernetes.io/projected/f8ed5f81-f329-48c9-9d4b-d638fecc5644-kube-api-access-qghk7\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.143805 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.143773    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8ed5f81-f329-48c9-9d4b-d638fecc5644-tls-cert\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.149298 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.149275    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qghk7\" (UniqueName: \"kubernetes.io/projected/f8ed5f81-f329-48c9-9d4b-d638fecc5644-kube-api-access-qghk7\") pod \"authorino-5bd84998d-6sj79\" (UID: \"f8ed5f81-f329-48c9-9d4b-d638fecc5644\") " pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.289124 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.289046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd84998d-6sj79"
Jul 02 23:21:40.433692 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.433663    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd84998d-6sj79"]
Jul 02 23:21:40.434971 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:21:40.434944    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8ed5f81_f329_48c9_9d4b_d638fecc5644.slice/crio-0be64d88c1d0b91286583790fd31b656400a57fc08d54fd406b3ce9c3f52c767 WatchSource:0}: Error finding container 0be64d88c1d0b91286583790fd31b656400a57fc08d54fd406b3ce9c3f52c767: Status 404 returned error can't find the container with id 0be64d88c1d0b91286583790fd31b656400a57fc08d54fd406b3ce9c3f52c767
Jul 02 23:21:40.436314 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.436297    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:21:40.926409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:40.926371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd84998d-6sj79" event={"ID":"f8ed5f81-f329-48c9-9d4b-d638fecc5644","Type":"ContainerStarted","Data":"0be64d88c1d0b91286583790fd31b656400a57fc08d54fd406b3ce9c3f52c767"}
Jul 02 23:21:41.935702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:41.935657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd84998d-6sj79" event={"ID":"f8ed5f81-f329-48c9-9d4b-d638fecc5644","Type":"ContainerStarted","Data":"72479ad9cf2d0aecba32286545715cf8879cc4c157cd73310d28ff045f5400aa"}
Jul 02 23:21:41.960345 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:41.960294    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bd84998d-6sj79" podStartSLOduration=2.3613552 podStartE2EDuration="2.960275807s" totalImagesPullingTime="598.920607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:21:41.958555966 +0000 UTC m=+689.942624327" watchObservedRunningTime="2026-07-02 23:21:41.960275807 +0000 UTC m=+689.944344193"
Jul 02 23:21:42.000404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:41.999337    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:21:42.000404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:41.999560    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" podUID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" containerName="authorino" containerID="cri-o://9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1" gracePeriod=30
Jul 02 23:21:42.288176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.287943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:21:42.365264 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.365232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts96d\" (UniqueName: \"kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d\") pod \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") "
Jul 02 23:21:42.365453 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.365318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert\") pod \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\" (UID: \"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd\") "
Jul 02 23:21:42.367390 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.367363    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d" (OuterVolumeSpecName: "kube-api-access-ts96d") pod "4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" (UID: "4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd"). InnerVolumeSpecName "kube-api-access-ts96d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:21:42.377128 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.377015    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" (UID: "4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:21:42.466729 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.466686    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-tls-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:21:42.466729 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.466731    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts96d\" (UniqueName: \"kubernetes.io/projected/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd-kube-api-access-ts96d\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:21:42.942497 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.942464    2573 generic.go:356] "Generic (PLEG): container finished" podID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" containerID="9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1" exitCode=0
Jul 02 23:21:42.943001 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.942508    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4f87699c-zqq8b"
Jul 02 23:21:42.943001 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.942549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" event={"ID":"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd","Type":"ContainerDied","Data":"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"}
Jul 02 23:21:42.943001 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.942601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4f87699c-zqq8b" event={"ID":"4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd","Type":"ContainerDied","Data":"db5e9462293c983189b47a763c1be1a237f96f8ba3e14c4e5be9b182a49755a7"}
Jul 02 23:21:42.943001 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.942625    2573 scope.go:117] "RemoveContainer" containerID="9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"
Jul 02 23:21:42.953702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.953676    2573 scope.go:117] "RemoveContainer" containerID="9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"
Jul 02 23:21:42.954161 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:21:42.954137    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1\": container with ID starting with 9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1 not found: ID does not exist" containerID="9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"
Jul 02 23:21:42.954254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.954173    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1"} err="failed to get container status \"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1\": rpc error: code = NotFound desc = could not find container \"9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1\": container with ID starting with 9629940d1d46850a3c8e39bd73ef6c5f6a7514eade1bf3b67ab27bfcd9fbcfd1 not found: ID does not exist"
Jul 02 23:21:42.966459 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.966422    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:21:42.969867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:42.969843    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f4f87699c-zqq8b"]
Jul 02 23:21:44.537370 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:21:44.537326    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" path="/var/lib/kubelet/pods/4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd/volumes"
Jul 02 23:23:02.710581 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:02.710538    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:23:02.711191 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:02.710777    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" podUID="513dbe93-2263-41a5-b06d-82baf72878cd" containerName="manager" containerID="cri-o://5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f" gracePeriod=30
Jul 02 23:23:02.971136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:02.971074    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:23:03.001856 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.001823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert\") pod \"513dbe93-2263-41a5-b06d-82baf72878cd\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") "
Jul 02 23:23:03.002043 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.001948    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcb48\" (UniqueName: \"kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48\") pod \"513dbe93-2263-41a5-b06d-82baf72878cd\" (UID: \"513dbe93-2263-41a5-b06d-82baf72878cd\") "
Jul 02 23:23:03.004088 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.004055    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48" (OuterVolumeSpecName: "kube-api-access-lcb48") pod "513dbe93-2263-41a5-b06d-82baf72878cd" (UID: "513dbe93-2263-41a5-b06d-82baf72878cd"). InnerVolumeSpecName "kube-api-access-lcb48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:23:03.004088 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.004077    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "513dbe93-2263-41a5-b06d-82baf72878cd" (UID: "513dbe93-2263-41a5-b06d-82baf72878cd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:23:03.102647 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.102613    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/513dbe93-2263-41a5-b06d-82baf72878cd-webhook-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:23:03.102647 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.102644    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcb48\" (UniqueName: \"kubernetes.io/projected/513dbe93-2263-41a5-b06d-82baf72878cd-kube-api-access-lcb48\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:23:03.365944 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.365834    2573 generic.go:356] "Generic (PLEG): container finished" podID="513dbe93-2263-41a5-b06d-82baf72878cd" containerID="5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f" exitCode=0
Jul 02 23:23:03.365944 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.365874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" event={"ID":"513dbe93-2263-41a5-b06d-82baf72878cd","Type":"ContainerDied","Data":"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"}
Jul 02 23:23:03.365944 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.365880    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj"
Jul 02 23:23:03.365944 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.365931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-t7tfj" event={"ID":"513dbe93-2263-41a5-b06d-82baf72878cd","Type":"ContainerDied","Data":"f1ea6ca146407727265256b2bced9197a22ef6f164902fc2910d75e1c79b81b6"}
Jul 02 23:23:03.366278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.365953    2573 scope.go:117] "RemoveContainer" containerID="5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"
Jul 02 23:23:03.377418 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.377219    2573 scope.go:117] "RemoveContainer" containerID="5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"
Jul 02 23:23:03.377600 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:23:03.377576    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f\": container with ID starting with 5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f not found: ID does not exist" containerID="5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"
Jul 02 23:23:03.377681 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.377614    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f"} err="failed to get container status \"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f\": rpc error: code = NotFound desc = could not find container \"5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f\": container with ID starting with 5b9fe5e7814cfd380a798db9584ab0a0b46d9fdbefda7f879805aaf3e21e031f not found: ID does not exist"
Jul 02 23:23:03.392376 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.392341    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:23:03.398334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:03.398306    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-t7tfj"]
Jul 02 23:23:04.182044 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182014    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-8h99m"]
Jul 02 23:23:04.182426 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182396    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513dbe93-2263-41a5-b06d-82baf72878cd" containerName="manager"
Jul 02 23:23:04.182426 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182407    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="513dbe93-2263-41a5-b06d-82baf72878cd" containerName="manager"
Jul 02 23:23:04.182494 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182430    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" containerName="authorino"
Jul 02 23:23:04.182494 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182436    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" containerName="authorino"
Jul 02 23:23:04.182551 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182500    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc3ba2b-c775-4d5d-921b-33d3c90ae3bd" containerName="authorino"
Jul 02 23:23:04.182551 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.182511    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="513dbe93-2263-41a5-b06d-82baf72878cd" containerName="manager"
Jul 02 23:23:04.187011 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.186993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.195660 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.195613    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:23:04.195660 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.195656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xlvwv\""
Jul 02 23:23:04.195962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.195941    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:23:04.198194 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.198173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-8h99m"]
Jul 02 23:23:04.212583 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.212548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f777b4-7c89-47ac-86fe-2f824bb6c999-webhook-cert\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.212733 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.212594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgkm7\" (UniqueName: \"kubernetes.io/projected/41f777b4-7c89-47ac-86fe-2f824bb6c999-kube-api-access-qgkm7\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.313165 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.313124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f777b4-7c89-47ac-86fe-2f824bb6c999-webhook-cert\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.313334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.313175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgkm7\" (UniqueName: \"kubernetes.io/projected/41f777b4-7c89-47ac-86fe-2f824bb6c999-kube-api-access-qgkm7\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.315672 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.315647    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f777b4-7c89-47ac-86fe-2f824bb6c999-webhook-cert\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.320860 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.320838    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgkm7\" (UniqueName: \"kubernetes.io/projected/41f777b4-7c89-47ac-86fe-2f824bb6c999-kube-api-access-qgkm7\") pod \"maas-controller-56dc4c68dc-8h99m\" (UID: \"41f777b4-7c89-47ac-86fe-2f824bb6c999\") " pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.506108 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.506015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:04.536074 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.536040    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513dbe93-2263-41a5-b06d-82baf72878cd" path="/var/lib/kubelet/pods/513dbe93-2263-41a5-b06d-82baf72878cd/volumes"
Jul 02 23:23:04.642322 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:04.642296    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56dc4c68dc-8h99m"]
Jul 02 23:23:04.644309 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:23:04.644280    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f777b4_7c89_47ac_86fe_2f824bb6c999.slice/crio-dfaccd7a5361d1ae052082b45017efe7070129532b377b76ee5b1fc46d5f8c74 WatchSource:0}: Error finding container dfaccd7a5361d1ae052082b45017efe7070129532b377b76ee5b1fc46d5f8c74: Status 404 returned error can't find the container with id dfaccd7a5361d1ae052082b45017efe7070129532b377b76ee5b1fc46d5f8c74
Jul 02 23:23:05.378857 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:05.378765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-8h99m" event={"ID":"41f777b4-7c89-47ac-86fe-2f824bb6c999","Type":"ContainerStarted","Data":"fdf8ff9be956505b65afb685ccbd45ebfef265651a4f3805b920e5b6acee45c4"}
Jul 02 23:23:05.378857 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:05.378826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56dc4c68dc-8h99m" event={"ID":"41f777b4-7c89-47ac-86fe-2f824bb6c999","Type":"ContainerStarted","Data":"dfaccd7a5361d1ae052082b45017efe7070129532b377b76ee5b1fc46d5f8c74"}
Jul 02 23:23:05.379293 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:05.378967    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:23:05.397042 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:05.396993    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56dc4c68dc-8h99m" podStartSLOduration=0.940089964 podStartE2EDuration="1.396978065s" totalImagesPullingTime="456.888101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:23:05.396362258 +0000 UTC m=+773.380430618" watchObservedRunningTime="2026-07-02 23:23:05.396978065 +0000 UTC m=+773.381046478"
Jul 02 23:23:16.389843 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:23:16.389814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56dc4c68dc-8h99m"
Jul 02 23:25:12.482312 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:25:12.482232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:25:12.486518 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:25:12.486498    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:30:00.145688 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.145605    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-jptnh"]
Jul 02 23:30:00.149317 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.149299    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:00.152260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.152230    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nmtfb\""
Jul 02 23:30:00.157490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.157464    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-jptnh"]
Jul 02 23:30:00.314586 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.314547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtfn\" (UniqueName: \"kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn\") pod \"maas-api-key-cleanup-29717250-jptnh\" (UID: \"a716477d-92e2-4d34-9085-a3a75528fe52\") " pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:00.415869 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.415769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtfn\" (UniqueName: \"kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn\") pod \"maas-api-key-cleanup-29717250-jptnh\" (UID: \"a716477d-92e2-4d34-9085-a3a75528fe52\") " pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:00.424938 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.424912    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtfn\" (UniqueName: \"kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn\") pod \"maas-api-key-cleanup-29717250-jptnh\" (UID: \"a716477d-92e2-4d34-9085-a3a75528fe52\") " pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:00.460848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.460812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:00.599669 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.599636    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-jptnh"]
Jul 02 23:30:00.601444 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:30:00.601418    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda716477d_92e2_4d34_9085_a3a75528fe52.slice/crio-eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae WatchSource:0}: Error finding container eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae: Status 404 returned error can't find the container with id eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae
Jul 02 23:30:00.603805 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:00.603788    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:30:01.497625 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:01.497591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh" event={"ID":"a716477d-92e2-4d34-9085-a3a75528fe52","Type":"ContainerStarted","Data":"eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae"}
Jul 02 23:30:03.510831 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:03.510796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh" event={"ID":"a716477d-92e2-4d34-9085-a3a75528fe52","Type":"ContainerStarted","Data":"b54e083c97f249e696f1ddee9f41e40a59952e8db7bb6f92252e3391c26d4ccd"}
Jul 02 23:30:03.527143 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:03.527091    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh" podStartSLOduration=1.173840383 podStartE2EDuration="3.527071268s" totalImagesPullingTime="2.353230885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:30:03.526513676 +0000 UTC m=+1191.510582037" watchObservedRunningTime="2026-07-02 23:30:03.527071268 +0000 UTC m=+1191.511139630"
Jul 02 23:30:04.518694 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:04.518661    2573 generic.go:356] "Generic (PLEG): container finished" podID="a716477d-92e2-4d34-9085-a3a75528fe52" containerID="b54e083c97f249e696f1ddee9f41e40a59952e8db7bb6f92252e3391c26d4ccd" exitCode=0
Jul 02 23:30:04.519111 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:04.518753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh" event={"ID":"a716477d-92e2-4d34-9085-a3a75528fe52","Type":"ContainerDied","Data":"b54e083c97f249e696f1ddee9f41e40a59952e8db7bb6f92252e3391c26d4ccd"}
Jul 02 23:30:05.657434 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:05.657411    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:05.766529 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:05.766498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtfn\" (UniqueName: \"kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn\") pod \"a716477d-92e2-4d34-9085-a3a75528fe52\" (UID: \"a716477d-92e2-4d34-9085-a3a75528fe52\") "
Jul 02 23:30:05.768549 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:05.768517    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn" (OuterVolumeSpecName: "kube-api-access-nhtfn") pod "a716477d-92e2-4d34-9085-a3a75528fe52" (UID: "a716477d-92e2-4d34-9085-a3a75528fe52"). InnerVolumeSpecName "kube-api-access-nhtfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:30:05.867376 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:05.867349    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhtfn\" (UniqueName: \"kubernetes.io/projected/a716477d-92e2-4d34-9085-a3a75528fe52-kube-api-access-nhtfn\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:30:06.529905 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:06.529854    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh"
Jul 02 23:30:06.534713 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:06.534684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-jptnh" event={"ID":"a716477d-92e2-4d34-9085-a3a75528fe52","Type":"ContainerDied","Data":"eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae"}
Jul 02 23:30:06.534861 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:06.534727    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec581ca4a25958f319170b993baa9a9e4fd46e6fbd3dc34e7ca6bbf3e5545ae"
Jul 02 23:30:12.513643 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:12.513533    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:30:12.530726 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:30:12.517254    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:34:49.952109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.952079    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:34:49.953254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.952691    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a716477d-92e2-4d34-9085-a3a75528fe52" containerName="cleanup"
Jul 02 23:34:49.953254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.952710    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a716477d-92e2-4d34-9085-a3a75528fe52" containerName="cleanup"
Jul 02 23:34:49.953254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.952807    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a716477d-92e2-4d34-9085-a3a75528fe52" containerName="cleanup"
Jul 02 23:34:49.955866 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.955845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.958809 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.958640    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a58dbec0-openshift-default-dockercfg-4w9d6\""
Jul 02 23:34:49.975484 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.975397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:34:49.992130 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992301 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992301 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992301 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd8kq\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:49.992693 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:49.992522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093664 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093664 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd8kq\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.093932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.093944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094395 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094226    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094414    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094456    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.094569 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.094550    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.096127 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.096103    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.096587 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.096567    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.102229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.102204    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd8kq\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.103187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.103168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token\") pod \"e2e-ait-a58dbec0-openshift-default-795b67878c-265b6\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") " pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.267038 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.266957    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:50.408730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.408704    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:34:50.410097 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:34:50.410068    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf083c094_9f7d_4860_909f_c4a87c942a03.slice/crio-e0e4050ce93392ae19f0352ab598a328d94e5b9155c1995f359ffe61950e7fc1 WatchSource:0}: Error finding container e0e4050ce93392ae19f0352ab598a328d94e5b9155c1995f359ffe61950e7fc1: Status 404 returned error can't find the container with id e0e4050ce93392ae19f0352ab598a328d94e5b9155c1995f359ffe61950e7fc1
Jul 02 23:34:50.412224 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.412183    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:34:50.412305 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.412276    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:34:50.412352 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.412319    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:34:50.964810 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.964771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" event={"ID":"f083c094-9f7d-4860-909f-c4a87c942a03","Type":"ContainerStarted","Data":"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"}
Jul 02 23:34:50.965246 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.964830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" event={"ID":"f083c094-9f7d-4860-909f-c4a87c942a03","Type":"ContainerStarted","Data":"e0e4050ce93392ae19f0352ab598a328d94e5b9155c1995f359ffe61950e7fc1"}
Jul 02 23:34:50.985054 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:50.984998    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" podStartSLOduration=1.984975377 podStartE2EDuration="1.984975377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:34:50.984113545 +0000 UTC m=+1478.968181910" watchObservedRunningTime="2026-07-02 23:34:50.984975377 +0000 UTC m=+1478.969043738"
Jul 02 23:34:51.267400 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:51.267308    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:51.272727 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:51.272703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:51.971813 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:51.971776    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:51.972842 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:51.972820    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:34:56.414302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:56.414266    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:34:56.414725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:34:56.414481    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" podUID="f083c094-9f7d-4860-909f-c4a87c942a03" containerName="istio-proxy" containerID="cri-o://ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5" gracePeriod=30
Jul 02 23:35:02.678509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.678477    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:35:02.683214 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.683179    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:02.683826 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.683805    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f083c094-9f7d-4860-909f-c4a87c942a03" containerName="istio-proxy"
Jul 02 23:35:02.683826 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.683828    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f083c094-9f7d-4860-909f-c4a87c942a03" containerName="istio-proxy"
Jul 02 23:35:02.683990 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.683963    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f083c094-9f7d-4860-909f-c4a87c942a03" containerName="istio-proxy"
Jul 02 23:35:02.687855 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.687837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.690945 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.690920    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-966cc298-gw-openshift-default-dockercfg-nxdhw\""
Jul 02 23:35:02.703177 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.703156    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:02.717608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717575    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717617    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717649    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717713    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717988 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717765    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd8kq\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.717988 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.717814    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.718145 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718050    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:02.718145 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718104    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:02.718145 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718128    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:02.718302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718205    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.718302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token\") pod \"f083c094-9f7d-4860-909f-c4a87c942a03\" (UID: \"f083c094-9f7d-4860-909f-c4a87c942a03\") "
Jul 02 23:35:02.718302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718268    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:02.718663 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718640    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f083c094-9f7d-4860-909f-c4a87c942a03-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.718791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718666    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.718791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718680    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.718791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.718695    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.719205 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.719181    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data" (OuterVolumeSpecName: "istio-data") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:02.720435 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.720408    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq" (OuterVolumeSpecName: "kube-api-access-fd8kq") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "kube-api-access-fd8kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:02.720545 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.720431    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:35:02.720545 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.720416    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:02.720665 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.720622    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token" (OuterVolumeSpecName: "istio-token") pod "f083c094-9f7d-4860-909f-c4a87c942a03" (UID: "f083c094-9f7d-4860-909f-c4a87c942a03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:02.819627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819627 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr5td\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.819963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.819969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.820047    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.820063    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.820079    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f083c094-9f7d-4860-909f-c4a87c942a03-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.820093    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd8kq\" (UniqueName: \"kubernetes.io/projected/f083c094-9f7d-4860-909f-c4a87c942a03-kube-api-access-fd8kq\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.820202 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.820107    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f083c094-9f7d-4860-909f-c4a87c942a03-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:02.921326 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921326 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr5td\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.921930 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.921775    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.922309 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.922275    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.922442 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.922324    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.922442 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.922369    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.922619 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.922598    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.923737 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.923719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.923832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.923738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.931377 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.931343    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.931509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.931411    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr5td\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td\") pod \"e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") " pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:02.998834 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:02.998799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:03.029506 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.029476    2573 generic.go:356] "Generic (PLEG): container finished" podID="f083c094-9f7d-4860-909f-c4a87c942a03" containerID="ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5" exitCode=0
Jul 02 23:35:03.029652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.029534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" event={"ID":"f083c094-9f7d-4860-909f-c4a87c942a03","Type":"ContainerDied","Data":"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"}
Jul 02 23:35:03.029652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.029540    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"
Jul 02 23:35:03.029652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.029576    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6" event={"ID":"f083c094-9f7d-4860-909f-c4a87c942a03","Type":"ContainerDied","Data":"e0e4050ce93392ae19f0352ab598a328d94e5b9155c1995f359ffe61950e7fc1"}
Jul 02 23:35:03.029652 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.029598    2573 scope.go:117] "RemoveContainer" containerID="ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"
Jul 02 23:35:03.040324 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.040305    2573 scope.go:117] "RemoveContainer" containerID="ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"
Jul 02 23:35:03.040622 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:35:03.040603    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5\": container with ID starting with ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5 not found: ID does not exist" containerID="ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"
Jul 02 23:35:03.040697 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.040633    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5"} err="failed to get container status \"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5\": rpc error: code = NotFound desc = could not find container \"ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5\": container with ID starting with ea506a11671b940eb842cf27656bcf700e0e7ad7e0593f6722882077691a5ed5 not found: ID does not exist"
Jul 02 23:35:03.059480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.057688    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:35:03.060859 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.060838    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a58dbec0-openshift-default-795b67878c-265b6"]
Jul 02 23:35:03.138986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.138963    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:03.140741 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:35:03.140714    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b558a9a_73b9_41df_9729_e52b46dc6d0f.slice/crio-e573a70753573482412768f8b47b44fd178158051926d185424cb3b678ef0c83 WatchSource:0}: Error finding container e573a70753573482412768f8b47b44fd178158051926d185424cb3b678ef0c83: Status 404 returned error can't find the container with id e573a70753573482412768f8b47b44fd178158051926d185424cb3b678ef0c83
Jul 02 23:35:03.143166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.143135    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:03.143260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.143199    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:03.143260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:03.143228    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:04.038391 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:04.038357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" event={"ID":"6b558a9a-73b9-41df-9729-e52b46dc6d0f","Type":"ContainerStarted","Data":"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"}
Jul 02 23:35:04.038785 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:04.038405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" event={"ID":"6b558a9a-73b9-41df-9729-e52b46dc6d0f","Type":"ContainerStarted","Data":"e573a70753573482412768f8b47b44fd178158051926d185424cb3b678ef0c83"}
Jul 02 23:35:04.061093 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:04.061043    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" podStartSLOduration=2.061029077 podStartE2EDuration="2.061029077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:04.059070686 +0000 UTC m=+1492.043139082" watchObservedRunningTime="2026-07-02 23:35:04.061029077 +0000 UTC m=+1492.045097436"
Jul 02 23:35:04.536327 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:04.536297    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f083c094-9f7d-4860-909f-c4a87c942a03" path="/var/lib/kubelet/pods/f083c094-9f7d-4860-909f-c4a87c942a03/volumes"
Jul 02 23:35:04.999674 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:04.999633    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:05.005104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:05.005077    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:05.045522 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:05.045487    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:05.046514 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:05.046496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:08.766704 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:08.766668    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:08.767106 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:08.766846    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" podUID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" containerName="istio-proxy" containerID="cri-o://c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0" gracePeriod=30
Jul 02 23:35:12.548414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:12.548376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:35:12.552852 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:12.552825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:35:14.317320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.317295    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:14.434587 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434757 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434638    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434757 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434661    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434757 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434683    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434757 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434713    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434756    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434789    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434839    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr5td\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.434986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434870    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:14.434986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.434914    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert\") pod \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\" (UID: \"6b558a9a-73b9-41df-9729-e52b46dc6d0f\") "
Jul 02 23:35:14.435323 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435034    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:14.435323 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435187    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:14.435323 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435238    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.435323 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435258    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.435529 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435476    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:14.435814 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.435788    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:14.436924 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.436899    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:14.437015 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.436948    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:35:14.437015 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.436990    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:14.437104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.437089    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td" (OuterVolumeSpecName: "kube-api-access-jr5td") pod "6b558a9a-73b9-41df-9729-e52b46dc6d0f" (UID: "6b558a9a-73b9-41df-9729-e52b46dc6d0f"). InnerVolumeSpecName "kube-api-access-jr5td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:14.536191 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536156    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536191 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536182    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536191 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536195    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536206    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536216    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536227    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr5td\" (UniqueName: \"kubernetes.io/projected/6b558a9a-73b9-41df-9729-e52b46dc6d0f-kube-api-access-jr5td\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.536429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.536240    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b558a9a-73b9-41df-9729-e52b46dc6d0f-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:14.823654 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.823573    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:14.824148 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.824127    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" containerName="istio-proxy"
Jul 02 23:35:14.824148 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.824148    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" containerName="istio-proxy"
Jul 02 23:35:14.824315 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.824270    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" containerName="istio-proxy"
Jul 02 23:35:14.827609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.827590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.835197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.835174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6ccb1915-openshift-default-dockercfg-d2z7l\""
Jul 02 23:35:14.859487 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.859460    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:14.939565 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7l9\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.939867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:14.940057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:14.939934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.040983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7l9\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041594 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041594 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041450    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041595    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041721 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041695    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.041933 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.041862    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.043644 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.043623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.043818 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.043797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.056631 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.056606    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.056729 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.056715    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7l9\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9\") pod \"e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") " pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.100026 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.099934    2573 generic.go:356] "Generic (PLEG): container finished" podID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" containerID="c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0" exitCode=0
Jul 02 23:35:15.100026 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.100002    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"
Jul 02 23:35:15.100228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.100024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" event={"ID":"6b558a9a-73b9-41df-9729-e52b46dc6d0f","Type":"ContainerDied","Data":"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"}
Jul 02 23:35:15.100228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.100079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22" event={"ID":"6b558a9a-73b9-41df-9729-e52b46dc6d0f","Type":"ContainerDied","Data":"e573a70753573482412768f8b47b44fd178158051926d185424cb3b678ef0c83"}
Jul 02 23:35:15.100228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.100102    2573 scope.go:117] "RemoveContainer" containerID="c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"
Jul 02 23:35:15.109059 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.108997    2573 scope.go:117] "RemoveContainer" containerID="c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"
Jul 02 23:35:15.109299 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:35:15.109277    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0\": container with ID starting with c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0 not found: ID does not exist" containerID="c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"
Jul 02 23:35:15.109351 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.109308    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0"} err="failed to get container status \"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0\": rpc error: code = NotFound desc = could not find container \"c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0\": container with ID starting with c71c9ed879ca0bb3444838a5c14e890f675719d0a3b4af59afdb49ecfdbeaeb0 not found: ID does not exist"
Jul 02 23:35:15.132732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.132695    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:15.140017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.139995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:15.140383 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.140364    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-966cc298-gw-openshift-default-7cd4644fb7-4jd22"]
Jul 02 23:35:15.287361 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.287334    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:15.288341 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:35:15.288319    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26407883_c281_4a2f_9321_75f5991954fa.slice/crio-52b8c2631e221a056bc6432a109439227fd125578736f537963e8fd94b3bb7ee WatchSource:0}: Error finding container 52b8c2631e221a056bc6432a109439227fd125578736f537963e8fd94b3bb7ee: Status 404 returned error can't find the container with id 52b8c2631e221a056bc6432a109439227fd125578736f537963e8fd94b3bb7ee
Jul 02 23:35:15.290602 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.290570    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:15.290702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.290647    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:15.290702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:15.290694    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:16.108254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.108223    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerStarted","Data":"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"}
Jul 02 23:35:16.108643 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.108269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerStarted","Data":"52b8c2631e221a056bc6432a109439227fd125578736f537963e8fd94b3bb7ee"}
Jul 02 23:35:16.138640 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.138590    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" podStartSLOduration=2.138570872 podStartE2EDuration="2.138570872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:16.135840447 +0000 UTC m=+1504.119908807" watchObservedRunningTime="2026-07-02 23:35:16.138570872 +0000 UTC m=+1504.122639231"
Jul 02 23:35:16.140347 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.140326    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:16.144713 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.144681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:16.535793 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:16.535759    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b558a9a-73b9-41df-9729-e52b46dc6d0f" path="/var/lib/kubelet/pods/6b558a9a-73b9-41df-9729-e52b46dc6d0f/volumes"
Jul 02 23:35:17.113489 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:17.113460    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:17.114556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:17.114538    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:27.174578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.174543    2573 generic.go:356] "Generic (PLEG): container finished" podID="26407883-c281-4a2f-9321-75f5991954fa" containerID="def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788" exitCode=0
Jul 02 23:35:27.175067 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.174618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerDied","Data":"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"}
Jul 02 23:35:27.175067 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.175023    2573 scope.go:117] "RemoveContainer" containerID="def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"
Jul 02 23:35:27.175999 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.175971    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:27.176093 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.176052    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:27.176161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.176099    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:27.506389 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:27.506348    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:28.181985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:28.181951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerStarted","Data":"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"}
Jul 02 23:35:28.182447 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:28.182047    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy" containerID="cri-o://c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd" gracePeriod=30
Jul 02 23:35:32.113624 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:32.113581    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:33.429411 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.429387    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:33.524007 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.523909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524007 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.523950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524007 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524002    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524027    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524096    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524125    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524151    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524291 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv7l9\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9\") pod \"26407883-c281-4a2f-9321-75f5991954fa\" (UID: \"26407883-c281-4a2f-9321-75f5991954fa\") "
Jul 02 23:35:33.524584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524372    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:33.524584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524430    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:33.524584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524477    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:33.524584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524506    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:33.524775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524621    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.524775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524642    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.524775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524654    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.524775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.524664    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26407883-c281-4a2f-9321-75f5991954fa-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.525260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.525233    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:33.526449 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.526426    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:35:33.526549 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.526523    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9" (OuterVolumeSpecName: "kube-api-access-vv7l9") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "kube-api-access-vv7l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:33.526626 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.526582    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:33.526626 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.526592    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "26407883-c281-4a2f-9321-75f5991954fa" (UID: "26407883-c281-4a2f-9321-75f5991954fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:33.625257 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.625222    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.625257 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.625257    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv7l9\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-kube-api-access-vv7l9\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.625499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.625273    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26407883-c281-4a2f-9321-75f5991954fa-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.625499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.625283    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26407883-c281-4a2f-9321-75f5991954fa-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.625499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.625290    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26407883-c281-4a2f-9321-75f5991954fa-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:33.928679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.928652    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929142    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929163    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929178    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929183    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929265    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.929409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.929274    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="26407883-c281-4a2f-9321-75f5991954fa" containerName="istio-proxy"
Jul 02 23:35:33.931474 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.931455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:33.935236 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.935216    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ee1caf8b-openshift-default-dockercfg-j6gbt\""
Jul 02 23:35:33.945228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:33.945208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:34.028628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.028867 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psndt\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.029154 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.029154 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.028956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.129847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.129801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.129847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.129843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.129847 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.129859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psndt\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130427 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130427 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130427 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130591 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130477    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130651 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130632    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.130762 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.130677    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.132259 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.132230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.132595 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.132577    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.139239 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.139215    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.139450 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.139435    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psndt\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt\") pod \"e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") " pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.215403 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.215321    2573 generic.go:356] "Generic (PLEG): container finished" podID="26407883-c281-4a2f-9321-75f5991954fa" containerID="c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd" exitCode=0
Jul 02 23:35:34.215403 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.215374    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"
Jul 02 23:35:34.215599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.215403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerDied","Data":"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"}
Jul 02 23:35:34.215599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.215458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k" event={"ID":"26407883-c281-4a2f-9321-75f5991954fa","Type":"ContainerDied","Data":"52b8c2631e221a056bc6432a109439227fd125578736f537963e8fd94b3bb7ee"}
Jul 02 23:35:34.215599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.215481    2573 scope.go:117] "RemoveContainer" containerID="c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"
Jul 02 23:35:34.224844 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.224824    2573 scope.go:117] "RemoveContainer" containerID="def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"
Jul 02 23:35:34.233169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.233152    2573 scope.go:117] "RemoveContainer" containerID="c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"
Jul 02 23:35:34.233458 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:35:34.233442    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd\": container with ID starting with c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd not found: ID does not exist" containerID="c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"
Jul 02 23:35:34.233509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.233466    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd"} err="failed to get container status \"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd\": rpc error: code = NotFound desc = could not find container \"c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd\": container with ID starting with c8580a4a37d3144d78ab8c84a9f92e08730fc3f97fd87df5a75d1bc8898b7dfd not found: ID does not exist"
Jul 02 23:35:34.233509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.233484    2573 scope.go:117] "RemoveContainer" containerID="def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"
Jul 02 23:35:34.233710 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:35:34.233695    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788\": container with ID starting with def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788 not found: ID does not exist" containerID="def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"
Jul 02 23:35:34.233754 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.233714    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788"} err="failed to get container status \"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788\": rpc error: code = NotFound desc = could not find container \"def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788\": container with ID starting with def34329df4e183fa36fa47485670233dec45165e7e3a6102c74e52b90425788 not found: ID does not exist"
Jul 02 23:35:34.242613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.242590    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:34.245092 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.245072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:34.248395 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.248374    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6ccb1915-openshift-default-cdf648f79-7jq9k"]
Jul 02 23:35:34.403319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.403296    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:34.406072 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:35:34.406042    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d144a1_1556_49e9_b158_453b2c5755c6.slice/crio-82d03ac08fc933474cf781cca1b4cd5b1babfa8413b659a0b17b76cb99489b57 WatchSource:0}: Error finding container 82d03ac08fc933474cf781cca1b4cd5b1babfa8413b659a0b17b76cb99489b57: Status 404 returned error can't find the container with id 82d03ac08fc933474cf781cca1b4cd5b1babfa8413b659a0b17b76cb99489b57
Jul 02 23:35:34.408302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.408263    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:34.408405 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.408359    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:34.408468 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.408402    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:35:34.537209 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:34.537177    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26407883-c281-4a2f-9321-75f5991954fa" path="/var/lib/kubelet/pods/26407883-c281-4a2f-9321-75f5991954fa/volumes"
Jul 02 23:35:35.223179 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:35.223140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" event={"ID":"c0d144a1-1556-49e9-b158-453b2c5755c6","Type":"ContainerStarted","Data":"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"}
Jul 02 23:35:35.223371 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:35.223199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" event={"ID":"c0d144a1-1556-49e9-b158-453b2c5755c6","Type":"ContainerStarted","Data":"82d03ac08fc933474cf781cca1b4cd5b1babfa8413b659a0b17b76cb99489b57"}
Jul 02 23:35:35.245575 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:35.245542    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:35.251355 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:35.251261    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:35.251511 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:35.251373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" podStartSLOduration=2.251353164 podStartE2EDuration="2.251353164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:35.24818865 +0000 UTC m=+1523.232257010" watchObservedRunningTime="2026-07-02 23:35:35.251353164 +0000 UTC m=+1523.235421527"
Jul 02 23:35:36.229201 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:36.229170    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:36.230311 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:36.230291    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:39.747783 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:39.747737    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:39.748336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:39.748251    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" podUID="c0d144a1-1556-49e9-b158-453b2c5755c6" containerName="istio-proxy" containerID="cri-o://b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd" gracePeriod=30
Jul 02 23:35:45.509454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.509424    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:45.529424 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529534    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529628 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529608    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psndt\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529641    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket\") pod \"c0d144a1-1556-49e9-b158-453b2c5755c6\" (UID: \"c0d144a1-1556-49e9-b158-453b2c5755c6\") "
Jul 02 23:35:45.529921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.529856    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:45.530624 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.530577    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:45.532682 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.532550    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:35:45.532823 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.532802    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:45.533147 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533124    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:45.533599 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533566    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533598    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533622    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533635    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533648    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533662    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d144a1-1556-49e9-b158-453b2c5755c6-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.533696 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.533682    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:45.534379 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.534349    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt" (OuterVolumeSpecName: "kube-api-access-psndt") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "kube-api-access-psndt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:45.535539 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.535515    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0d144a1-1556-49e9-b158-453b2c5755c6" (UID: "c0d144a1-1556-49e9-b158-453b2c5755c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:45.634210 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.634178    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.634210 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.634204    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.634210 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.634215    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psndt\" (UniqueName: \"kubernetes.io/projected/c0d144a1-1556-49e9-b158-453b2c5755c6-kube-api-access-psndt\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:45.634450 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:45.634227    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d144a1-1556-49e9-b158-453b2c5755c6-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:35:46.299789 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.299756    2573 generic.go:356] "Generic (PLEG): container finished" podID="c0d144a1-1556-49e9-b158-453b2c5755c6" containerID="b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd" exitCode=0
Jul 02 23:35:46.300017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.299802    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"
Jul 02 23:35:46.300017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.299840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" event={"ID":"c0d144a1-1556-49e9-b158-453b2c5755c6","Type":"ContainerDied","Data":"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"}
Jul 02 23:35:46.300017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.299925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6" event={"ID":"c0d144a1-1556-49e9-b158-453b2c5755c6","Type":"ContainerDied","Data":"82d03ac08fc933474cf781cca1b4cd5b1babfa8413b659a0b17b76cb99489b57"}
Jul 02 23:35:46.300017 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.299948    2573 scope.go:117] "RemoveContainer" containerID="b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"
Jul 02 23:35:46.309303 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.309284    2573 scope.go:117] "RemoveContainer" containerID="b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"
Jul 02 23:35:46.309558 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:35:46.309539    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd\": container with ID starting with b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd not found: ID does not exist" containerID="b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"
Jul 02 23:35:46.309609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.309565    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd"} err="failed to get container status \"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd\": rpc error: code = NotFound desc = could not find container \"b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd\": container with ID starting with b6aa86867759753de76289864c94bc409512d8e57509a1f5dae525ab95ef00fd not found: ID does not exist"
Jul 02 23:35:46.321807 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.321780    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:46.328689 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.328664    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ee1caf8b-openshift-default-844c4587f9-dlhj6"]
Jul 02 23:35:46.534903 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:35:46.534858    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d144a1-1556-49e9-b158-453b2c5755c6" path="/var/lib/kubelet/pods/c0d144a1-1556-49e9-b158-453b2c5755c6/volumes"
Jul 02 23:37:20.941913 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.941865    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:20.942409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.942358    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d144a1-1556-49e9-b158-453b2c5755c6" containerName="istio-proxy"
Jul 02 23:37:20.942409 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.942371    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d144a1-1556-49e9-b158-453b2c5755c6" containerName="istio-proxy"
Jul 02 23:37:20.942485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.942445    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d144a1-1556-49e9-b158-453b2c5755c6" containerName="istio-proxy"
Jul 02 23:37:20.945533 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.945515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:20.948343 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.948319    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-27a6656e-openshift-default-dockercfg-bscvk\""
Jul 02 23:37:20.963526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:20.963498    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:21.013281 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013281 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkdwl\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013571 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.013796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.013635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114156 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkdwl\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114702 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114662    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114852 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.114932 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.114845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.115111 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.115088    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.116772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.116737    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.116877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.116845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.122380 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.122359    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.122471 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.122387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkdwl\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl\") pod \"e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") " pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.256803 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.256708    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:21.399083 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.399057    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:21.401134 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:37:21.401097    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e4b232_5e2c_4ccd_b002_4ac394b5f6e5.slice/crio-c2f38c1cd97435b856564495a6de16e06439fd76b141cb28dd42668a34e348e0 WatchSource:0}: Error finding container c2f38c1cd97435b856564495a6de16e06439fd76b141cb28dd42668a34e348e0: Status 404 returned error can't find the container with id c2f38c1cd97435b856564495a6de16e06439fd76b141cb28dd42668a34e348e0
Jul 02 23:37:21.403482 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.403444    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:21.403560 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.403527    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:21.403600 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.403574    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:21.792092 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.792058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerStarted","Data":"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"}
Jul 02 23:37:21.792278 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.792114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerStarted","Data":"c2f38c1cd97435b856564495a6de16e06439fd76b141cb28dd42668a34e348e0"}
Jul 02 23:37:21.814131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:21.814078    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podStartSLOduration=1.8140616189999998 podStartE2EDuration="1.814061619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:21.812132669 +0000 UTC m=+1629.796201030" watchObservedRunningTime="2026-07-02 23:37:21.814061619 +0000 UTC m=+1629.798129978"
Jul 02 23:37:22.257746 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:22.257715    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:22.263967 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:22.263938    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:22.797732 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:22.797700    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:22.798713 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:22.798697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:36.877840 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.877811    2573 generic.go:356] "Generic (PLEG): container finished" podID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerID="e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda" exitCode=0
Jul 02 23:37:36.878211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.877900    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerDied","Data":"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"}
Jul 02 23:37:36.878294 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.878281    2573 scope.go:117] "RemoveContainer" containerID="e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"
Jul 02 23:37:36.879418 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.879389    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:36.879485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.879469    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:36.879544 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:36.879518    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:37:37.798124 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:37.798083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:37.884337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:37.884308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerStarted","Data":"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"}
Jul 02 23:37:38.256974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:38.256933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:38.258187 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:38.258160    2573 patch_prober.go:28] interesting pod/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 23:37:38.258340 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:38.258249    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 23:37:39.257859 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:39.257820    2573 patch_prober.go:28] interesting pod/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 23:37:39.258312 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:39.257876    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 23:37:40.257578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:40.257541    2573 patch_prober.go:28] interesting pod/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 23:37:40.257772 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:40.257597    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 23:37:41.257319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:41.257281    2573 patch_prober.go:28] interesting pod/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 23:37:41.257719 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:41.257346    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 23:37:42.163629 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:42.163586    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:42.163834 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:42.163809    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy" containerID="cri-o://f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d" gracePeriod=30
Jul 02 23:37:47.425394 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.425362    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:47.563470 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563420    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563470 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563521    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563556    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.563749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.564109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563746    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:37:47.564109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563815    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:37:47.564109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.563836    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkdwl\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl\") pod \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\" (UID: \"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5\") "
Jul 02 23:37:47.564109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564066    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:37:47.564300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564194    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.564300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564235    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.564300 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564250    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.564429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564360    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:37:47.564684 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.564656    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:37:47.566358 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.566331    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:37:47.566473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.566331    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:37:47.569925 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.567257    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:37:47.572356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.571025    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl" (OuterVolumeSpecName: "kube-api-access-pkdwl") pod "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" (UID: "a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5"). InnerVolumeSpecName "kube-api-access-pkdwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:37:47.665136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665098    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.665136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665128    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.665136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665137    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.665136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665146    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.665399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665154    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.665399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.665163    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkdwl\" (UniqueName: \"kubernetes.io/projected/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5-kube-api-access-pkdwl\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:37:47.936912 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.936854    2573 generic.go:356] "Generic (PLEG): container finished" podID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerID="f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d" exitCode=0
Jul 02 23:37:47.937104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.936946    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"
Jul 02 23:37:47.937104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.936953    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerDied","Data":"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"}
Jul 02 23:37:47.937104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.937050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7" event={"ID":"a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5","Type":"ContainerDied","Data":"c2f38c1cd97435b856564495a6de16e06439fd76b141cb28dd42668a34e348e0"}
Jul 02 23:37:47.937104 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.937080    2573 scope.go:117] "RemoveContainer" containerID="f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"
Jul 02 23:37:47.947219 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.947199    2573 scope.go:117] "RemoveContainer" containerID="e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"
Jul 02 23:37:47.955161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.955143    2573 scope.go:117] "RemoveContainer" containerID="f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"
Jul 02 23:37:47.955407 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:37:47.955389    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d\": container with ID starting with f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d not found: ID does not exist" containerID="f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"
Jul 02 23:37:47.955480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.955419    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d"} err="failed to get container status \"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d\": rpc error: code = NotFound desc = could not find container \"f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d\": container with ID starting with f2f3b0afa3bdc2497c5e57e3af066b67f6a7ba350fd0db1640932a40caa1ae6d not found: ID does not exist"
Jul 02 23:37:47.955480 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.955444    2573 scope.go:117] "RemoveContainer" containerID="e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"
Jul 02 23:37:47.955738 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:37:47.955708    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda\": container with ID starting with e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda not found: ID does not exist" containerID="e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"
Jul 02 23:37:47.955783 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.955733    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda"} err="failed to get container status \"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda\": rpc error: code = NotFound desc = could not find container \"e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda\": container with ID starting with e8d6b713a136d93d2b62c7e23fe2f51d96475edbba04e59eabfcdd790764edda not found: ID does not exist"
Jul 02 23:37:47.960262 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.960243    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:47.966451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:47.966431    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-27a6656e-openshift-default-fbd5d58ff-jfst7"]
Jul 02 23:37:48.539180 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:37:48.539146    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" path="/var/lib/kubelet/pods/a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5/volumes"
Jul 02 23:38:01.416374 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.416335    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:38:01.416965 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.416949    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.417022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.416968    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.417022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.416997    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.417022 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.417006    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.417126 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.417110    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.417126 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.417122    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e4b232-5e2c-4ccd-b002-4ac394b5f6e5" containerName="istio-proxy"
Jul 02 23:38:01.422258 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.422235    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.425004 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.424979    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fe62b48c-openshift-default-dockercfg-t577t\""
Jul 02 23:38:01.433859 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.433830    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:38:01.469232 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469430 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhsq6\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469430 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469430 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469430 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469573 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469573 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469573 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.469667 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.469576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570044 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.569991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570349 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhsq6\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570634 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570771 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.570933 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.571040 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.571028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.571218 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.571205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.571320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.571307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.571711 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.571691    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.572169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.571914    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.572169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.570663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.572169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.572074    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.572367 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.572180    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.572809 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.572788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.573272 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.573248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.578672 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.578643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.578955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.578932    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhsq6\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6\") pod \"e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") " pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.735740 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.735699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:01.899249 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.899202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:38:01.902477 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:38:01.902433    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb898f05_2579_4310_ab69_f7b1669599c6.slice/crio-7b944b5c360298c2d26db10ee5d238ed908bb719deac1343d9bf9ae8260047eb WatchSource:0}: Error finding container 7b944b5c360298c2d26db10ee5d238ed908bb719deac1343d9bf9ae8260047eb: Status 404 returned error can't find the container with id 7b944b5c360298c2d26db10ee5d238ed908bb719deac1343d9bf9ae8260047eb
Jul 02 23:38:01.905273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.905236    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:01.905500 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.905472    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:01.905615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:01.905527    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:02.012670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:02.012571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerStarted","Data":"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"}
Jul 02 23:38:02.012670 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:02.012630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerStarted","Data":"7b944b5c360298c2d26db10ee5d238ed908bb719deac1343d9bf9ae8260047eb"}
Jul 02 23:38:02.034356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:02.034288    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podStartSLOduration=1.034265696 podStartE2EDuration="1.034265696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:02.033348787 +0000 UTC m=+1670.017417149" watchObservedRunningTime="2026-07-02 23:38:02.034265696 +0000 UTC m=+1670.018334058"
Jul 02 23:38:02.736819 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:02.736785    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:02.741566 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:02.741540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:03.017917 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:03.017818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:03.018935 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:03.018915    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:18.019320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.019286    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 23:38:18.019768 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.019352    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 23:38:18.103523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.103490    2573 generic.go:356] "Generic (PLEG): container finished" podID="cb898f05-2579-4310-ab69-f7b1669599c6" containerID="34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92" exitCode=0
Jul 02 23:38:18.103701 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.103560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerDied","Data":"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"}
Jul 02 23:38:18.103980 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.103966    2573 scope.go:117] "RemoveContainer" containerID="34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"
Jul 02 23:38:18.104977 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.104946    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:18.105055 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.105018    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:18.105093 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:18.105056    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:38:19.110204 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:19.110168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerStarted","Data":"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"}
Jul 02 23:38:19.737232 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:19.737189    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:19.737461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:19.737328    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 23:38:19.737461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:19.737374    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 23:38:20.736992 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:20.736950    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 23:38:20.737525 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:20.737017    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 23:38:21.736845 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:21.736802    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 23:38:21.737083 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:21.736901    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 23:38:22.736638 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:22.736600    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 23:38:22.736958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:22.736930    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 23:38:23.740503 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:23.740472    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:23.740911 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:23.740818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:38:23.741489 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:38:23.741471    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:40:12.578990 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:40:12.578959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:40:12.586640 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:40:12.586618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:41:20.023685 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:20.023652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:41:20.024302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:20.023939    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" containerID="cri-o://1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d" gracePeriod=30
Jul 02 23:41:23.743753 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:23.743715    2573 patch_prober.go:28] interesting pod/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:41:23.744181 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:23.743771    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:41:25.281636 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.281612    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:41:25.389776 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.389776 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389730    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.389776 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhsq6\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.389858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390071    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390340 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390155    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket\") pod \"cb898f05-2579-4310-ab69-f7b1669599c6\" (UID: \"cb898f05-2579-4310-ab69-f7b1669599c6\") "
Jul 02 23:41:25.390340 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390271    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:41:25.390596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390527    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:41:25.390596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390557    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.390775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390726    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:41:25.390775 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390735    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:41:25.390852 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.390830    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:41:25.392196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.392168    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:41:25.392284 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.392173    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:41:25.392419 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.392400    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:41:25.392657 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.392641    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6" (OuterVolumeSpecName: "kube-api-access-bhsq6") pod "cb898f05-2579-4310-ab69-f7b1669599c6" (UID: "cb898f05-2579-4310-ab69-f7b1669599c6"). InnerVolumeSpecName "kube-api-access-bhsq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:41:25.491337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491303    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491332    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491341    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491351    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb898f05-2579-4310-ab69-f7b1669599c6-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491360    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhsq6\" (UniqueName: \"kubernetes.io/projected/cb898f05-2579-4310-ab69-f7b1669599c6-kube-api-access-bhsq6\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491369    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb898f05-2579-4310-ab69-f7b1669599c6-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491376    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:25.491579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:25.491384    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb898f05-2579-4310-ab69-f7b1669599c6-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:41:26.048475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.048442    2573 generic.go:356] "Generic (PLEG): container finished" podID="cb898f05-2579-4310-ab69-f7b1669599c6" containerID="1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d" exitCode=0
Jul 02 23:41:26.048690 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.048495    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"
Jul 02 23:41:26.048690 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.048529    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerDied","Data":"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"}
Jul 02 23:41:26.048690 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.048586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv" event={"ID":"cb898f05-2579-4310-ab69-f7b1669599c6","Type":"ContainerDied","Data":"7b944b5c360298c2d26db10ee5d238ed908bb719deac1343d9bf9ae8260047eb"}
Jul 02 23:41:26.048690 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.048615    2573 scope.go:117] "RemoveContainer" containerID="1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"
Jul 02 23:41:26.061173 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.061145    2573 scope.go:117] "RemoveContainer" containerID="34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"
Jul 02 23:41:26.070476 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.070434    2573 scope.go:117] "RemoveContainer" containerID="1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"
Jul 02 23:41:26.070845 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:41:26.070823    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d\": container with ID starting with 1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d not found: ID does not exist" containerID="1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"
Jul 02 23:41:26.070957 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.070854    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d"} err="failed to get container status \"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d\": rpc error: code = NotFound desc = could not find container \"1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d\": container with ID starting with 1390d5d5cb4af64e76783aa12397c27d5d2d697f97aeb583e1c92350f896640d not found: ID does not exist"
Jul 02 23:41:26.070957 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.070879    2573 scope.go:117] "RemoveContainer" containerID="34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"
Jul 02 23:41:26.071214 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:41:26.071198    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92\": container with ID starting with 34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92 not found: ID does not exist" containerID="34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"
Jul 02 23:41:26.071270 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.071219    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92"} err="failed to get container status \"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92\": rpc error: code = NotFound desc = could not find container \"34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92\": container with ID starting with 34760defba6ac242efe2f3cf18244f4e3bf06b9ca88cb22a8d19fe50b8bd5e92 not found: ID does not exist"
Jul 02 23:41:26.073941 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.073907    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:41:26.077138 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.077114    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fe62b48c-openshift-default-6f47fc6ff9-52tnv"]
Jul 02 23:41:26.542624 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:41:26.542582    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" path="/var/lib/kubelet/pods/cb898f05-2579-4310-ab69-f7b1669599c6/volumes"
Jul 02 23:42:14.518902 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.518838    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:42:14.519414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519322    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.519414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519336    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.519414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519351    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.519414 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519357    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.519640 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519439    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.519640 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.519449    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb898f05-2579-4310-ab69-f7b1669599c6" containerName="istio-proxy"
Jul 02 23:42:14.523788 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.523766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.526679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.526654    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1ef970-openshift-default-dockercfg-jx5wf\""
Jul 02 23:42:14.540220 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.540190    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:42:14.548846 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.548821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.548864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.548914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.548936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.548960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8j8\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.549041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.549081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.549147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.549203 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.549182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650089 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650413    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8j8\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650556 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650626    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650689    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.650738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.650716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.651133 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.651117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.653031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.653015    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.653368 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.653348    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.659481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.659455    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.659584 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.659525    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8j8\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8\") pod \"e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") " pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.834797 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.834706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:14.979706 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.979674    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:42:14.980354 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:42:14.980313    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad25ac9_d129_4214_a880_5dedd0a16efe.slice/crio-1e2e5b3b7b95a4d64323e120ac84ec5e862b2c4a431671b0b4b32760467f0fd5 WatchSource:0}: Error finding container 1e2e5b3b7b95a4d64323e120ac84ec5e862b2c4a431671b0b4b32760467f0fd5: Status 404 returned error can't find the container with id 1e2e5b3b7b95a4d64323e120ac84ec5e862b2c4a431671b0b4b32760467f0fd5
Jul 02 23:42:14.982633 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.982595    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:14.982703 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.982677    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:14.982741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:14.982721    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:15.298141 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:15.298103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerStarted","Data":"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"}
Jul 02 23:42:15.298296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:15.298161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerStarted","Data":"1e2e5b3b7b95a4d64323e120ac84ec5e862b2c4a431671b0b4b32760467f0fd5"}
Jul 02 23:42:15.345950 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:15.345869    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podStartSLOduration=1.345851894 podStartE2EDuration="1.345851894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:15.344981237 +0000 UTC m=+1923.329049597" watchObservedRunningTime="2026-07-02 23:42:15.345851894 +0000 UTC m=+1923.329920254"
Jul 02 23:42:15.835663 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:15.835627    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:16.840666 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:16.840632    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:17.309976 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:17.309950    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:17.311132 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:17.311108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:22.455745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.455713    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:42:22.459454 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.459431    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.462698 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.462671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-20977a-openshift-default-dockercfg-dv4lq\""
Jul 02 23:42:22.470170 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.470147    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:42:22.527745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.527708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.527974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.527769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.527974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.527844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.527974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.527906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.527974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.527936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.528130 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.528034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.528130 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.528100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.528210 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.528131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrm9r\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.528210 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.528157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629108 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrm9r\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629307 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629608 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629773 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629633    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629832 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629786    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.629919 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.629834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.630084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.630059    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.630084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.630067    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.631943 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.631925    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.632280 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.632261    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.637021 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.636999    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.637198 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.637179    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrm9r\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r\") pod \"e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") " pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.773736 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.773643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:22.913099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.913068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:42:22.914986 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:42:22.914947    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a428d4_cc3d_4931_b022_6e1cec5d3685.slice/crio-ce3d54158fe5e7405aeb138d4c891c79aaec8de527eb15e4a0e7aeba796b6279 WatchSource:0}: Error finding container ce3d54158fe5e7405aeb138d4c891c79aaec8de527eb15e4a0e7aeba796b6279: Status 404 returned error can't find the container with id ce3d54158fe5e7405aeb138d4c891c79aaec8de527eb15e4a0e7aeba796b6279
Jul 02 23:42:22.917257 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.917218    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:22.917339 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.917310    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:22.917386 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:22.917352    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:23.342490 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:23.342452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerStarted","Data":"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"}
Jul 02 23:42:23.342671 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:23.342503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerStarted","Data":"ce3d54158fe5e7405aeb138d4c891c79aaec8de527eb15e4a0e7aeba796b6279"}
Jul 02 23:42:23.362533 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:23.362466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podStartSLOduration=1.36244403 podStartE2EDuration="1.36244403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:23.361826709 +0000 UTC m=+1931.345895071" watchObservedRunningTime="2026-07-02 23:42:23.36244403 +0000 UTC m=+1931.346512391"
Jul 02 23:42:23.774580 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:23.774542    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:23.779354 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:23.779333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:24.347726 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:24.347689    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:24.348730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:24.348707    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:32.311326 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.311287    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 02 23:42:32.311752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.311362    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 02 23:42:32.400523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.400490    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerID="07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648" exitCode=0
Jul 02 23:42:32.400695 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.400562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerDied","Data":"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"}
Jul 02 23:42:32.401016 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.401002    2573 scope.go:117] "RemoveContainer" containerID="07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"
Jul 02 23:42:32.402027 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.401998    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:32.402139 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.402120    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:32.402204 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:32.402173    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:33.407738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:33.407707    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerStarted","Data":"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"}
Jul 02 23:42:33.836109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:33.836073    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:33.836463 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:33.836441    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 02 23:42:33.836612 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:33.836588    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 02 23:42:34.835403 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:34.835358    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 02 23:42:34.835951 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:34.835427    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 02 23:42:35.835380 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:35.835344    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 02 23:42:35.835654 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:35.835623    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 02 23:42:36.835717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:36.835673    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 02 23:42:36.836253 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:36.835764    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 02 23:42:37.839099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:37.839068    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:37.839508 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:37.839362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:37.840193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:37.840177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:42:39.349697 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.349664    2573 patch_prober.go:28] interesting pod/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 23:42:39.350136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.349724    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 23:42:39.441713 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.441681    2573 generic.go:356] "Generic (PLEG): container finished" podID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerID="496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c" exitCode=0
Jul 02 23:42:39.441918 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.441758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerDied","Data":"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"}
Jul 02 23:42:39.442269 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.442246    2573 scope.go:117] "RemoveContainer" containerID="496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"
Jul 02 23:42:39.443255 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.443229    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:39.443314 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.443292    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:39.443350 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:39.443324    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:42:40.453150 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:40.453106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerStarted","Data":"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"}
Jul 02 23:42:40.774088 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:40.773989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:40.774288 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:40.774269    2573 patch_prober.go:28] interesting pod/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 23:42:40.774333 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:40.774315    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 23:42:41.775099 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:41.775057    2573 patch_prober.go:28] interesting pod/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 23:42:41.775598 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:41.775130    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 23:42:42.774866 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:42.774823    2573 patch_prober.go:28] interesting pod/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 23:42:42.775136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:42.774906    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 23:42:43.775057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:43.775016    2573 patch_prober.go:28] interesting pod/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 23:42:43.775316 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:43.775078    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 23:42:44.777624 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:44.777591    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:44.778123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:44.777984    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:42:44.778665 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:42:44.778647    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:44:22.623833 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:22.623798    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:44:22.624471 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:22.624081    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" containerID="cri-o://1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf" gracePeriod=30
Jul 02 23:44:22.841963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:22.841913    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:44:22.842122 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:22.841987    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:44:27.886962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.886877    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:44:27.936677 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.936871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.936871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d8j8\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.936871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936814    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.936871 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936848    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.937131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936902    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.937131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.937131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.936990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.937131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data\") pod \"8ad25ac9-d129-4214-a880-5dedd0a16efe\" (UID: \"8ad25ac9-d129-4214-a880-5dedd0a16efe\") "
Jul 02 23:44:27.937131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937104    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:27.937416 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937362    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:27.937579 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937475    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:44:27.938005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937811    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:27.938005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.937963    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:27.938231 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.938195    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:27.939334 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.939301    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:27.940029 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.939999    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:27.940132 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.940085    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:44:27.941109 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:27.941080    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8" (OuterVolumeSpecName: "kube-api-access-8d8j8") pod "8ad25ac9-d129-4214-a880-5dedd0a16efe" (UID: "8ad25ac9-d129-4214-a880-5dedd0a16efe"). InnerVolumeSpecName "kube-api-access-8d8j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:28.005326 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.005285    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerID="1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf" exitCode=0
Jul 02 23:44:28.005520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.005335    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"
Jul 02 23:44:28.005520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.005373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerDied","Data":"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"}
Jul 02 23:44:28.005520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.005439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf" event={"ID":"8ad25ac9-d129-4214-a880-5dedd0a16efe","Type":"ContainerDied","Data":"1e2e5b3b7b95a4d64323e120ac84ec5e862b2c4a431671b0b4b32760467f0fd5"}
Jul 02 23:44:28.005520 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.005469    2573 scope.go:117] "RemoveContainer" containerID="1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"
Jul 02 23:44:28.015424 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.015401    2573 scope.go:117] "RemoveContainer" containerID="07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"
Jul 02 23:44:28.023896 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.023864    2573 scope.go:117] "RemoveContainer" containerID="1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"
Jul 02 23:44:28.024213 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:44:28.024194    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf\": container with ID starting with 1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf not found: ID does not exist" containerID="1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"
Jul 02 23:44:28.024262 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.024223    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf"} err="failed to get container status \"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf\": rpc error: code = NotFound desc = could not find container \"1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf\": container with ID starting with 1bcf7f6398fde3cd18f0d1d8ea7ea7b54fe7a4e3c36fec3a53d3c426b8af69cf not found: ID does not exist"
Jul 02 23:44:28.024262 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.024243    2573 scope.go:117] "RemoveContainer" containerID="07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"
Jul 02 23:44:28.024493 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:44:28.024477    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648\": container with ID starting with 07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648 not found: ID does not exist" containerID="07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"
Jul 02 23:44:28.024530 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.024499    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648"} err="failed to get container status \"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648\": rpc error: code = NotFound desc = could not find container \"07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648\": container with ID starting with 07d4dedab2d25b2a4985a8a27239271b62c00c8d25becb3ef6c8af76ad81f648 not found: ID does not exist"
Jul 02 23:44:28.029534 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.029514    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:44:28.034870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.034846    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1ef970-openshift-default-b55b9b5df-cf6xf"]
Jul 02 23:44:28.037814 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037794    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037817    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037827    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037836    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037845    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d8j8\" (UniqueName: \"kubernetes.io/projected/8ad25ac9-d129-4214-a880-5dedd0a16efe-kube-api-access-8d8j8\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037853    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad25ac9-d129-4214-a880-5dedd0a16efe-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037861    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad25ac9-d129-4214-a880-5dedd0a16efe-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.037870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.037869    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad25ac9-d129-4214-a880-5dedd0a16efe-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:28.535408 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:28.535371    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" path="/var/lib/kubelet/pods/8ad25ac9-d129-4214-a880-5dedd0a16efe/volumes"
Jul 02 23:44:30.316098 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:30.316062    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:44:30.316502 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:30.316327    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy" containerID="cri-o://8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b" gracePeriod=30
Jul 02 23:44:31.187919 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.187871    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:44:31.188473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188448    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.188473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188473    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.188622 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188486    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.188622 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188495    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.188717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188622    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.188717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.188633    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad25ac9-d129-4214-a880-5dedd0a16efe" containerName="istio-proxy"
Jul 02 23:44:31.193511 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.193491    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.196339 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.196322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7318b0-openshift-default-dockercfg-tsw68\""
Jul 02 23:44:31.202960 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.202937    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:44:31.268791 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.268985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.268985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.268985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.268985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.268985 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.268959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.269160 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.269008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.269160 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.269029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.269160 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.269050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5b77\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370336 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370413    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370437    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5b77\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.370777 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370880    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.370982    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371211 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.371181    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.371211    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.371346 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.371256    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.372789 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.372763    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.373032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.373017    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.387411 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.387374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.387545 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.387486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5b77\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77\") pod \"e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") " pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.504349 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.504239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:31.645018 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.644990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:44:31.646712 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:44:31.646686    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2020bb65_47cf_4489_9d9f_dd86c5938f08.slice/crio-722baf9f68a51902a703dcd3cb67b0967ad59fa11a919d367a611923c424b677 WatchSource:0}: Error finding container 722baf9f68a51902a703dcd3cb67b0967ad59fa11a919d367a611923c424b677: Status 404 returned error can't find the container with id 722baf9f68a51902a703dcd3cb67b0967ad59fa11a919d367a611923c424b677
Jul 02 23:44:31.651538 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.651500    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:31.651633 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.651572    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:31.651633 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:31.651601    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:32.029785 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:32.029077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerStarted","Data":"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"}
Jul 02 23:44:32.029785 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:32.029140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerStarted","Data":"722baf9f68a51902a703dcd3cb67b0967ad59fa11a919d367a611923c424b677"}
Jul 02 23:44:32.051993 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:32.051926    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podStartSLOduration=1.051907025 podStartE2EDuration="1.051907025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:32.050150867 +0000 UTC m=+2060.034219250" watchObservedRunningTime="2026-07-02 23:44:32.051907025 +0000 UTC m=+2060.035975387"
Jul 02 23:44:32.504632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:32.504594    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:32.509632 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:32.509602    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:33.035510 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:33.035476    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:33.036366 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:33.036349    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:35.577408 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.577341    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:44:35.712473 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712485    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712516    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712592    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.712680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712659    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.713031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712713    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrm9r\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.713031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712793    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy\") pod \"24a428d4-cc3d-4931-b022-6e1cec5d3685\" (UID: \"24a428d4-cc3d-4931-b022-6e1cec5d3685\") "
Jul 02 23:44:35.713031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712859    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:35.713031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.712871    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:35.713230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713034    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:35.713230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713109    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:44:35.713230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713195    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.713230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713210    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.713230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713220    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.713477 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.713331    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data" (OuterVolumeSpecName: "istio-data") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:35.715084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.715062    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:44:35.715084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.715075    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token" (OuterVolumeSpecName: "istio-token") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:35.715227 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.715108    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:44:35.715227 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.715121    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r" (OuterVolumeSpecName: "kube-api-access-vrm9r") pod "24a428d4-cc3d-4931-b022-6e1cec5d3685" (UID: "24a428d4-cc3d-4931-b022-6e1cec5d3685"). InnerVolumeSpecName "kube-api-access-vrm9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:35.813739 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813702    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a428d4-cc3d-4931-b022-6e1cec5d3685-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.813739 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813734    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.813739 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813745    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.814020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813754    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrm9r\" (UniqueName: \"kubernetes.io/projected/24a428d4-cc3d-4931-b022-6e1cec5d3685-kube-api-access-vrm9r\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.814020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813764    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:35.814020 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:35.813772    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a428d4-cc3d-4931-b022-6e1cec5d3685-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:44:36.052818 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.052780    2573 generic.go:356] "Generic (PLEG): container finished" podID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerID="8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b" exitCode=0
Jul 02 23:44:36.053027 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.052861    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"
Jul 02 23:44:36.053027 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.052865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerDied","Data":"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"}
Jul 02 23:44:36.053027 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.052977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f" event={"ID":"24a428d4-cc3d-4931-b022-6e1cec5d3685","Type":"ContainerDied","Data":"ce3d54158fe5e7405aeb138d4c891c79aaec8de527eb15e4a0e7aeba796b6279"}
Jul 02 23:44:36.053027 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.053000    2573 scope.go:117] "RemoveContainer" containerID="8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"
Jul 02 23:44:36.062496 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.062479    2573 scope.go:117] "RemoveContainer" containerID="496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"
Jul 02 23:44:36.070983 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.070963    2573 scope.go:117] "RemoveContainer" containerID="8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"
Jul 02 23:44:36.071278 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:44:36.071258    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b\": container with ID starting with 8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b not found: ID does not exist" containerID="8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"
Jul 02 23:44:36.071360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.071294    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b"} err="failed to get container status \"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b\": rpc error: code = NotFound desc = could not find container \"8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b\": container with ID starting with 8eef13eadda4a0d8ed2e7fb68762cd2ccea12185033d0514dfd70ea8b8d5a18b not found: ID does not exist"
Jul 02 23:44:36.071360 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.071320    2573 scope.go:117] "RemoveContainer" containerID="496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"
Jul 02 23:44:36.071609 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:44:36.071592    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c\": container with ID starting with 496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c not found: ID does not exist" containerID="496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"
Jul 02 23:44:36.071646 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.071616    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c"} err="failed to get container status \"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c\": rpc error: code = NotFound desc = could not find container \"496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c\": container with ID starting with 496a6ec43fbf05e32709f2536727248717185fde43c00c382689b87650e43e3c not found: ID does not exist"
Jul 02 23:44:36.075324 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.075301    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:44:36.085144 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.085120    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-20977a-openshift-default-79d589ccb7-tps6f"]
Jul 02 23:44:36.535277 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:36.535247    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" path="/var/lib/kubelet/pods/24a428d4-cc3d-4931-b022-6e1cec5d3685/volumes"
Jul 02 23:44:39.377152 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377117    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:44:39.377765 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377745    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.377828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377768    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.377828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377803    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.377828 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377812    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.378021 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377950    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.378021 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.377964    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a428d4-cc3d-4931-b022-6e1cec5d3685" containerName="istio-proxy"
Jul 02 23:44:39.382928 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.382876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.385703 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.385682    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-06bba8-openshift-default-dockercfg-lmjcw\""
Jul 02 23:44:39.391875 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.391854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:44:39.548451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.548451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.548717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.548717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.548717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.548717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.549955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.549955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvjk\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.549955 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.548865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.649720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.649720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvjk\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.649720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650012 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.649860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.650236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.650259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650363 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.650327    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.650412    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.650623 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.650600    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.652290 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.652263    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.652435 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.652418    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.660711 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.660686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.660980 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.660951    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvjk\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk\") pod \"e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") " pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.694049 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.694014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:39.841849 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.841822    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:44:39.843345 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:44:39.843318    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a72325a_0794_4c09_b9dd_e0c22f2878b1.slice/crio-d2f0cebdef5d1f4bce6ad4ade53cee95bb7bb365efab718cb8919b9f5ec62a42 WatchSource:0}: Error finding container d2f0cebdef5d1f4bce6ad4ade53cee95bb7bb365efab718cb8919b9f5ec62a42: Status 404 returned error can't find the container with id d2f0cebdef5d1f4bce6ad4ade53cee95bb7bb365efab718cb8919b9f5ec62a42
Jul 02 23:44:39.845593 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.845563    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:39.845673 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.845628    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:39.845673 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:39.845657    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:40.078468 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:40.078411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerStarted","Data":"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"}
Jul 02 23:44:40.078730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:40.078476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerStarted","Data":"d2f0cebdef5d1f4bce6ad4ade53cee95bb7bb365efab718cb8919b9f5ec62a42"}
Jul 02 23:44:40.101084 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:40.101026    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podStartSLOduration=1.101006997 podStartE2EDuration="1.101006997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:40.098099539 +0000 UTC m=+2068.082167913" watchObservedRunningTime="2026-07-02 23:44:40.101006997 +0000 UTC m=+2068.085075357"
Jul 02 23:44:40.694337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:40.694295    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:40.699485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:40.699459    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:41.085743 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:41.085659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:41.086561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:41.086541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:48.037650 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.037615    2573 patch_prober.go:28] interesting pod/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 23:44:48.038100 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.037681    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 23:44:48.125188 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.125151    2573 generic.go:356] "Generic (PLEG): container finished" podID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerID="ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc" exitCode=0
Jul 02 23:44:48.125355 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.125225    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerDied","Data":"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"}
Jul 02 23:44:48.125630 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.125611    2573 scope.go:117] "RemoveContainer" containerID="ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"
Jul 02 23:44:48.126639 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.126612    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:48.126719 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.126677    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:48.126719 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:48.126707    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:49.135917 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:49.135415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerStarted","Data":"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"}
Jul 02 23:44:49.505174 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:49.505136    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:49.505396 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:49.505366    2573 patch_prober.go:28] interesting pod/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 23:44:49.505475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:49.505422    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 23:44:50.505485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:50.505454    2573 patch_prober.go:28] interesting pod/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 23:44:50.505862 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:50.505509    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 23:44:51.504986 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:51.504947    2573 patch_prober.go:28] interesting pod/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 23:44:51.505181 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:51.505000    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 23:44:52.505320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:52.505286    2573 patch_prober.go:28] interesting pod/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 23:44:52.505717 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:52.505338    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 23:44:53.508508 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:53.508477    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:53.508952 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:53.508794    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:53.509374 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:53.509359    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:44:56.980578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:56.980240    2573 patch_prober.go:28] interesting pod/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:48470->10.133.0.61:15021: read: connection reset by peer" start-of-body=
Jul 02 23:44:56.980578 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:56.980306    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:48470->10.133.0.61:15021: read: connection reset by peer"
Jul 02 23:44:57.188352 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.188319    2573 generic.go:356] "Generic (PLEG): container finished" podID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerID="6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78" exitCode=0
Jul 02 23:44:57.188527 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.188385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerDied","Data":"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"}
Jul 02 23:44:57.188820 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.188805    2573 scope.go:117] "RemoveContainer" containerID="6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"
Jul 02 23:44:57.189784 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.189756    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:57.189839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.189823    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:57.189897 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:57.189857    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:44:58.196204 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:58.196168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerStarted","Data":"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"}
Jul 02 23:44:58.694290 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:58.694261    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:44:58.694537 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:58.694516    2573 patch_prober.go:28] interesting pod/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 02 23:44:58.694591 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:58.694567    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 02 23:44:59.695002 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:59.694959    2573 patch_prober.go:28] interesting pod/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 02 23:44:59.695475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:44:59.695022    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 02 23:45:00.695073 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:00.695040    2573 patch_prober.go:28] interesting pod/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 02 23:45:00.695462 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:00.695095    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 02 23:45:01.242041 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:01.242003    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:45:01.242517 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:01.242484    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy" containerID="cri-o://479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818" gracePeriod=30
Jul 02 23:45:01.695119 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:01.695082    2573 patch_prober.go:28] interesting pod/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 02 23:45:01.695521 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:01.695137    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 02 23:45:02.698376 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:02.698344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:45:02.698849 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:02.698716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:45:02.699428 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:02.699412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:45:06.498327 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.498301    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:45:06.631404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631308    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631342    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631404 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631377    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631432    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631662    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:06.631679 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631673    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.632032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631761    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:06.632032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631774    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5b77\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77\") pod \"2020bb65-47cf-4489-9d9f-dd86c5938f08\" (UID: \"2020bb65-47cf-4489-9d9f-dd86c5938f08\") "
Jul 02 23:45:06.632032 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.631999    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:06.632295 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632264    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:45:06.632667 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632647    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.632764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632669    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.632764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632683    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2020bb65-47cf-4489-9d9f-dd86c5938f08-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.632764 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632695    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.632866 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.632758    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data" (OuterVolumeSpecName: "istio-data") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:06.634234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.634200    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77" (OuterVolumeSpecName: "kube-api-access-g5b77") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "kube-api-access-g5b77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:06.634357 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.634335    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token" (OuterVolumeSpecName: "istio-token") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:06.634401 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.634349    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:06.634676 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.634649    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2020bb65-47cf-4489-9d9f-dd86c5938f08" (UID: "2020bb65-47cf-4489-9d9f-dd86c5938f08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:45:06.733800 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.733761    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.733800 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.733792    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.733800 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.733801    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.733800 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.733810    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2020bb65-47cf-4489-9d9f-dd86c5938f08-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:06.734123 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:06.733820    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5b77\" (UniqueName: \"kubernetes.io/projected/2020bb65-47cf-4489-9d9f-dd86c5938f08-kube-api-access-g5b77\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:07.248001 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.247969    2573 generic.go:356] "Generic (PLEG): container finished" podID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerID="479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818" exitCode=0
Jul 02 23:45:07.248190 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.248018    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"
Jul 02 23:45:07.248190 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.248057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerDied","Data":"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"}
Jul 02 23:45:07.248190 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.248118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn" event={"ID":"2020bb65-47cf-4489-9d9f-dd86c5938f08","Type":"ContainerDied","Data":"722baf9f68a51902a703dcd3cb67b0967ad59fa11a919d367a611923c424b677"}
Jul 02 23:45:07.248190 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.248140    2573 scope.go:117] "RemoveContainer" containerID="479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"
Jul 02 23:45:07.257738 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.257719    2573 scope.go:117] "RemoveContainer" containerID="ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"
Jul 02 23:45:07.265682 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.265664    2573 scope.go:117] "RemoveContainer" containerID="479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"
Jul 02 23:45:07.265973 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:45:07.265954    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818\": container with ID starting with 479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818 not found: ID does not exist" containerID="479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"
Jul 02 23:45:07.266048 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.265984    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818"} err="failed to get container status \"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818\": rpc error: code = NotFound desc = could not find container \"479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818\": container with ID starting with 479b88912b31c2b270a61dcb7d49de26acc4ff14cde01b0ccb9a89ca35f94818 not found: ID does not exist"
Jul 02 23:45:07.266048 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.266008    2573 scope.go:117] "RemoveContainer" containerID="ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"
Jul 02 23:45:07.266254 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:45:07.266237    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc\": container with ID starting with ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc not found: ID does not exist" containerID="ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"
Jul 02 23:45:07.266297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.266260    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc"} err="failed to get container status \"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc\": rpc error: code = NotFound desc = could not find container \"ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc\": container with ID starting with ba6357cff2866a61335efd68fc1b7378e7b3cec9c63db839839e1e75b90745fc not found: ID does not exist"
Jul 02 23:45:07.270024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.270004    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:45:07.274740 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:07.274721    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7318b0-openshift-default-65589db7bf-b5dqn"]
Jul 02 23:45:08.328902 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:08.328860    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:45:08.329391 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:08.329086    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy" containerID="cri-o://691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f" gracePeriod=30
Jul 02 23:45:08.537079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:08.537046    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" path="/var/lib/kubelet/pods/2020bb65-47cf-4489-9d9f-dd86c5938f08/volumes"
Jul 02 23:45:09.207710 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.207680    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:45:09.208117 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.208104    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:09.208184 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.208119    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:09.208224 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.208183    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:09.208224 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.208190    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:09.210963 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.210947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.213835 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.213813    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6d35bd-openshift-default-dockercfg-lkdhl\""
Jul 02 23:45:09.221461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.221435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:45:09.256972 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.256939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257151 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.256986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257151 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257151 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257260 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257295 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257295 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257362 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.257397 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.257374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56v5\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358325 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56v5\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.358796 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.359229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.359229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.358996    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.359229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.359144    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.359229 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.359206    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.359492 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.359260    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.360839 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.360808    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.361135 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.361114    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.366565 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.366538    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.366685 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.366585    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56v5\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5\") pod \"e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") " pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.522725 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.522638    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:09.666053 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.666024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:45:09.667629 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:45:09.667597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5b724b_dcce_4464_8852_904848e6b1ed.slice/crio-4be067efb627b5b66b68ad4793a70f92acf1cb345ba9699ec6f536ebc4cfea82 WatchSource:0}: Error finding container 4be067efb627b5b66b68ad4793a70f92acf1cb345ba9699ec6f536ebc4cfea82: Status 404 returned error can't find the container with id 4be067efb627b5b66b68ad4793a70f92acf1cb345ba9699ec6f536ebc4cfea82
Jul 02 23:45:09.669958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.669873    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:09.670063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.669995    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:09.670063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:09.670033    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:10.266063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:10.266027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerStarted","Data":"8258a972ca6bc845b71b8a82b0838053313ed538ee519c0cc1b9ce2b155d8063"}
Jul 02 23:45:10.266241 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:10.266083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerStarted","Data":"4be067efb627b5b66b68ad4793a70f92acf1cb345ba9699ec6f536ebc4cfea82"}
Jul 02 23:45:10.306988 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:10.306936    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podStartSLOduration=1.306919567 podStartE2EDuration="1.306919567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:10.305684834 +0000 UTC m=+2098.289753194" watchObservedRunningTime="2026-07-02 23:45:10.306919567 +0000 UTC m=+2098.290987926"
Jul 02 23:45:10.523596 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:10.523494    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:10.536375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:10.536342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:11.271691 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:11.271659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:11.272758 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:11.272741    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:12.612007 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:12.611981    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:45:12.619617 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:12.619599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:45:13.596478 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.596415    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:45:13.703127 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703090    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703211    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703305    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703350    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703398    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsvjk\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk\") pod \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\" (UID: \"0a72325a-0794-4c09-b9dd-e0c22f2878b1\") "
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703449    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:13.703615 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703520    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703642    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703781    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703809    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703842    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.703859    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.704197 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.704180    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:13.705601 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.705571    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:13.705722 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.705612    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:45:13.705863 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.705836    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:45:13.705974 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.705909    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk" (OuterVolumeSpecName: "kube-api-access-bsvjk") pod "0a72325a-0794-4c09-b9dd-e0c22f2878b1" (UID: "0a72325a-0794-4c09-b9dd-e0c22f2878b1"). InnerVolumeSpecName "kube-api-access-bsvjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:13.805234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805201    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.805234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805227    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.805234 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805236    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.805451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805246    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsvjk\" (UniqueName: \"kubernetes.io/projected/0a72325a-0794-4c09-b9dd-e0c22f2878b1-kube-api-access-bsvjk\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.805451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805256    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:13.805451 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:13.805264    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a72325a-0794-4c09-b9dd-e0c22f2878b1-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:45:14.294374 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.294339    2573 generic.go:356] "Generic (PLEG): container finished" podID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerID="691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f" exitCode=0
Jul 02 23:45:14.294542 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.294370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerDied","Data":"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"}
Jul 02 23:45:14.294542 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.294421    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"
Jul 02 23:45:14.294542 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.294457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6" event={"ID":"0a72325a-0794-4c09-b9dd-e0c22f2878b1","Type":"ContainerDied","Data":"d2f0cebdef5d1f4bce6ad4ade53cee95bb7bb365efab718cb8919b9f5ec62a42"}
Jul 02 23:45:14.294542 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.294492    2573 scope.go:117] "RemoveContainer" containerID="691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"
Jul 02 23:45:14.305230 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.305214    2573 scope.go:117] "RemoveContainer" containerID="6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"
Jul 02 23:45:14.313399 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.313369    2573 scope.go:117] "RemoveContainer" containerID="691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"
Jul 02 23:45:14.313659 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:45:14.313638    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f\": container with ID starting with 691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f not found: ID does not exist" containerID="691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"
Jul 02 23:45:14.313720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.313666    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f"} err="failed to get container status \"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f\": rpc error: code = NotFound desc = could not find container \"691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f\": container with ID starting with 691c226480f0675dad517b3b18acadf8d39b2f268348180b0867445c9d81230f not found: ID does not exist"
Jul 02 23:45:14.313720 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.313683    2573 scope.go:117] "RemoveContainer" containerID="6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"
Jul 02 23:45:14.313954 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:45:14.313925    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78\": container with ID starting with 6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78 not found: ID does not exist" containerID="6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"
Jul 02 23:45:14.314010 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.313962    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78"} err="failed to get container status \"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78\": rpc error: code = NotFound desc = could not find container \"6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78\": container with ID starting with 6e8c56c36f5fb0ab8015862c14600d8382a0e95375007e9848deb33497032f78 not found: ID does not exist"
Jul 02 23:45:14.318734 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.318703    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:45:14.320742 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.320722    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-06bba8-openshift-default-557b87f74c-pg2d6"]
Jul 02 23:45:14.536061 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:14.536027    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" path="/var/lib/kubelet/pods/0a72325a-0794-4c09-b9dd-e0c22f2878b1/volumes"
Jul 02 23:45:17.400954 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.400920    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:45:17.401534 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401509    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:17.401534 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401534    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2020bb65-47cf-4489-9d9f-dd86c5938f08" containerName="istio-proxy"
Jul 02 23:45:17.401675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401552    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:45:17.401675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401561    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:45:17.401675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401658    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:45:17.401675 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.401670    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:45:17.404553 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.404534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.407240 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.407225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ed05a5-openshift-default-dockercfg-4wxhq\""
Jul 02 23:45:17.416594 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.416566    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:45:17.553559 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.553769 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.553769 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.553769 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.553769 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.553769 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8mc\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.554087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.554087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.554087 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.553852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.654957 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.654843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.654957 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.654910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8mc\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.654961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.654990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655196 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655516 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655516 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.655921 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.655875    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.656057 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.656011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.656206 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.656184    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.656271 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.656259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.657575 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.657557    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.657978 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.657941    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.663035 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.663007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.663252 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.663236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8mc\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc\") pod \"e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") " pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.715548 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.715510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:17.910903 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.910862    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:45:17.912256 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:45:17.912233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d912756_7524_4e64_9bb9_335004eb057f.slice/crio-68e9c2693b7c75cc83caa0ad2461d43ad89bf5445ce6c2efb6956f93e43b0070 WatchSource:0}: Error finding container 68e9c2693b7c75cc83caa0ad2461d43ad89bf5445ce6c2efb6956f93e43b0070: Status 404 returned error can't find the container with id 68e9c2693b7c75cc83caa0ad2461d43ad89bf5445ce6c2efb6956f93e43b0070
Jul 02 23:45:17.914622 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.914584    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:17.914701 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.914674    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:17.914737 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:17.914715    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:18.316987 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.316950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerStarted","Data":"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"}
Jul 02 23:45:18.317273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.317013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerStarted","Data":"68e9c2693b7c75cc83caa0ad2461d43ad89bf5445ce6c2efb6956f93e43b0070"}
Jul 02 23:45:18.337485 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.337413    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podStartSLOduration=1.337390163 podStartE2EDuration="1.337390163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:18.335110211 +0000 UTC m=+2106.319178573" watchObservedRunningTime="2026-07-02 23:45:18.337390163 +0000 UTC m=+2106.321458526"
Jul 02 23:45:18.716028 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.715992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:18.717781 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.717752    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:18.717904 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:18.717803    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:19.719618 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:19.719589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:20.329134 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:20.329104    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:20.341166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:20.341138    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:24.352659 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.352624    2573 generic.go:356] "Generic (PLEG): container finished" podID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerID="8258a972ca6bc845b71b8a82b0838053313ed538ee519c0cc1b9ce2b155d8063" exitCode=0
Jul 02 23:45:24.353166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.352697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerDied","Data":"8258a972ca6bc845b71b8a82b0838053313ed538ee519c0cc1b9ce2b155d8063"}
Jul 02 23:45:24.353166 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.353133    2573 scope.go:117] "RemoveContainer" containerID="8258a972ca6bc845b71b8a82b0838053313ed538ee519c0cc1b9ce2b155d8063"
Jul 02 23:45:24.354139 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.354111    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:24.354200 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.354179    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:24.354236 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:24.354206    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:25.361367 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:25.361332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerStarted","Data":"fc98d4fb62bf68c215808e7b0959663f220ded75a5f535f28f1d62a2f7f73530"}
Jul 02 23:45:25.523222 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:25.523184    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:25.524416 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:25.524388    2573 patch_prober.go:28] interesting pod/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 23:45:25.524541 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:25.524451    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 23:45:26.272031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:26.271995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:26.523267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:26.523177    2573 patch_prober.go:28] interesting pod/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 23:45:26.523267 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:26.523228    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 23:45:27.524136 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:27.524095    2573 patch_prober.go:28] interesting pod/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 23:45:27.524558 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:27.524174    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 23:45:28.523193 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:28.523150    2573 patch_prober.go:28] interesting pod/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 23:45:28.523375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:28.523213    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 23:45:29.530773 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:29.530741    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:29.536552 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:29.536478    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:45:35.331100 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.331061    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:35.331515 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.331132    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:35.420131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.420098    2573 generic.go:356] "Generic (PLEG): container finished" podID="9d912756-7524-4e64-9bb9-335004eb057f" containerID="d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56" exitCode=0
Jul 02 23:45:35.420337 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.420173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerDied","Data":"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"}
Jul 02 23:45:35.420646 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.420629    2573 scope.go:117] "RemoveContainer" containerID="d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"
Jul 02 23:45:35.421709 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.421680    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:35.421806 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.421764    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:35.421875 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:35.421812    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:45:36.428005 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:36.427962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerStarted","Data":"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"}
Jul 02 23:45:36.716083 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:36.716056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:36.716293 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:36.716261    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:36.716345 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:36.716325    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:37.716237 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:37.716198    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:37.716665 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:37.716263    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:38.715929 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:38.715872    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:38.716108 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:38.715950    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:39.715941 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:39.715868    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 23:45:39.716344 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:39.715969    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 23:45:40.719561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:40.719526    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:40.719976 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:40.719911    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:45:40.720606 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:45:40.720587    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:50:12.643375 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:50:12.643348    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:50:12.652141 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:50:12.652119    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:51:15.083041 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:15.083002    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:51:15.083593 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:15.083300    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy" containerID="cri-o://fc98d4fb62bf68c215808e7b0959663f220ded75a5f535f28f1d62a2f7f73530" gracePeriod=30
Jul 02 23:51:20.226820 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.226787    2573 generic.go:356] "Generic (PLEG): container finished" podID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerID="fc98d4fb62bf68c215808e7b0959663f220ded75a5f535f28f1d62a2f7f73530" exitCode=0
Jul 02 23:51:20.227328 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.226861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerDied","Data":"fc98d4fb62bf68c215808e7b0959663f220ded75a5f535f28f1d62a2f7f73530"}
Jul 02 23:51:20.227328 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.226982    2573 scope.go:117] "RemoveContainer" containerID="8258a972ca6bc845b71b8a82b0838053313ed538ee519c0cc1b9ce2b155d8063"
Jul 02 23:51:20.346872 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.346798    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:51:20.509699 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509662    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g56v5\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.509877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.509877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509784    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.509877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509809    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.509877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.509877 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.510161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509926    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.510161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.509990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.510161 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data\") pod \"8b5b724b-dcce-4464-8852-904848e6b1ed\" (UID: \"8b5b724b-dcce-4464-8852-904848e6b1ed\") "
Jul 02 23:51:20.510319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510211    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:51:20.510492 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510425    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:20.510563 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510487    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:20.510563 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510537    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b724b-dcce-4464-8852-904848e6b1ed-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.510563 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510559    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.510719 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.510645    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:20.511131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.511105    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:20.512273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.512240    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5" (OuterVolumeSpecName: "kube-api-access-g56v5") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "kube-api-access-g56v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:51:20.512273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.512258    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:20.512273 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.512246    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:51:20.512429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.512301    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b5b724b-dcce-4464-8852-904848e6b1ed" (UID: "8b5b724b-dcce-4464-8852-904848e6b1ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611789    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611819    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611829    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611838    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56v5\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-kube-api-access-g56v5\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611846    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611855    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:20.611878 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:20.611864    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b724b-dcce-4464-8852-904848e6b1ed-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:21.233805 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.233778    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"
Jul 02 23:51:21.234306 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.233779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw" event={"ID":"8b5b724b-dcce-4464-8852-904848e6b1ed","Type":"ContainerDied","Data":"4be067efb627b5b66b68ad4793a70f92acf1cb345ba9699ec6f536ebc4cfea82"}
Jul 02 23:51:21.234306 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.233915    2573 scope.go:117] "RemoveContainer" containerID="fc98d4fb62bf68c215808e7b0959663f220ded75a5f535f28f1d62a2f7f73530"
Jul 02 23:51:21.253951 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.253911    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:51:21.258031 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.258008    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6d35bd-openshift-default-6688455659-fp9cw"]
Jul 02 23:51:21.952952 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.952922    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:51:21.953155 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:21.953133    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" containerID="cri-o://74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1" gracePeriod=30
Jul 02 23:51:22.535356 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:22.535319    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" path="/var/lib/kubelet/pods/8b5b724b-dcce-4464-8852-904848e6b1ed/volumes"
Jul 02 23:51:22.631000 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:22.630953    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd84998d-6sj79_f8ed5f81-f329-48c9-9d4b-d638fecc5644/authorino/0.log"
Jul 02 23:51:25.723060 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:25.723023    2573 patch_prober.go:28] interesting pod/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:51:25.723439 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:25.723083    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:51:27.215700 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.215638    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:51:27.268962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.268932    2573 generic.go:356] "Generic (PLEG): container finished" podID="9d912756-7524-4e64-9bb9-335004eb057f" containerID="74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1" exitCode=0
Jul 02 23:51:27.269120 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.268983    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"
Jul 02 23:51:27.269120 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.268979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerDied","Data":"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"}
Jul 02 23:51:27.269120 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.269112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk" event={"ID":"9d912756-7524-4e64-9bb9-335004eb057f","Type":"ContainerDied","Data":"68e9c2693b7c75cc83caa0ad2461d43ad89bf5445ce6c2efb6956f93e43b0070"}
Jul 02 23:51:27.269228 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.269134    2573 scope.go:117] "RemoveContainer" containerID="74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"
Jul 02 23:51:27.273994 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.273971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274052    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274144    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274252    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274302 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274252    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:27.274562 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274315    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq8mc\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc\") pod \"9d912756-7524-4e64-9bb9-335004eb057f\" (UID: \"9d912756-7524-4e64-9bb9-335004eb057f\") "
Jul 02 23:51:27.274562 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274479    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:27.274680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274645    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.274680 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274667    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.274972 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274933    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:27.274972 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.274945    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:51:27.275178 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.275040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:27.276475 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.276451    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:51:27.276752 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.276711    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:51:27.277056 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.277034    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:51:27.277169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.277145    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc" (OuterVolumeSpecName: "kube-api-access-jq8mc") pod "9d912756-7524-4e64-9bb9-335004eb057f" (UID: "9d912756-7524-4e64-9bb9-335004eb057f"). InnerVolumeSpecName "kube-api-access-jq8mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:51:27.278499 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.278478    2573 scope.go:117] "RemoveContainer" containerID="d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"
Jul 02 23:51:27.296382 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.296360    2573 scope.go:117] "RemoveContainer" containerID="74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"
Jul 02 23:51:27.296661 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:51:27.296639    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1\": container with ID starting with 74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1 not found: ID does not exist" containerID="74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"
Jul 02 23:51:27.296724 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.296668    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1"} err="failed to get container status \"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1\": rpc error: code = NotFound desc = could not find container \"74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1\": container with ID starting with 74c5d43b8d31321b44a998535855dcc9378ce3c63d2b873cbc8da0799b0606b1 not found: ID does not exist"
Jul 02 23:51:27.296724 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.296685    2573 scope.go:117] "RemoveContainer" containerID="d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"
Jul 02 23:51:27.296963 ip-10-0-141-125 kubenswrapper[2573]: E0702 23:51:27.296947    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56\": container with ID starting with d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56 not found: ID does not exist" containerID="d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"
Jul 02 23:51:27.297018 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.296968    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56"} err="failed to get container status \"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56\": rpc error: code = NotFound desc = could not find container \"d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56\": container with ID starting with d1f61bcaf17bcf905c9b1843d946a6696c88a71f9f0ba7d18c69b83fdef4ce56 not found: ID does not exist"
Jul 02 23:51:27.308540 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.308514    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fjbsr_69583d64-afda-4a7a-845b-07a184acba23/manager/0.log"
Jul 02 23:51:27.375958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375910    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq8mc\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-kube-api-access-jq8mc\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.375958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375953    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d912756-7524-4e64-9bb9-335004eb057f-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.375958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375963    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.375958 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375973    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.376244 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375981    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d912756-7524-4e64-9bb9-335004eb057f-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.376244 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375989    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d912756-7524-4e64-9bb9-335004eb057f-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.376244 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.375996    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d912756-7524-4e64-9bb9-335004eb057f-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 02 23:51:27.427040 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.426990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gnh58_014a75de-865f-4580-88c4-cbece1fdc654/manager/0.log"
Jul 02 23:51:27.592934 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.592906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:51:27.598629 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.598601    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ed05a5-openshift-default-5f56ddbf4c-thxvk"]
Jul 02 23:51:27.663864 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.663834    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-jptnh_a716477d-92e2-4d34-9085-a3a75528fe52/cleanup/0.log"
Jul 02 23:51:27.911549 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:27.911471    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56dc4c68dc-8h99m_41f777b4-7c89-47ac-86fe-2f824bb6c999/manager/0.log"
Jul 02 23:51:28.155321 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:28.155294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r6hgs_3f98a7ce-4cb2-418d-a71d-bb5f57b34c39/manager/0.log"
Jul 02 23:51:28.395820 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:28.395793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-rf6rw_2eb311b8-1629-4877-821a-d975bd40956f/copy-manifests/0.log"
Jul 02 23:51:28.409093 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:28.409061    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-rf6rw_2eb311b8-1629-4877-821a-d975bd40956f/manager/0.log"
Jul 02 23:51:28.535435 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:28.535405    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d912756-7524-4e64-9bb9-335004eb057f" path="/var/lib/kubelet/pods/9d912756-7524-4e64-9bb9-335004eb057f/volumes"
Jul 02 23:51:28.647381 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:28.647304    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7ccrp_ddc0c614-1680-4d08-ba43-9e737b0a12e4/postgres/0.log"
Jul 02 23:51:29.943583 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:29.943556    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd84998d-6sj79_f8ed5f81-f329-48c9-9d4b-d638fecc5644/authorino/0.log"
Jul 02 23:51:30.057169 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:30.057141    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-smfwb_5898b7eb-2a14-4cde-9607-2ceed1c54bf9/manager/0.log"
Jul 02 23:51:30.166280 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:30.166217    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x7tk6_5893d752-e8bd-462e-a8ca-3787ffdba037/manager/0.log"
Jul 02 23:51:30.277795 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:30.277717    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f5zxh_3d361d5f-7526-4909-82e3-144fa0460c6b/kuadrant-console-plugin/0.log"
Jul 02 23:51:30.393567 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:30.393539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8t4jt_dca2760b-09cd-4493-a1cc-60073ad626a5/registry-server/0.log"
Jul 02 23:51:30.752172 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:30.752139    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ml5f6_36d63807-8016-4d4b-a3b6-2fd26cf02421/manager/0.log"
Jul 02 23:51:31.106602 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:31.106530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4s25m5_d1e43978-edef-4de5-ad82-71c6f59c3e7d/istio-proxy/0.log"
Jul 02 23:51:31.352266 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:31.352238    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c4d5658d-8rbjm_6df13bb5-1732-4863-886f-aac4648e6f6f/kube-auth-proxy/0.log"
Jul 02 23:51:31.582512 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:31.582479    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/1.log"
Jul 02 23:51:31.698728 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:31.698701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p2snj_4f3b7264-eaf9-4f4f-96b6-209aafde8c59/payload-pre-processing/0.log"
Jul 02 23:51:31.813112 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:31.813085    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-rpmfr_c7e2ec90-a59b-4d21-99c1-e86a0868b82f/payload-processing/0.log"
Jul 02 23:51:32.259842 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:32.259810    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6dc6h_3ef56577-d5db-4232-b836-823ef43538f9/main/0.log"
Jul 02 23:51:32.481509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:32.481482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dfpkn_03a48cfc-6a5d-4c0a-8814-85e92aa176f0/main/0.log"
Jul 02 23:51:39.787429 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:39.787401    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hwdkt_e76d6b91-105e-4eb3-9942-40d5e59a2c4f/global-pull-secret-syncer/0.log"
Jul 02 23:51:39.923461 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:39.923434    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t26ch_76e8ccb3-d79a-4e77-b3f8-08935f215f43/konnectivity-agent/0.log"
Jul 02 23:51:40.028509 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:40.028483    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-125.ec2.internal_6c4d63ef409094950b6ec013bdbf23f0/haproxy/0.log"
Jul 02 23:51:44.986254 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:44.986226    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd84998d-6sj79_f8ed5f81-f329-48c9-9d4b-d638fecc5644/authorino/0.log"
Jul 02 23:51:45.018462 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:45.018435    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-smfwb_5898b7eb-2a14-4cde-9607-2ceed1c54bf9/manager/0.log"
Jul 02 23:51:45.046843 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:45.046818    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x7tk6_5893d752-e8bd-462e-a8ca-3787ffdba037/manager/0.log"
Jul 02 23:51:45.078935 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:45.078910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f5zxh_3d361d5f-7526-4909-82e3-144fa0460c6b/kuadrant-console-plugin/0.log"
Jul 02 23:51:45.132859 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:45.132824    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8t4jt_dca2760b-09cd-4493-a1cc-60073ad626a5/registry-server/0.log"
Jul 02 23:51:45.385737 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:45.385622    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ml5f6_36d63807-8016-4d4b-a3b6-2fd26cf02421/manager/0.log"
Jul 02 23:51:47.245754 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.245720    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68d749d85f-b4khj_5716dca4-9e26-4d85-8f45-57aa1501cd53/metrics-server/0.log"
Jul 02 23:51:47.275527 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.275461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-kb4pq_6fb07652-da2a-4521-9f0e-a97e294e862d/monitoring-plugin/0.log"
Jul 02 23:51:47.484470 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.484440    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xgbnw_a0ef4b39-9d90-4aae-ad09-3638b9470745/node-exporter/0.log"
Jul 02 23:51:47.509831 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.509756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xgbnw_a0ef4b39-9d90-4aae-ad09-3638b9470745/kube-rbac-proxy/0.log"
Jul 02 23:51:47.543613 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.543582    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xgbnw_a0ef4b39-9d90-4aae-ad09-3638b9470745/init-textfile/0.log"
Jul 02 23:51:47.978240 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:47.978213    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/thanos-query/0.log"
Jul 02 23:51:48.000826 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:48.000802    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/kube-rbac-proxy-web/0.log"
Jul 02 23:51:48.031079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:48.031046    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/kube-rbac-proxy/0.log"
Jul 02 23:51:48.054338 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:48.054311    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/prom-label-proxy/0.log"
Jul 02 23:51:48.074741 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:48.074714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/kube-rbac-proxy-rules/0.log"
Jul 02 23:51:48.094798 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:48.094760    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f54999797-kr4tg_745d1524-e3e4-4f1c-9dbc-aafde524418c/kube-rbac-proxy-metrics/0.log"
Jul 02 23:51:49.348217 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:49.348191    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-k49wk_93fa6e10-3c85-42c6-b646-353a7cae8347/networking-console-plugin/0.log"
Jul 02 23:51:49.886626 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:49.886593    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/1.log"
Jul 02 23:51:49.891778 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:49.891754    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7jqsn_856cca8d-8432-428a-80d2-5f79a4e3bfb7/console-operator/2.log"
Jul 02 23:51:50.199460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199424    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"]
Jul 02 23:51:50.199825 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199813    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy"
Jul 02 23:51:50.199870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199826    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy"
Jul 02 23:51:50.199870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199844    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:51:50.199870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199849    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a72325a-0794-4c09-b9dd-e0c22f2878b1" containerName="istio-proxy"
Jul 02 23:51:50.199870 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199866    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199872    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199880    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199903    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199969    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199978    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d912756-7524-4e64-9bb9-335004eb057f" containerName="istio-proxy"
Jul 02 23:51:50.200024 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.199986    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5b724b-dcce-4464-8852-904848e6b1ed" containerName="istio-proxy"
Jul 02 23:51:50.202990 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.202969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.205938 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.205917    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2r2d9\"/\"kube-root-ca.crt\""
Jul 02 23:51:50.206079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.205917    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2r2d9\"/\"openshift-service-ca.crt\""
Jul 02 23:51:50.206079 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.205923    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2r2d9\"/\"default-dockercfg-vnk2p\""
Jul 02 23:51:50.212526 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.212502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"]
Jul 02 23:51:50.301240 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.301201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-sys\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.301240 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.301244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-kube-api-access-79q7w\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.301460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.301323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-lib-modules\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.301460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.301352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-proc\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.301460 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.301400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-podres\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-lib-modules\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402372 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-proc\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-podres\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-sys\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-kube-api-access-79q7w\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402473    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-proc\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-lib-modules\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-sys\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.402812 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.402594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-podres\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.411233 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.411210    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/c1010b34-78a6-4c2a-8169-9dcbbad7cd44-kube-api-access-79q7w\") pod \"perf-node-gather-daemonset-444cs\" (UID: \"c1010b34-78a6-4c2a-8169-9dcbbad7cd44\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.514602 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.514508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:50.650561 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:50.650535    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"]
Jul 02 23:51:50.653309 ip-10-0-141-125 kubenswrapper[2573]: W0702 23:51:50.653277    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc1010b34_78a6_4c2a_8169_9dcbbad7cd44.slice/crio-7db8a2b8b91e391cc3216676a4f96b29c79028e4ec1fd73fff067e15851ef847 WatchSource:0}: Error finding container 7db8a2b8b91e391cc3216676a4f96b29c79028e4ec1fd73fff067e15851ef847: Status 404 returned error can't find the container with id 7db8a2b8b91e391cc3216676a4f96b29c79028e4ec1fd73fff067e15851ef847
Jul 02 23:51:51.401067 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:51.401028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs" event={"ID":"c1010b34-78a6-4c2a-8169-9dcbbad7cd44","Type":"ContainerStarted","Data":"ad59df5d01c31ccf375187ab94e38d5d398d512c18c2853f79484f9b905e28de"}
Jul 02 23:51:51.401387 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:51.401082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs" event={"ID":"c1010b34-78a6-4c2a-8169-9dcbbad7cd44","Type":"ContainerStarted","Data":"7db8a2b8b91e391cc3216676a4f96b29c79028e4ec1fd73fff067e15851ef847"}
Jul 02 23:51:51.401387 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:51.401112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:51.416668 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:51.416610    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs" podStartSLOduration=1.416594513 podStartE2EDuration="1.416594513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:51:51.416212059 +0000 UTC m=+2499.400280431" watchObservedRunningTime="2026-07-02 23:51:51.416594513 +0000 UTC m=+2499.400662872"
Jul 02 23:51:52.087463 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:52.087431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5tkh_dd10af0f-6cf4-4a44-81fd-0663aedfa57a/dns/0.log"
Jul 02 23:51:52.109212 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:52.109187    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5tkh_dd10af0f-6cf4-4a44-81fd-0663aedfa57a/kube-rbac-proxy/0.log"
Jul 02 23:51:52.216553 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:52.216524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9s79s_ba0af08b-e746-4406-b9c7-82d95e148d7f/dns-node-resolver/0.log"
Jul 02 23:51:52.826033 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:52.826003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9k7w2_2c3a5902-591b-46e5-bb6f-4742af23c689/node-ca/0.log"
Jul 02 23:51:53.737902 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:53.737864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4s25m5_d1e43978-edef-4de5-ad82-71c6f59c3e7d/istio-proxy/0.log"
Jul 02 23:51:53.951730 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:53.951703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c4d5658d-8rbjm_6df13bb5-1732-4863-886f-aac4648e6f6f/kube-auth-proxy/0.log"
Jul 02 23:51:54.002131 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:54.002052    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/0.log"
Jul 02 23:51:54.029570 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:54.029541    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/1.log"
Jul 02 23:51:54.058063 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:54.058035    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p2snj_4f3b7264-eaf9-4f4f-96b6-209aafde8c59/payload-pre-processing/0.log"
Jul 02 23:51:54.103609 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:54.103577    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-rpmfr_c7e2ec90-a59b-4d21-99c1-e86a0868b82f/payload-processing/0.log"
Jul 02 23:51:54.766327 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:54.766299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgr7p_62277ec7-af6d-4cc6-bd68-1923a99a3984/serve-healthcheck-canary/0.log"
Jul 02 23:51:55.272371 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:55.272317    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-tb462_94bbf191-9ad4-470e-b37d-ce062fcffbfc/insights-operator/0.log"
Jul 02 23:51:55.272749 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:55.272476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-tb462_94bbf191-9ad4-470e-b37d-ce062fcffbfc/insights-operator/1.log"
Jul 02 23:51:55.415320 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:55.415295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6drk_232b25fb-bcb6-48d4-83dc-504abbd8196e/kube-rbac-proxy/0.log"
Jul 02 23:51:55.437660 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:55.437630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6drk_232b25fb-bcb6-48d4-83dc-504abbd8196e/exporter/0.log"
Jul 02 23:51:55.459980 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:55.459951    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6drk_232b25fb-bcb6-48d4-83dc-504abbd8196e/extractor/0.log"
Jul 02 23:51:57.415824 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.415797    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-444cs"
Jul 02 23:51:57.549938 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.549911    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fjbsr_69583d64-afda-4a7a-845b-07a184acba23/manager/0.log"
Jul 02 23:51:57.677303 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.677218    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gnh58_014a75de-865f-4580-88c4-cbece1fdc654/manager/0.log"
Jul 02 23:51:57.743701 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.743677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-jptnh_a716477d-92e2-4d34-9085-a3a75528fe52/cleanup/0.log"
Jul 02 23:51:57.856121 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.856090    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56dc4c68dc-8h99m_41f777b4-7c89-47ac-86fe-2f824bb6c999/manager/0.log"
Jul 02 23:51:57.944977 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:57.944944    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r6hgs_3f98a7ce-4cb2-418d-a71d-bb5f57b34c39/manager/0.log"
Jul 02 23:51:58.054956 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:58.054919    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-rf6rw_2eb311b8-1629-4877-821a-d975bd40956f/manager/0.log"
Jul 02 23:51:58.070745 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:58.070723    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-rf6rw_2eb311b8-1629-4877-821a-d975bd40956f/copy-manifests/0.log"
Jul 02 23:51:58.142505 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:58.142478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7ccrp_ddc0c614-1680-4d08-ba43-9e737b0a12e4/postgres/0.log"
Jul 02 23:51:59.631727 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:51:59.631696    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9krsq_a78a20c3-ecbd-4f3a-aa9e-b032ee85ecba/openshift-lws-operator/0.log"
Jul 02 23:52:00.671733 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.671653    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4s25m5_d1e43978-edef-4de5-ad82-71c6f59c3e7d/istio-proxy/0.log"
Jul 02 23:52:00.867532 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.867499    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c4d5658d-8rbjm_6df13bb5-1732-4863-886f-aac4648e6f6f/kube-auth-proxy/0.log"
Jul 02 23:52:00.899176 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.899147    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/0.log"
Jul 02 23:52:00.927648 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.927559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/1.log"
Jul 02 23:52:00.946442 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.946412    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p2snj_4f3b7264-eaf9-4f4f-96b6-209aafde8c59/payload-pre-processing/0.log"
Jul 02 23:52:00.982962 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:00.982929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-rpmfr_c7e2ec90-a59b-4d21-99c1-e86a0868b82f/payload-processing/0.log"
Jul 02 23:52:02.288296 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.288270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4s25m5_d1e43978-edef-4de5-ad82-71c6f59c3e7d/istio-proxy/0.log"
Jul 02 23:52:02.488605 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.488575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c4d5658d-8rbjm_6df13bb5-1732-4863-886f-aac4648e6f6f/kube-auth-proxy/0.log"
Jul 02 23:52:02.523794 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.523760    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/0.log"
Jul 02 23:52:02.562412 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.562323    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xts26_3cfd6a21-d50c-44c9-8887-1a4784a58d7c/istio-proxy/1.log"
Jul 02 23:52:02.582251 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.582220    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p2snj_4f3b7264-eaf9-4f4f-96b6-209aafde8c59/payload-pre-processing/0.log"
Jul 02 23:52:02.619858 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:02.619827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-rpmfr_c7e2ec90-a59b-4d21-99c1-e86a0868b82f/payload-processing/0.log"
Jul 02 23:52:06.233259 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.233180    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:52:06.255523 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.255496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/egress-router-binary-copy/0.log"
Jul 02 23:52:06.286534 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.286504    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/cni-plugins/0.log"
Jul 02 23:52:06.306848 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.306821    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/bond-cni-plugin/0.log"
Jul 02 23:52:06.326785 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.326751    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/routeoverride-cni/0.log"
Jul 02 23:52:06.346237 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.346210    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/whereabouts-cni-bincopy/0.log"
Jul 02 23:52:06.365297 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.365261    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lg4ts_656ca62d-f422-4a93-a688-16fc089444ee/whereabouts-cni/0.log"
Jul 02 23:52:06.543033 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.542959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ppgdb_f85d1666-c93b-46a8-9b99-2a3e70af502d/kube-multus/0.log"
Jul 02 23:52:06.708654 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.708621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zj9d7_2ef9dea4-06a4-4fd9-9321-ba5296b61b59/network-metrics-daemon/0.log"
Jul 02 23:52:06.727106 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:06.727075    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zj9d7_2ef9dea4-06a4-4fd9-9321-ba5296b61b59/kube-rbac-proxy/0.log"
Jul 02 23:52:07.712493 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.712465    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/ovn-controller/0.log"
Jul 02 23:52:07.727481 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.727437    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/ovn-acl-logging/0.log"
Jul 02 23:52:07.748845 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.748816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/kube-rbac-proxy-node/0.log"
Jul 02 23:52:07.772538 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.772506    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 23:52:07.791844 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.791819    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/northd/0.log"
Jul 02 23:52:07.813332 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.813295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/nbdb/0.log"
Jul 02 23:52:07.833866 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.833844    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/sbdb/0.log"
Jul 02 23:52:07.884319 ip-10-0-141-125 kubenswrapper[2573]: I0702 23:52:07.884286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vh4wr_cc28d19b-dfb8-4909-af3e-988562654b9f/ovnkube-controller/0.log"