Jul 02 18:59:27.852909 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 18:59:27.852921 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 18:59:27.852930 ip-10-0-134-80 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 18:59:27.853207 ip-10-0-134-80 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 18:59:38.102243 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 18:59:38.102260 ip-10-0-134-80 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d8834b3bca9941b680a723643c6c64c5 --
Jul 02 19:01:35.259270 ip-10-0-134-80 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.345412    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350114    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350127    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350130    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350133    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350136    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350139    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350142    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.366766 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350145    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350147    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350157    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350160    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350162    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350165    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350168    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350170    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350173    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350176    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350179    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350182    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350185    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350187    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350190    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350193    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350196    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350198    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350201    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350203    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.368106 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350206    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350208    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350211    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350214    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350216    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350218    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350222    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350224    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350227    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350229    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350232    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350234    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350238    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350242    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350245    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350248    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350251    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350254    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350256    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.369008 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350259    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350261    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350264    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350267    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350271    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350275    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350278    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350281    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350284    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350287    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350290    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350293    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350295    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350298    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350300    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350304    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350307    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350310    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350313    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.370102 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350316    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350319    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350322    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350325    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350328    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350331    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350334    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350337    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350342    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350344    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350347    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350349    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350352    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350354    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350357    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350360    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350362    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350365    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350367    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350370    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.371018 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350373    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350376    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350378    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350381    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350383    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350386    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350388    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350391    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350394    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350396    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350399    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350401    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350403    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.350406    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351102    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351108    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351111    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351114    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351117    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351120    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.372105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351123    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351125    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351128    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351131    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351134    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351137    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351140    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351142    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351145    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351148    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351152    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351156    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351159    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351162    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351165    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351168    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351171    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351174    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351177    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351179    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.373012 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351182    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351185    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351188    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351190    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351193    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351195    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351198    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351201    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351204    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351206    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351209    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351212    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351218    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351220    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351223    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351225    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351228    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351231    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351239    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351241    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.374110 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351244    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351247    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351250    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351253    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351256    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351258    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351261    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351263    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351266    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351269    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351271    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351276    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351279    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351283    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351286    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351288    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351291    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351293    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351296    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351300    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.375019 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351302    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351305    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351308    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351310    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351312    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351318    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351321    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351323    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351326    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351328    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351330    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351333    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351335    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351338    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351340    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351343    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351345    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351348    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351351    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351353    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.376117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351356    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351359    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351361    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351364    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351367    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351369    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351373    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351377    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351379    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351382    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351385    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351389    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351392    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351804    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351810    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351813    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351816    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351819    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351823    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.377024 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351825    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351828    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351831    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351833    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351836    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351838    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351855    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351858    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351861    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351864    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351866    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351869    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351873    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351877    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351880    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351883    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351886    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351889    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351892    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351895    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.378101 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351898    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351900    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351903    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351905    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351910    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351913    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351916    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351919    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351922    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351924    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351927    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351930    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351933    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351935    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351938    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351940    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351943    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351945    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351948    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351950    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351953    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.379002 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351955    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351958    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351960    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351962    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351965    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351967    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351970    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351972    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351975    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351977    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351980    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351982    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351985    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351987    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351990    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351997    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.351999    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352002    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352004    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.382469 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352007    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352009    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352012    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352015    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352018    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352021    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352023    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352026    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352030    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352033    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352035    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352038    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352041    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352044    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352047    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352050    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352052    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352055    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352058    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352060    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.383362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352063    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352068    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352072    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352074    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352077    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352079    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352082    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352084    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352090    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352092    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352095    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352097    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352100    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352159    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352166    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352172    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352176    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352181    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352184    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352188    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352193    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:01:37.390662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352196    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352200    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352203    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352206    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352209    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352212    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352215    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352218    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352220    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352223    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352227    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352230    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352233    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352236    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352239    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352243    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352245    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352248    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352256    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352261    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352264    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352267    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352270    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352273    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:01:37.391553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352282    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352285    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352288    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352291    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352294    2569 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352298    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352302    2569 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352305    2569 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352308    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352311    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352314    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352317    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352320    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352323    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352326    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352329    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352332    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352334    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352337    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352340    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352343    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352345    2569 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352349    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352352    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352355    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:01:37.392458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352358    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352360    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352367    2569 flags.go:64] FLAG: --help="false"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352370    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352373    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352376    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352378    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352381    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352385    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352387    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352390    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352393    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352396    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352399    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352402    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352405    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352408    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352411    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352414    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352416    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352419    2569 flags.go:64] FLAG: --lock-file=""
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352422    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352424    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352427    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:01:37.393574 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352432    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352435    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352437    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352440    2569 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352443    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352446    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352449    2569 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352451    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352455    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352458    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352465    2569 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352467    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352470    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352473    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352476    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352479    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352482    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352485    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352491    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352494    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352498    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352501    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352504    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:01:37.394675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352510    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352513    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352516    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352526    2569 flags.go:64] FLAG: --port="10250"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352531    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352534    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cd9463dfdb03b70"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352537    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352540    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352543    2569 flags.go:64] FLAG: --register-node="true"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352546    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352554    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352557    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352560    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352562    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352568    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352571    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352574    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352576    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352579    2569 flags.go:64] FLAG: --runonce="false"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352583    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352588    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352591    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352593    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352596    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352599    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352602    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:01:37.395763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352605    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352607    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352610    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352613    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352616    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352619    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352622    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352625    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352630    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352633    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352636    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352640    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352643    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352646    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352648    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352651    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352654    2569 flags.go:64] FLAG: --v="2"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352658    2569 flags.go:64] FLAG: --version="false"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352661    2569 flags.go:64] FLAG: --vmodule=""
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352664    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.352668    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352775    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352778    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352781    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.397105 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352784    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352788    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352792    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352794    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352797    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352799    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352802    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352806    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352810    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352813    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352816    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352819    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352822    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352825    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352828    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352834    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352837    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352853    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352856    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.398223 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352859    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352862    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352864    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352867    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352870    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352873    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352875    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352877    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352880    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352882    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352885    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352888    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352891    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352893    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352897    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352901    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352904    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352907    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352909    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352912    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.399108 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352914    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352917    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352920    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352923    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352925    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352928    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352930    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352933    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352935    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352938    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352941    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352943    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352946    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352948    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352951    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352953    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352956    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352958    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352961    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352963    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.399982 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352966    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352968    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352971    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352973    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352976    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352978    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352984    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352989    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352992    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352995    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.352998    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353000    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353003    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353006    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353008    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353011    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353014    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353016    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353018    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353021    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.400881 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353024    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353027    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353030    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353032    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353035    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353038    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353040    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353043    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353045    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353047    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353050    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353052    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353055    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353057    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353060    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353063    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.401739 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.353065    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.353070    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.359631    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.359645    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.360646    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.360658    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360715    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360721    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360724    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360727    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360730    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360733    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360736    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360738    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.518112 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360742    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.459523 ip-10-0-134-80 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360745    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360747    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360750    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360753    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360755    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360758    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360761    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360765    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360768    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360772    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360774    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360777    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360779    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360782    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360784    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360787    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360789    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360795    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360798    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.519178 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360801    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360804    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360807    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360809    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360813    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360817    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360820    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360824    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360828    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360831    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360834    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360836    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360856    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360860    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360862    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360865    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360867    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360870    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360873    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.520268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360875    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360878    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360880    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360883    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360885    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360888    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360891    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360894    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360896    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360899    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360902    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360906    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360909    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360912    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360914    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360918    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360921    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360924    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360926    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360929    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.521357 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360931    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360934    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360936    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360939    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360941    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360943    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360946    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360949    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360952    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360954    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360957    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360959    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360962    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360965    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360967    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360970    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360972    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360975    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360977    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360980    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.522266 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360982    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360984    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360987    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360991    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360994    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360996    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.360999    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361001    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361005    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361007    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361010    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361013    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.361017    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361129    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361134    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:37.523353 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361137    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361141    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361144    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361147    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361150    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361153    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361156    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361158    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361161    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361163    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361166    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361169    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361171    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361174    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361176    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361178    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361181    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361183    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361186    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361188    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:37.524027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361191    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361194    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361197    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361199    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361202    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361205    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361208    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361210    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361213    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361215    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361218    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361220    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361223    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361226    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361229    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361231    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361234    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361236    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361239    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361241    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:37.524930 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361244    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361246    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361249    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361252    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361255    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361257    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361259    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361262    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361264    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361267    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361269    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361272    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361274    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361278    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361281    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361284    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361286    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361289    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361291    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361294    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:37.528388 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361297    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361299    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361302    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361304    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361307    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361311    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361314    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361316    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361319    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361321    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361325    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361329    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361333    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361335    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361338    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361341    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361344    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361346    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361349    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:37.529512 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361351    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361354    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361356    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361359    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361361    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361365    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361370    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361372    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361375    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361378    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361380    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361383    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361386    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361389    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361392    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361394    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361397    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:37.536599 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:37.361399    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.361405    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.361512    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.363584    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.365487    2569 server.go:1019] "Starting client certificate rotation"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.365581    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.365615    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.368065    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.407388    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.418083    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.420109    2569 log.go:25] "Validated CRI v1 image API"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.423869    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:01:37.537406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.426689    2569 fs.go:135] Filesystem UUIDs: map[24634300-119d-4926-8353-eb2aa1b96cfb:/dev/nvme0n1p3 4d147d44-6525-4c80-ae4a-1fd6b71205f6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 02 19:01:37.538064 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.426708    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.432344    2569 manager.go:216] Machine: {Timestamp:2026-07-02 19:01:37.430980869 +0000 UTC m=+0.403642014 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105561 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fec6743560fcdd0f59342ac3e7c3e SystemUUID:ec2fec67-4356-0fcd-d0f5-9342ac3e7c3e BootID:d8834b3b-ca99-41b6-80a7-23643c6c64c5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:6c:18:43:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:6c:18:43:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:d4:34:d4:85:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.432443    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.432549    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.434752    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.436385    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.436406    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:01:37.538277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.437705    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.437716    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.437724    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.438282    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.439683    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442626    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442732    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442758    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442773    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442791    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442803    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.442815    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.443143    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.443159    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.450633    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.453103    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.453134    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454719    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454732    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454740    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454749    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454761    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454767    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454774    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454780    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454786    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454792    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454801    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.454806    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.455692    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.455700    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.455996    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.455992    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.458705    2569 server.go:1268] "Started kubelet"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.458775    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.458780    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.458853    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.460563    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.460712    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2jcz"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.463484    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:01:37.538721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.466817    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467017    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.467017    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467029    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.467218    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467627    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467709    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467742    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467762    2569 factory.go:55] Registering systemd factory
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467776    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467865    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.467876    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.466892    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-80.ec2.internal.18be8e3d8ad54c21  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-80.ec2.internal,UID:ip-10-0-134-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-80.ec2.internal,},FirstTimestamp:2026-07-02 19:01:37.458678817 +0000 UTC m=+0.431339962,LastTimestamp:2026-07-02 19:01:37.458678817 +0000 UTC m=+0.431339962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-80.ec2.internal,}"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468024    2569 factory.go:153] Registering CRI-O factory
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468037    2569 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468099    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468124    2569 factory.go:103] Registering Raw factory
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468148    2569 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468471    2569 manager.go:349] Starting recovery of all containers
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.468932    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2jcz"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.477004    2569 manager.go:354] Recovery completed
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.484375    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.484760    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.486946    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.488353    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491086    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491110    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491119    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491556    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491562    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491567    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.491586    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.492831    2569 policy_none.go:49] "None policy: Start"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.492873    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.492888    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:01:37.540321 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.493036    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.541863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.493064    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.541863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.493074    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.541863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.494049    2569 policy_none.go:47] "Start"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.568248    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580350    2569 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.580375    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580383    2569 server.go:87] "Starting device plugin registration server"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580577    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580586    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580740    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580809    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.580818    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.581286    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.581416    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.681328    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.683079    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.683106    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.683118    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.683146    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.694194    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.713363 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.694212    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-80.ec2.internal\": node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.716482    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.721045    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.722230    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.722265    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.722290    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.722325    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.724455    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.816936    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.823079    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"]
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.823144    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.824740    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.824773    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.824787    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.826236    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.826364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.826410    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827004    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827005    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827029    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827043    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827044    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.827060    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.828531    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.828554    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.832650    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.832679    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.832690    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.854374    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.862535 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.855470    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.870543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.870013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.870543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.870039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:37.870543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.870055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5749cf2dfac2578b4bca0b2a2d6d9f8a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"5749cf2dfac2578b4bca0b2a2d6d9f8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:37.917698    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971099    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5749cf2dfac2578b4bca0b2a2d6d9f8a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"5749cf2dfac2578b4bca0b2a2d6d9f8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5749cf2dfac2578b4bca0b2a2d6d9f8a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"5749cf2dfac2578b4bca0b2a2d6d9f8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:37.971203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb779a7c33815725fa9939f6626b8942-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"eb779a7c33815725fa9939f6626b8942\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.066280 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.018706    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.259146 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.119153    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.259146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.158262    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.259146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.158665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.259146 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.219766    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.460813 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.320183    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.460813 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.364351    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:01:38.460813 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.364494    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:01:38.460813 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.364533    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:01:38.460813 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.420891    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.472473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.471619    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:56:37 +0000 UTC" deadline="2028-02-05 05:41:59.48285387 +0000 UTC"
Jul 02 19:01:38.472473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.471652    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13978h40m21.011205491s"
Jul 02 19:01:38.680836 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.521792    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.680836 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:38.622320    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.687011    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.768211    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.778820    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.780802    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.786602    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:01:38.904927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:38.854012    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.443520    2569 apiserver.go:52] "Watching apiserver"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.450676    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.453022    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","openshift-multus/multus-66s5c","openshift-multus/multus-additional-cni-plugins-5gjlt","kube-system/global-pull-secret-syncer-zsqcz","openshift-image-registry/node-ca-tcmtj","openshift-multus/network-metrics-daemon-n57s7","openshift-network-diagnostics/network-check-target-gllnw","openshift-network-operator/iptables-alerter-jlrsj","openshift-ovn-kubernetes/ovnkube-node-r5pzm","kube-system/konnectivity-agent-zhbg2","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt","openshift-cluster-node-tuning-operator/tuned-ng8dx","openshift-dns/node-resolver-m2dmw"]
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.454513    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.454571    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.455602    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.457611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.458708    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-747lx\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.459059    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.459161    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.459377    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.459867    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.459971    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.460435    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.460537    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.461121    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.461427    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.466335    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.466447    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gh8j\""
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.467129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.467173    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.467264    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.468274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.521451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.469459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.470613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.471797    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.471854    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.471970    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.472975    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.474149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.475341    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479159    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxdpn\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479314    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479433    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479580    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-26nbb\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479738    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.479939    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.480075    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.480194    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.480493    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.480777    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.480937    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x7hh9\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481043    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zwf76\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481151    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481254    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481501    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481503    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481523    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481531    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481537    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r92vd\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481557    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481572    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9zgnk\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481508    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481672    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:01:39.523355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-kubernetes\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-kubelet-config\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxjj\" (UniqueName: \"kubernetes.io/projected/738ebfaf-caba-4bd6-aa56-80d60490f4b9-kube-api-access-2mxjj\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-lib-modules\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481788    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-host\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cnibin\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-serviceca\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-slash\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-tmp\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.481983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-host\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-var-lib-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-bin\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-netd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482075    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-env-overrides\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovn-node-metrics-cert\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482116    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-script-lib\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysconfig\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-systemd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-conf\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482266    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-systemd\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482279    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-var-lib-kubelet\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-tuned\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq57v\" (UniqueName: \"kubernetes.io/projected/f7f5e59d-f851-4be3-8673-57c39de70955-kube-api-access-xq57v\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.529592 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-systemd-units\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-netns\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-log-socket\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-run\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-sys\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-os-release\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482466    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-etc-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-ovn\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9pct\" (UniqueName: \"kubernetes.io/projected/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-kube-api-access-n9pct\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqxt\" (UniqueName: \"kubernetes.io/projected/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-kube-api-access-5dqxt\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-kubelet\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-node-log\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrbv\" (UniqueName: \"kubernetes.io/projected/c6bac7b2-d55b-46f7-aff8-5359876e73a6-kube-api-access-vvrbv\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-system-cni-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-dbus\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-config\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.482745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-modprobe-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.486091    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmwd9\""
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.489209    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.513440    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wz792"
Jul 02 19:01:39.530611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.521275    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wz792"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.568658    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.582958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-var-lib-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.582987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-netd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovn-node-metrics-cert\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583060    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-netd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583061    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-var-lib-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-script-lib\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583102    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysconfig\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqxt\" (UniqueName: \"kubernetes.io/projected/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-kube-api-access-5dqxt\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583149    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-os-release\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583190    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysconfig\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583185    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-systemd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.686749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-systemd\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-conf\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583352    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-netns\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583367    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583408    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqs5\" (UniqueName: \"kubernetes.io/projected/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-kube-api-access-nvqs5\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583464    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583506    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-sysctl-conf\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq57v\" (UniqueName: \"kubernetes.io/projected/f7f5e59d-f851-4be3-8673-57c39de70955-kube-api-access-xq57v\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-netns\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-log-socket\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-run\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.687514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583611    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-netns\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-sys\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-os-release\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583668    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-sys\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-log-socket\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9pct\" (UniqueName: \"kubernetes.io/projected/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-kube-api-access-n9pct\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583725    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-script-lib\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583725    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-run\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c915941-fd74-4541-91c4-7bd76399139d-tmp-dir\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-os-release\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583763    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-agent-certs\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-kubelet\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-node-log\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583836    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-system-cni-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583902    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583911    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-system-cni-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-node-log\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-multus\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583918    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-kubelet\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-etc-kubernetes\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngth\" (UniqueName: \"kubernetes.io/projected/a20f578c-b153-4196-861e-a8f77dbf05b7-kube-api-access-9ngth\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.583992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-host-slash\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-dbus\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-config\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584047    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-cni-binary-copy\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.688891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-lib-modules\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584116    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-dbus\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-host\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cnibin\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-lib-modules\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584191    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-host\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-socket-dir-parent\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-hostroot\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cnibin\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-tmp\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-host\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-bin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-host\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584352    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-conf-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.689561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c915941-fd74-4541-91c4-7bd76399139d-hosts-file\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-bin\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-env-overrides\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-systemd\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584450    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovnkube-config\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584469    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-tuned\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584523    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-systemd\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-system-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584469    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-cni-bin\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-cnibin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-var-lib-kubelet\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-k8s-cni-cncf-io\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.690231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-kubelet\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-daemon-config\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584745    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-var-lib-kubelet\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-systemd-units\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584798    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-systemd-units\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/738ebfaf-caba-4bd6-aa56-80d60490f4b9-env-overrides\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-konnectivity-ca\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.584997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-etc-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-ovn\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585048    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrbv\" (UniqueName: \"kubernetes.io/projected/c6bac7b2-d55b-46f7-aff8-5359876e73a6-kube-api-access-vvrbv\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.690816 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5x4q\" (UniqueName: \"kubernetes.io/projected/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kube-api-access-n5x4q\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585156    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-run-ovn\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-modprobe-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585398    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-kubernetes\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-kubelet-config\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxjj\" (UniqueName: \"kubernetes.io/projected/738ebfaf-caba-4bd6-aa56-80d60490f4b9-kube-api-access-2mxjj\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-serviceca\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.585284    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-multus-certs\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-iptables-alerter-script\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585479    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-kubernetes\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585363    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-modprobe-d\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.585568    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:40.085531032 +0000 UTC m=+3.058192181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585236    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7762fcf-f3b4-44e9-aec8-465f82fd2411-kubelet-config\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-etc-openvswitch\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-device-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585295    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585871    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-serviceca\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-slash\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585910    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.585913    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738ebfaf-caba-4bd6-aa56-80d60490f4b9-host-slash\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.585973    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:40.085958255 +0000 UTC m=+3.058619402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.585991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc87g\" (UniqueName: \"kubernetes.io/projected/9c915941-fd74-4541-91c4-7bd76399139d-kube-api-access-cc87g\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.691935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.586268    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.586950    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-tmp\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.586997    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bac7b2-d55b-46f7-aff8-5359876e73a6-etc-tuned\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.587017    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/738ebfaf-caba-4bd6-aa56-80d60490f4b9-ovn-node-metrics-cert\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.592866    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqxt\" (UniqueName: \"kubernetes.io/projected/6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d-kube-api-access-5dqxt\") pod \"node-ca-tcmtj\" (UID: \"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d\") " pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.598266    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq57v\" (UniqueName: \"kubernetes.io/projected/f7f5e59d-f851-4be3-8673-57c39de70955-kube-api-access-xq57v\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.600123    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.600140    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.600152    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:39.600219    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:01:40.100198508 +0000 UTC m=+3.072859659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.601794    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxjj\" (UniqueName: \"kubernetes.io/projected/738ebfaf-caba-4bd6-aa56-80d60490f4b9-kube-api-access-2mxjj\") pod \"ovnkube-node-r5pzm\" (UID: \"738ebfaf-caba-4bd6-aa56-80d60490f4b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.602219    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9pct\" (UniqueName: \"kubernetes.io/projected/bbec8ef8-69b6-4b6b-9a0d-88c565f702bb-kube-api-access-n9pct\") pod \"multus-additional-cni-plugins-5gjlt\" (UID: \"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb\") " pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.608486    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrbv\" (UniqueName: \"kubernetes.io/projected/c6bac7b2-d55b-46f7-aff8-5359876e73a6-kube-api-access-vvrbv\") pod \"tuned-ng8dx\" (UID: \"c6bac7b2-d55b-46f7-aff8-5359876e73a6\") " pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-socket-dir-parent\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.692531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-hostroot\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-bin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-conf-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c915941-fd74-4541-91c4-7bd76399139d-hosts-file\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-system-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-hostroot\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687208    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-bin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687230    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-conf-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687246    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c915941-fd74-4541-91c4-7bd76399139d-hosts-file\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687250    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-system-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-cnibin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687278    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-socket-dir-parent\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687326    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-cnibin\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687326    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-k8s-cni-cncf-io\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-k8s-cni-cncf-io\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-kubelet\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687388    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-daemon-config\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687392    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-kubelet\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-konnectivity-ca\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687455    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5x4q\" (UniqueName: \"kubernetes.io/projected/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kube-api-access-n5x4q\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-multus-certs\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-iptables-alerter-script\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-device-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687554    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-multus-certs\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc87g\" (UniqueName: \"kubernetes.io/projected/9c915941-fd74-4541-91c4-7bd76399139d-kube-api-access-cc87g\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687629    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.693675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-os-release\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687672    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-netns\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687694    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-os-release\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqs5\" (UniqueName: \"kubernetes.io/projected/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-kube-api-access-nvqs5\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687736    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-device-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687774    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-run-netns\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687872    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c915941-fd74-4541-91c4-7bd76399139d-tmp-dir\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-daemon-config\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-agent-certs\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687952    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-multus-cni-dir\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687955    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-konnectivity-ca\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.694220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-multus\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.687980    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-etc-kubernetes\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688036    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-etc-kubernetes\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688006    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a20f578c-b153-4196-861e-a8f77dbf05b7-host-var-lib-cni-multus\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngth\" (UniqueName: \"kubernetes.io/projected/a20f578c-b153-4196-861e-a8f77dbf05b7-kube-api-access-9ngth\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688086    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-host-slash\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-cni-binary-copy\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688176    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-host-slash\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688226    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c915941-fd74-4541-91c4-7bd76399139d-tmp-dir\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a20f578c-b153-4196-861e-a8f77dbf05b7-cni-binary-copy\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.688687    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-iptables-alerter-script\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.694802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.689698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8-agent-certs\") pod \"konnectivity-agent-zhbg2\" (UID: \"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8\") " pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.703762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.703737    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc87g\" (UniqueName: \"kubernetes.io/projected/9c915941-fd74-4541-91c4-7bd76399139d-kube-api-access-cc87g\") pod \"node-resolver-m2dmw\" (UID: \"9c915941-fd74-4541-91c4-7bd76399139d\") " pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.704131 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.704112    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqs5\" (UniqueName: \"kubernetes.io/projected/27ab8a1c-5199-4971-b17e-9ecbfdf3452d-kube-api-access-nvqs5\") pod \"iptables-alerter-jlrsj\" (UID: \"27ab8a1c-5199-4971-b17e-9ecbfdf3452d\") " pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.704359 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.704337    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5x4q\" (UniqueName: \"kubernetes.io/projected/cd0a95b0-de71-4478-9d25-7a29a1a08b3d-kube-api-access-n5x4q\") pod \"aws-ebs-csi-driver-node-dc9tt\" (UID: \"cd0a95b0-de71-4478-9d25-7a29a1a08b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.705027 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.705013    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngth\" (UniqueName: \"kubernetes.io/projected/a20f578c-b153-4196-861e-a8f77dbf05b7-kube-api-access-9ngth\") pod \"multus-66s5c\" (UID: \"a20f578c-b153-4196-861e-a8f77dbf05b7\") " pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.785498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.785435    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:39.787466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.787449    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ng8dx"
Jul 02 19:01:39.789804 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.789783    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:39.793751 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.793735    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tcmtj"
Jul 02 19:01:39.817657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.817642    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gjlt"
Jul 02 19:01:39.821182 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.821167    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:01:39.849793 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.849776    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2dmw"
Jul 02 19:01:39.870522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.870504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66s5c"
Jul 02 19:01:39.914722 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.914705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:39.919229 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.919214    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jlrsj"
Jul 02 19:01:39.920344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.920327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt"
Jul 02 19:01:39.932386 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:39.932362    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0a95b0_de71_4478_9d25_7a29a1a08b3d.slice/crio-01f0dd0a7cec69d3d6ad1d4b8e519041ea3929662164c75b36b6fcc3c43b165d WatchSource:0}: Error finding container 01f0dd0a7cec69d3d6ad1d4b8e519041ea3929662164c75b36b6fcc3c43b165d: Status 404 returned error can't find the container with id 01f0dd0a7cec69d3d6ad1d4b8e519041ea3929662164c75b36b6fcc3c43b165d
Jul 02 19:01:39.933804 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:39.933783    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ab8a1c_5199_4971_b17e_9ecbfdf3452d.slice/crio-4adc879ce389763b68ec5508b69cdd4cf47dec97fa13015fc356a14955dd2127 WatchSource:0}: Error finding container 4adc879ce389763b68ec5508b69cdd4cf47dec97fa13015fc356a14955dd2127: Status 404 returned error can't find the container with id 4adc879ce389763b68ec5508b69cdd4cf47dec97fa13015fc356a14955dd2127
Jul 02 19:01:39.934610 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:39.934591    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb779a7c33815725fa9939f6626b8942.slice/crio-04f7f0f4faf0e105596b539117f9130d32ea722909cf9835364d093655405571 WatchSource:0}: Error finding container 04f7f0f4faf0e105596b539117f9130d32ea722909cf9835364d093655405571: Status 404 returned error can't find the container with id 04f7f0f4faf0e105596b539117f9130d32ea722909cf9835364d093655405571
Jul 02 19:01:39.935225 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:39.935206    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24d3a27_2a3b_4e6e_84f2_f092ab0a72c8.slice/crio-e011b351abb89577685e7384408845735b049e9d472872b06651e46bcc3cc52c WatchSource:0}: Error finding container e011b351abb89577685e7384408845735b049e9d472872b06651e46bcc3cc52c: Status 404 returned error can't find the container with id e011b351abb89577685e7384408845735b049e9d472872b06651e46bcc3cc52c
Jul 02 19:01:39.938326 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:39.938193    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:01:40.086277 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:40.086241    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb7daf6_ad09_4dfe_bfd6_36d7bd632d8d.slice/crio-daa9ac222ac4b348bb2b56fedc97f806998ed24cc31293bd4b659364962df03b WatchSource:0}: Error finding container daa9ac222ac4b348bb2b56fedc97f806998ed24cc31293bd4b659364962df03b: Status 404 returned error can't find the container with id daa9ac222ac4b348bb2b56fedc97f806998ed24cc31293bd4b659364962df03b
Jul 02 19:01:40.091594 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.091576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:40.091654 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.091610    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:40.091713 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.091703    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:40.091747 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.091704    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:40.091781 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.091748    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:41.091735511 +0000 UTC m=+4.064396642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:40.091781 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.091761    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:41.091754958 +0000 UTC m=+4.064416090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:40.192953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.192919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:40.193103 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.193084    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:40.193143 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.193108    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:40.193143 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.193119    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:40.193204 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.193173    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:01:41.193155381 +0000 UTC m=+4.165816529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:40.210726 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:40.210697    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20f578c_b153_4196_861e_a8f77dbf05b7.slice/crio-f8169fb87b5e3c78f8db74d5f502f7e5c3d7c80bdedf8b1cfd282c2a745ac95d WatchSource:0}: Error finding container f8169fb87b5e3c78f8db74d5f502f7e5c3d7c80bdedf8b1cfd282c2a745ac95d: Status 404 returned error can't find the container with id f8169fb87b5e3c78f8db74d5f502f7e5c3d7c80bdedf8b1cfd282c2a745ac95d
Jul 02 19:01:40.211427 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:40.211404    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbec8ef8_69b6_4b6b_9a0d_88c565f702bb.slice/crio-930bf49ce94a37a5a5ab6e864d82f974a5d47eca35b6934a770bd81c8f617f1d WatchSource:0}: Error finding container 930bf49ce94a37a5a5ab6e864d82f974a5d47eca35b6934a770bd81c8f617f1d: Status 404 returned error can't find the container with id 930bf49ce94a37a5a5ab6e864d82f974a5d47eca35b6934a770bd81c8f617f1d
Jul 02 19:01:40.280442 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:40.280416    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5749cf2dfac2578b4bca0b2a2d6d9f8a.slice/crio-fd48921b2b7f094536a1fc7f8919657360556b138ed423a05ee8f843353ad11b WatchSource:0}: Error finding container fd48921b2b7f094536a1fc7f8919657360556b138ed423a05ee8f843353ad11b: Status 404 returned error can't find the container with id fd48921b2b7f094536a1fc7f8919657360556b138ed423a05ee8f843353ad11b
Jul 02 19:01:40.523062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.522948    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:39 +0000 UTC" deadline="2028-02-23 04:48:52.811914348 +0000 UTC"
Jul 02 19:01:40.523062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.523008    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14409h47m12.288910856s"
Jul 02 19:01:40.723305 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.722881    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:40.723305 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:40.723019    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:40.728075 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.727995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tcmtj" event={"ID":"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d","Type":"ContainerStarted","Data":"daa9ac222ac4b348bb2b56fedc97f806998ed24cc31293bd4b659364962df03b"}
Jul 02 19:01:40.729766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.729706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt" event={"ID":"cd0a95b0-de71-4478-9d25-7a29a1a08b3d","Type":"ContainerStarted","Data":"01f0dd0a7cec69d3d6ad1d4b8e519041ea3929662164c75b36b6fcc3c43b165d"}
Jul 02 19:01:40.731314 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.731249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jlrsj" event={"ID":"27ab8a1c-5199-4971-b17e-9ecbfdf3452d","Type":"ContainerStarted","Data":"4adc879ce389763b68ec5508b69cdd4cf47dec97fa13015fc356a14955dd2127"}
Jul 02 19:01:40.733274 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.733222    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zhbg2" event={"ID":"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8","Type":"ContainerStarted","Data":"e011b351abb89577685e7384408845735b049e9d472872b06651e46bcc3cc52c"}
Jul 02 19:01:40.735421 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.735363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"eb779a7c33815725fa9939f6626b8942","Type":"ContainerStarted","Data":"04f7f0f4faf0e105596b539117f9130d32ea722909cf9835364d093655405571"}
Jul 02 19:01:40.737947 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.737922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"5749cf2dfac2578b4bca0b2a2d6d9f8a","Type":"ContainerStarted","Data":"fd48921b2b7f094536a1fc7f8919657360556b138ed423a05ee8f843353ad11b"}
Jul 02 19:01:40.739534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.739481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerStarted","Data":"930bf49ce94a37a5a5ab6e864d82f974a5d47eca35b6934a770bd81c8f617f1d"}
Jul 02 19:01:40.742233 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:40.742204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66s5c" event={"ID":"a20f578c-b153-4196-861e-a8f77dbf05b7","Type":"ContainerStarted","Data":"f8169fb87b5e3c78f8db74d5f502f7e5c3d7c80bdedf8b1cfd282c2a745ac95d"}
Jul 02 19:01:41.100674 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.100641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:41.100879 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.100696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:41.100952 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.100878    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:41.100952 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.100936    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:43.100918147 +0000 UTC m=+6.073579298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:41.101328 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.101311    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:41.101395 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.101365    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:43.101349705 +0000 UTC m=+6.074010842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:41.201265 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.201144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:41.201479 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.201349    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:41.201479 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.201370    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:41.201479 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.201381    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:41.201479 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.201433    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:01:43.201415769 +0000 UTC m=+6.174076916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:41.274438 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:41.273606    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bac7b2_d55b_46f7_aff8_5359876e73a6.slice/crio-e0b956f41cbd48027a4772e78ea6e47861e1f4a29f3959077c1869061696ab86 WatchSource:0}: Error finding container e0b956f41cbd48027a4772e78ea6e47861e1f4a29f3959077c1869061696ab86: Status 404 returned error can't find the container with id e0b956f41cbd48027a4772e78ea6e47861e1f4a29f3959077c1869061696ab86
Jul 02 19:01:41.376009 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:41.375980    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c915941_fd74_4541_91c4_7bd76399139d.slice/crio-ebdf4bbc57ef897a62f404aa32e3dde2be2bbeb21b85ad2508e019961f6895f4 WatchSource:0}: Error finding container ebdf4bbc57ef897a62f404aa32e3dde2be2bbeb21b85ad2508e019961f6895f4: Status 404 returned error can't find the container with id ebdf4bbc57ef897a62f404aa32e3dde2be2bbeb21b85ad2508e019961f6895f4
Jul 02 19:01:41.523871 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.523804    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:39 +0000 UTC" deadline="2028-03-19 13:11:05.794813556 +0000 UTC"
Jul 02 19:01:41.523871 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.523839    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15018h9m24.270980141s"
Jul 02 19:01:41.725464 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.725072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:41.725464 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.725183    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:41.725464 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.725201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:41.725464 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:41.725320    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:41.745943 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.745913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2dmw" event={"ID":"9c915941-fd74-4541-91c4-7bd76399139d","Type":"ContainerStarted","Data":"ebdf4bbc57ef897a62f404aa32e3dde2be2bbeb21b85ad2508e019961f6895f4"}
Jul 02 19:01:41.747560 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:41.747537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ng8dx" event={"ID":"c6bac7b2-d55b-46f7-aff8-5359876e73a6","Type":"ContainerStarted","Data":"e0b956f41cbd48027a4772e78ea6e47861e1f4a29f3959077c1869061696ab86"}
Jul 02 19:01:42.723471 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:42.723014    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:42.723471 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:42.723135    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:43.115449 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:43.115364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:43.115449 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:43.115419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:43.115662 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.115556    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:43.115662 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.115565    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:43.115662 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.115623    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.115602924 +0000 UTC m=+10.088264059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:43.115662 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.115643    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.115632676 +0000 UTC m=+10.088293813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:43.216861 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:43.216735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:43.217035 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.216942    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:43.217035 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.216964    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:43.217035 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.216976    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:43.217035 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.217031    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.217013865 +0000 UTC m=+10.189675000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:43.722602 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:43.722569    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:43.722780 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.722696    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:43.723150 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:43.723129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:43.723279 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:43.723257    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:44.723275 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:44.723241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:44.723701 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:44.723379    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:45.723096 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:45.723062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:45.723282 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:45.723205    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:45.723510 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:45.723486    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:45.723878 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:45.723598    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:46.723386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:46.723360    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:46.723539 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:46.723472    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:47.145648 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:47.145399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:47.145648 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:47.145460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:47.145648 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.145560    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:47.145648 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.145619    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.145600874 +0000 UTC m=+18.118262012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:47.145648 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.145560    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:47.146062 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.145724    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.145701158 +0000 UTC m=+18.118362305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:47.246141 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:47.246055    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:47.246291 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.246195    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:47.246291 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.246213    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:47.246291 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.246225    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:47.246291 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.246275    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.246258888 +0000 UTC m=+18.218920023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:47.724566 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:47.724056    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:47.724566 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.724154    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:47.724566 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:47.724468    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:47.725120 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:47.724581    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:48.723544 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:48.723503    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:48.723717 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:48.723639    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:49.009651 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:01:49.009626    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738ebfaf_caba_4bd6_aa56_80d60490f4b9.slice/crio-65a974f4de8f2389a25bddb729e9f8744c3ea19a405f56f15a5c6ad6dfa59d60 WatchSource:0}: Error finding container 65a974f4de8f2389a25bddb729e9f8744c3ea19a405f56f15a5c6ad6dfa59d60: Status 404 returned error can't find the container with id 65a974f4de8f2389a25bddb729e9f8744c3ea19a405f56f15a5c6ad6dfa59d60
Jul 02 19:01:49.723239 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.722724    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:49.723239 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:49.723094    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:49.723440 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.722760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:49.723509 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:49.723493    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:49.765069 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.765037    2569 generic.go:356] "Generic (PLEG): container finished" podID="eb779a7c33815725fa9939f6626b8942" containerID="efe963943a3c397b230c08c00e7885a24827f89f3e6573bae2911ff7999ecdc2" exitCode=0
Jul 02 19:01:49.765178 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.765123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"eb779a7c33815725fa9939f6626b8942","Type":"ContainerDied","Data":"efe963943a3c397b230c08c00e7885a24827f89f3e6573bae2911ff7999ecdc2"}
Jul 02 19:01:49.766709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.766686    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2dmw" event={"ID":"9c915941-fd74-4541-91c4-7bd76399139d","Type":"ContainerStarted","Data":"121cdbdeca947f56599f01995970661c6d281fa14b367f79e55ba6811a728499"}
Jul 02 19:01:49.768261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.768235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tcmtj" event={"ID":"6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d","Type":"ContainerStarted","Data":"08c2087bb84973822b1fa647b0ffb74ea8ef5a21984fee8e56c7c031e1577857"}
Jul 02 19:01:49.769902 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.769876    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt" event={"ID":"cd0a95b0-de71-4478-9d25-7a29a1a08b3d","Type":"ContainerStarted","Data":"5f13381399c658a87242639e1f514116197a331bc6cfe2645f8cb1a425a5a332"}
Jul 02 19:01:49.771432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.771411    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zhbg2" event={"ID":"e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8","Type":"ContainerStarted","Data":"be2acc172238696ba05b7f748f21b2d3139693249264badb091f634ff58bb168"}
Jul 02 19:01:49.772893 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.772871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ng8dx" event={"ID":"c6bac7b2-d55b-46f7-aff8-5359876e73a6","Type":"ContainerStarted","Data":"af47242325219a2b22a2ed00f7991378c907c6c37a5ccde46134ab49668a0162"}
Jul 02 19:01:49.774047 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.774013    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"65a974f4de8f2389a25bddb729e9f8744c3ea19a405f56f15a5c6ad6dfa59d60"}
Jul 02 19:01:49.776640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.776358    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"5749cf2dfac2578b4bca0b2a2d6d9f8a","Type":"ContainerStarted","Data":"cfa14caa32d36fddc0ff9a7fb5aa8094deecd8d9936f53db5ad82faa25dec60a"}
Jul 02 19:01:49.778928 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.778905    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="9f890edc6a73e91ea308c419c68514c9fd7ee43835d1a48f3b82e96f58751929" exitCode=0
Jul 02 19:01:49.779021 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.778940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"9f890edc6a73e91ea308c419c68514c9fd7ee43835d1a48f3b82e96f58751929"}
Jul 02 19:01:49.806132 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.806086    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tcmtj" podStartSLOduration=3.893682265 podStartE2EDuration="12.80607028s" totalImagesPullingTime="8.912388015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:49.79238481 +0000 UTC m=+12.765045965" watchObservedRunningTime="2026-07-02 19:01:49.80607028 +0000 UTC m=+12.778731434"
Jul 02 19:01:49.821074 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.821033    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zhbg2" podStartSLOduration=3.795348869 podStartE2EDuration="12.8210165s" totalImagesPullingTime="9.025667631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:49.8060338 +0000 UTC m=+12.778694957" watchObservedRunningTime="2026-07-02 19:01:49.8210165 +0000 UTC m=+12.793677654"
Jul 02 19:01:49.842314 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.842275    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" podStartSLOduration=11.842259063 podStartE2EDuration="11.842259063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:49.821411214 +0000 UTC m=+12.794072369" watchObservedRunningTime="2026-07-02 19:01:49.842259063 +0000 UTC m=+12.814920219"
Jul 02 19:01:49.863246 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:49.863212    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ng8dx" podStartSLOduration=5.118012441 podStartE2EDuration="12.863201071s" totalImagesPullingTime="7.74518863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:49.841752694 +0000 UTC m=+12.814413848" watchObservedRunningTime="2026-07-02 19:01:49.863201071 +0000 UTC m=+12.835862224"
Jul 02 19:01:50.310659 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.310593    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:50.311146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.311126    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:50.326239 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.326198    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m2dmw" podStartSLOduration=5.7016042890000005 podStartE2EDuration="13.326184311s" totalImagesPullingTime="7.624580022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:49.87828261 +0000 UTC m=+12.850943764" watchObservedRunningTime="2026-07-02 19:01:50.326184311 +0000 UTC m=+13.298845468"
Jul 02 19:01:50.723513 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.723015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:50.723513 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:50.723152    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:50.783796 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.783762    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jlrsj" event={"ID":"27ab8a1c-5199-4971-b17e-9ecbfdf3452d","Type":"ContainerStarted","Data":"2c62768f7c6228e448d2f585a441332629cc7746714cc7c0682eb394029b7edd"}
Jul 02 19:01:50.787989 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.787627    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"eb779a7c33815725fa9939f6626b8942","Type":"ContainerStarted","Data":"4285027887d6aa9c4fa8b5d45346ad36665c136cdba9ced26836f9e5d14cfee1"}
Jul 02 19:01:50.788332 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.788311    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:50.789386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.789359    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zhbg2"
Jul 02 19:01:50.813425 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.813377    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jlrsj" podStartSLOduration=4.751042842 podStartE2EDuration="13.813360286s" totalImagesPullingTime="9.062317444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:50.798095062 +0000 UTC m=+13.770756216" watchObservedRunningTime="2026-07-02 19:01:50.813360286 +0000 UTC m=+13.786021441"
Jul 02 19:01:50.825854 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:50.825795    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" podStartSLOduration=12.825784793 podStartE2EDuration="12.825784793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:50.81302513 +0000 UTC m=+13.785686285" watchObservedRunningTime="2026-07-02 19:01:50.825784793 +0000 UTC m=+13.798445948"
Jul 02 19:01:51.723295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:51.723256    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:51.723295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:51.723290    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:51.723823 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:51.723394    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:51.723823 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:51.723510    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:52.723163 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:52.722975    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:52.723346 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:52.723245    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:53.723460 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:53.723416    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:53.723963 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:53.723429    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:53.723963 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:53.723552    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:53.723963 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:53.723635    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:54.722489 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:54.722455    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:54.722654 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:54.722582    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:55.210070 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:55.209984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:55.210605 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:55.210091    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:55.210605 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.210136    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:55.210605 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.210196    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:55.210605 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.210220    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:11.21019963 +0000 UTC m=+34.182860775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:55.210605 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.210244    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:11.210232595 +0000 UTC m=+34.182893728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:55.310687 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:55.310659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:55.310887 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.310789    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:55.310887 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.310807    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:55.310887 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.310819    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:55.310887 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.310889    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:02:11.3108727 +0000 UTC m=+34.283533835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:55.723131 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:55.723101    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:55.723318 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.723231    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:55.723318 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:55.723286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:55.723437 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:55.723402    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:56.723030 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:56.722998    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:56.723681 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:56.723099    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:57.724043 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:57.724008    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:57.724415 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:57.724135    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:57.724415 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:57.724183    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:57.724415 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:57.724271    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:57.850106 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:57.849692    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:01:58.593874 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.593749    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:01:57.849865812Z","UUID":"2afc691e-de41-4370-a8e2-f76cc914033a","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:01:58.595283 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.595252    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:01:58.595438 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.595291    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:01:58.723375 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.723286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:01:58.723518 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:58.723403    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:01:58.806276 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.806239    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="1e4afee085d3d351b7d729ed928887e273de460084b4885f60ee950a25bccdf9" exitCode=0
Jul 02 19:01:58.806828 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.806326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"1e4afee085d3d351b7d729ed928887e273de460084b4885f60ee950a25bccdf9"}
Jul 02 19:01:58.807926 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.807897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66s5c" event={"ID":"a20f578c-b153-4196-861e-a8f77dbf05b7","Type":"ContainerStarted","Data":"26e798567bcac41b5bb0ba9171445cad84e048ca1fb3237d4d94f76073c07b65"}
Jul 02 19:01:58.810010 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.809986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt" event={"ID":"cd0a95b0-de71-4478-9d25-7a29a1a08b3d","Type":"ContainerStarted","Data":"bf919e8e9df3a67996eee4e191947641b1d984bccf705fcef216a6ffef3936f5"}
Jul 02 19:01:58.848290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:58.848212    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-66s5c" podStartSLOduration=4.296333782 podStartE2EDuration="21.848192941s" totalImagesPullingTime="17.551859159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:58.847556296 +0000 UTC m=+21.820217452" watchObservedRunningTime="2026-07-02 19:01:58.848192941 +0000 UTC m=+21.820854096"
Jul 02 19:01:59.723335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:59.723313    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:01:59.723461 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:59.723441    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:01:59.723543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:59.723500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:01:59.723625 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:01:59.723606    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:01:59.813606 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:59.813577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt" event={"ID":"cd0a95b0-de71-4478-9d25-7a29a1a08b3d","Type":"ContainerStarted","Data":"e800cc955bdd183492e26aac42f3822c15b153f6661c109a6295f8556e09a7da"}
Jul 02 19:01:59.815597 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:59.815575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerStarted","Data":"5dab9b89395ea9a17d28c7ed5e215c708af4d89b6bde646888bab1ad9ec8cfa7"}
Jul 02 19:01:59.832454 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:01:59.832416    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc9tt" podStartSLOduration=4.347539371 podStartE2EDuration="22.832404269s" totalImagesPullingTime="18.484864898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:59.832159448 +0000 UTC m=+22.804820602" watchObservedRunningTime="2026-07-02 19:01:59.832404269 +0000 UTC m=+22.805065445"
Jul 02 19:02:00.722565 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:00.722535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:00.722810 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:00.722647    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:00.819623 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:00.819583    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="5dab9b89395ea9a17d28c7ed5e215c708af4d89b6bde646888bab1ad9ec8cfa7" exitCode=0
Jul 02 19:02:00.820011 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:00.819669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"5dab9b89395ea9a17d28c7ed5e215c708af4d89b6bde646888bab1ad9ec8cfa7"}
Jul 02 19:02:01.722737 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:01.722703    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:01.722904 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:01.722859    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:01.722969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:01.722909    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:01.723072 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:01.723042    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:02.723192 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:02.723159    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:02.723629 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:02.723287    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:03.723135 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:03.723104    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:03.723299 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:03.723237    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:03.723299 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:03.723283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:03.723691 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:03.723369    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:04.722600 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:04.722568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:04.722769 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:04.722679    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:05.723073 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:05.723042    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:05.723073 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:05.723047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:05.723555 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:05.723202    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:05.723555 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:05.723221    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:06.723378 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.723211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:06.723788 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:06.723467    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:06.835939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.835886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:02:06.836269 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836250    2569 generic.go:356] "Generic (PLEG): container finished" podID="738ebfaf-caba-4bd6-aa56-80d60490f4b9" containerID="244198c083bea6ffc631414b57a248cc54d91d989c0de52f9928c606569842e9" exitCode=1
Jul 02 19:02:06.836358 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"0301d02e1b95870ebd62f4c62492955b9d12832f520c58ffe28bd476a318871c"}
Jul 02 19:02:06.836409 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"0019f424cb0076d8a3143d035532c39384a0383e74fe03e56b699e90ac97e3c4"}
Jul 02 19:02:06.836462 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836441    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"e387b4e00cd49723500255710ad8f9142e3c8e823e6acf98c757f341671e7479"}
Jul 02 19:02:06.836511 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836497    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"37a45b1d75bb45f13da47d35a137adea5b217ecd65cdc99232fa65ab80cb01d5"}
Jul 02 19:02:06.836561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836544    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"aef5387810df26c820eb98ff09191a7c29b666d92dfdc4cc1a865ac6f1b6a606"}
Jul 02 19:02:06.836616 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.836577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerDied","Data":"244198c083bea6ffc631414b57a248cc54d91d989c0de52f9928c606569842e9"}
Jul 02 19:02:06.838672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.838652    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="8b7ae990670844d8d748a0b139b4b655986b8bddcf715118c8621c26a8ae455e" exitCode=0
Jul 02 19:02:06.838751 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:06.838690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"8b7ae990670844d8d748a0b139b4b655986b8bddcf715118c8621c26a8ae455e"}
Jul 02 19:02:07.723616 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:07.723588    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:07.724004 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:07.723672    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:07.724004 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:07.723764    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:07.724004 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:07.723839    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:08.722500 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:08.722474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:08.722624 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:08.722591    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:08.845672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:08.845600    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:02:08.846161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:08.846138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"f3b84112245d5529c4522350f9adc75d146b6272c00493fe5c2692de89be19bd"}
Jul 02 19:02:09.722534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:09.722500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:09.722704 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:09.722625    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:09.722704 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:09.722673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:09.722780 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:09.722762    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:10.722455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.722432    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:10.722958 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:10.722540    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:10.855462 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.855436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:02:10.856133 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.856028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"ab27f0a72318dcb98f6758392bd4594baca585530c194c6073cfaaf0d3558207"}
Jul 02 19:02:10.856414 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.856379    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:10.856523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.856463    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:10.856523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.856513    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:10.857131 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.856631    2569 scope.go:117] "RemoveContainer" containerID="244198c083bea6ffc631414b57a248cc54d91d989c0de52f9928c606569842e9"
Jul 02 19:02:10.877353 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.877154    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:10.877820 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:10.877718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:11.235131 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.235088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:11.235285 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.235137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:11.235285 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.235249    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:11.235285 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.235262    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:11.235441 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.235317    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret podName:c7762fcf-f3b4-44e9-aec8-465f82fd2411 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:43.235298364 +0000 UTC m=+66.207959496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret") pod "global-pull-secret-syncer-zsqcz" (UID: "c7762fcf-f3b4-44e9-aec8-465f82fd2411") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:11.235441 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.235336    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:43.235325465 +0000 UTC m=+66.207986597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:11.336198 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.336161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:11.336359 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.336306    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:11.336359 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.336332    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:11.336359 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.336347    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ph44j for pod openshift-network-diagnostics/network-check-target-gllnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:11.336519 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.336408    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j podName:49596e4f-8c55-4f62-a993-3d8bc4d3d6db nodeName:}" failed. No retries permitted until 2026-07-02 19:02:43.336390223 +0000 UTC m=+66.309051360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ph44j" (UniqueName: "kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j") pod "network-check-target-gllnw" (UID: "49596e4f-8c55-4f62-a993-3d8bc4d3d6db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:11.723541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.723465    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:11.723994 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.723604    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:11.723994 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.723671    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:11.723994 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:11.723785    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:11.862752 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.862727    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:02:11.863141 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.863110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" event={"ID":"738ebfaf-caba-4bd6-aa56-80d60490f4b9","Type":"ContainerStarted","Data":"1a61d8f75e134b9a5a74d6d2172fa3da9361a3cf9c33226703795e78f2eec787"}
Jul 02 19:02:11.891469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:11.891417    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm" podStartSLOduration=18.162532623 podStartE2EDuration="34.891380103s" totalImagesPullingTime="16.72884748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:11.890781903 +0000 UTC m=+34.863443095" watchObservedRunningTime="2026-07-02 19:02:11.891380103 +0000 UTC m=+34.864041257"
Jul 02 19:02:12.705108 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.705079    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsqcz"]
Jul 02 19:02:12.705331 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.705187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:12.705331 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:12.705285    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:12.707966 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.707939    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gllnw"]
Jul 02 19:02:12.708126 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.708018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:12.708199 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:12.708116    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:12.708609 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.708589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n57s7"]
Jul 02 19:02:12.708693 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.708678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:12.708801 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:12.708777    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:12.868696 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:12.868650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerStarted","Data":"11b7d12f39bd99b01a0246da901b64e05f600084e7e2530a214e7d488c7f1395"}
Jul 02 19:02:13.873663 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:13.873624    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="11b7d12f39bd99b01a0246da901b64e05f600084e7e2530a214e7d488c7f1395" exitCode=0
Jul 02 19:02:13.874153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:13.873692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"11b7d12f39bd99b01a0246da901b64e05f600084e7e2530a214e7d488c7f1395"}
Jul 02 19:02:14.723355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:14.723328    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:14.723533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:14.723331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:14.723533 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:14.723430    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:14.723649 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:14.723540    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:14.723649 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:14.723332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:14.723649 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:14.723625    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:14.878333 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:14.878306    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbec8ef8-69b6-4b6b-9a0d-88c565f702bb" containerID="669c98f6afcfa99e19b0eb3a869d875bde32179bf93a85a98897f7331ada8c7f" exitCode=0
Jul 02 19:02:14.878763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:14.878352    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerDied","Data":"669c98f6afcfa99e19b0eb3a869d875bde32179bf93a85a98897f7331ada8c7f"}
Jul 02 19:02:15.886917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:15.886875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" event={"ID":"bbec8ef8-69b6-4b6b-9a0d-88c565f702bb","Type":"ContainerStarted","Data":"9461eec231385456b4743b03034985476317a96f69de0f32ddb862dd0a6bb447"}
Jul 02 19:02:15.914090 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:15.914051    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5gjlt" podStartSLOduration=9.828384166 podStartE2EDuration="38.914037984s" totalImagesPullingTime="29.085653818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:15.913657134 +0000 UTC m=+38.886318288" watchObservedRunningTime="2026-07-02 19:02:15.914037984 +0000 UTC m=+38.886699138"
Jul 02 19:02:16.723209 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:16.723176    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:16.723356 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:16.723271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:16.723356 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:16.723282    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:16.723356 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:16.723278    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gllnw" podUID="49596e4f-8c55-4f62-a993-3d8bc4d3d6db"
Jul 02 19:02:16.723467 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:16.723386    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsqcz" podUID="c7762fcf-f3b4-44e9-aec8-465f82fd2411"
Jul 02 19:02:16.723501 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:16.723483    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:02:18.246542 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.246517    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeReady"
Jul 02 19:02:18.247002 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.246608    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:02:18.294759 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.294737    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-drll2"]
Jul 02 19:02:18.316550 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.316528    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5vr"]
Jul 02 19:02:18.316652 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.316636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.319019 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.319001    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:02:18.319403 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.319380    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:02:18.319456 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.319412    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\""
Jul 02 19:02:18.334628 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.334606    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.334628 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.334614    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drll2"]
Jul 02 19:02:18.334745 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.334680    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5vr"]
Jul 02 19:02:18.336739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.336717    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:02:18.336858 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.336829    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.336952 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.336937    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.337061 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.337043    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntzvv\""
Jul 02 19:02:18.493742 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf4bl\" (UniqueName: \"kubernetes.io/projected/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-kube-api-access-kf4bl\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.493742 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjs5\" (UniqueName: \"kubernetes.io/projected/4e78731a-8f8b-4527-9824-ead1338326c4-kube-api-access-qtjs5\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.493742 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-cert\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.493922 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e78731a-8f8b-4527-9824-ead1338326c4-config-volume\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.493922 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493814    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.493922 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.493873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e78731a-8f8b-4527-9824-ead1338326c4-tmp-dir\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.594992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjs5\" (UniqueName: \"kubernetes.io/projected/4e78731a-8f8b-4527-9824-ead1338326c4-kube-api-access-qtjs5\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-cert\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.595242 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595082    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e78731a-8f8b-4527-9824-ead1338326c4-config-volume\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595242 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595332 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595283    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e78731a-8f8b-4527-9824-ead1338326c4-tmp-dir\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595379 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:18.595337    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:18.595379 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf4bl\" (UniqueName: \"kubernetes.io/projected/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-kube-api-access-kf4bl\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.595469 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:18.595421    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.095399702 +0000 UTC m=+42.068060833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:18.595621 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595599    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e78731a-8f8b-4527-9824-ead1338326c4-tmp-dir\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.595784 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.595759    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e78731a-8f8b-4527-9824-ead1338326c4-config-volume\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.599385 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.599360    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-cert\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.605428 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.605408    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf4bl\" (UniqueName: \"kubernetes.io/projected/1785f430-a4c3-4270-bbc2-4c93ac00ebb7-kube-api-access-kf4bl\") pod \"ingress-canary-zs5vr\" (UID: \"1785f430-a4c3-4270-bbc2-4c93ac00ebb7\") " pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.605780 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.605764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjs5\" (UniqueName: \"kubernetes.io/projected/4e78731a-8f8b-4527-9824-ead1338326c4-kube-api-access-qtjs5\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:18.641959 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.641926    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zs5vr"
Jul 02 19:02:18.722724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.722693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:18.722917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.722734    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:18.722917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.722792    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:18.725527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.725496    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.725527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.725509    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\""
Jul 02 19:02:18.725678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.725536    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:02:18.725678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.725578    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\""
Jul 02 19:02:18.726271 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.726255    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:02:18.726341 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.726326    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.815633 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.815413    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5vr"]
Jul 02 19:02:18.819609 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:02:18.819578    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1785f430_a4c3_4270_bbc2_4c93ac00ebb7.slice/crio-4a10092e411440b9f8d93e191504fb10f72ea5db62f12902e8c1bcbee0381630 WatchSource:0}: Error finding container 4a10092e411440b9f8d93e191504fb10f72ea5db62f12902e8c1bcbee0381630: Status 404 returned error can't find the container with id 4a10092e411440b9f8d93e191504fb10f72ea5db62f12902e8c1bcbee0381630
Jul 02 19:02:18.892856 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:18.892809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zs5vr" event={"ID":"1785f430-a4c3-4270-bbc2-4c93ac00ebb7","Type":"ContainerStarted","Data":"4a10092e411440b9f8d93e191504fb10f72ea5db62f12902e8c1bcbee0381630"}
Jul 02 19:02:19.100071 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:19.100043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:19.100229 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:19.100195    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:19.100273 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:19.100257    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:20.100242893 +0000 UTC m=+43.072904025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:20.107427 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:20.107396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:20.107994 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:20.107548    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:20.107994 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:20.107611    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:22.107591469 +0000 UTC m=+45.080252606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:21.900744 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:21.900704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zs5vr" event={"ID":"1785f430-a4c3-4270-bbc2-4c93ac00ebb7","Type":"ContainerStarted","Data":"c2b2c6fe3b1b87a32896c362fce29d226c07dce34fec6bca0b6432796518d0b6"}
Jul 02 19:02:21.916605 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:21.916560    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zs5vr" podStartSLOduration=1.546513332 podStartE2EDuration="3.916546088s" totalImagesPullingTime="2.370032756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:21.916299074 +0000 UTC m=+44.888960227" watchObservedRunningTime="2026-07-02 19:02:21.916546088 +0000 UTC m=+44.889207243"
Jul 02 19:02:22.123896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:22.123866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:22.124026 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:22.123963    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:22.124026 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:22.124014    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:26.124000867 +0000 UTC m=+49.096661999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:26.153043 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:26.152999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:26.153411 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:26.153167    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:26.153411 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:26.153245    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:34.153228047 +0000 UTC m=+57.125889180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:34.208257 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:34.208212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:34.208835 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:34.208335    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:34.208835 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:34.208390    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:50.208376088 +0000 UTC m=+73.181037220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:42.882901 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:42.882873    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r5pzm"
Jul 02 19:02:43.261400 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.261320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:02:43.261400 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.261358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:43.263960 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.263940    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:02:43.264016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.263940    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:02:43.271993 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:43.271978    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:02:43.272046 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:43.272030    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:47.272016276 +0000 UTC m=+130.244677408 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : secret "metrics-daemon-secret" not found
Jul 02 19:02:43.275224 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.275205    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7762fcf-f3b4-44e9-aec8-465f82fd2411-original-pull-secret\") pod \"global-pull-secret-syncer-zsqcz\" (UID: \"c7762fcf-f3b4-44e9-aec8-465f82fd2411\") " pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:43.339505 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.339481    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsqcz"
Jul 02 19:02:43.361927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.361902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:43.364338 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.364320    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:02:43.374739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.374720    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:02:43.385953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.385921    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph44j\" (UniqueName: \"kubernetes.io/projected/49596e4f-8c55-4f62-a993-3d8bc4d3d6db-kube-api-access-ph44j\") pod \"network-check-target-gllnw\" (UID: \"49596e4f-8c55-4f62-a993-3d8bc4d3d6db\") " pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:43.482823 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.482795    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsqcz"]
Jul 02 19:02:43.635521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.635497    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\""
Jul 02 19:02:43.643051 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.643031    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:43.786352 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.786320    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gllnw"]
Jul 02 19:02:43.791542 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:02:43.791515    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49596e4f_8c55_4f62_a993_3d8bc4d3d6db.slice/crio-096942eee47416131a5b094380249b547adb6984032dc2aa8a6fa171964d8501 WatchSource:0}: Error finding container 096942eee47416131a5b094380249b547adb6984032dc2aa8a6fa171964d8501: Status 404 returned error can't find the container with id 096942eee47416131a5b094380249b547adb6984032dc2aa8a6fa171964d8501
Jul 02 19:02:43.951680 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.951615    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gllnw" event={"ID":"49596e4f-8c55-4f62-a993-3d8bc4d3d6db","Type":"ContainerStarted","Data":"096942eee47416131a5b094380249b547adb6984032dc2aa8a6fa171964d8501"}
Jul 02 19:02:43.952889 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:43.952865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsqcz" event={"ID":"c7762fcf-f3b4-44e9-aec8-465f82fd2411","Type":"ContainerStarted","Data":"ea333a1505c249e1817596e95fc9be6b42495c1646d102464af29f41b55bc57f"}
Jul 02 19:02:48.967925 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:48.967883    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gllnw" event={"ID":"49596e4f-8c55-4f62-a993-3d8bc4d3d6db","Type":"ContainerStarted","Data":"906ed7b411e940218762c061a6f145b8fc8c55972ac1e57596366427e489878e"}
Jul 02 19:02:48.968432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:48.967987    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:02:48.969548 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:48.969512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsqcz" event={"ID":"c7762fcf-f3b4-44e9-aec8-465f82fd2411","Type":"ContainerStarted","Data":"59334177a47306d63880343ea4acc34599f177fc9ca1701046c71e9b27fb68cf"}
Jul 02 19:02:48.983228 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:48.983180    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gllnw" podStartSLOduration=67.279043951 podStartE2EDuration="1m11.983167939s" totalImagesPullingTime="4.704123988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:48.982757732 +0000 UTC m=+71.955418886" watchObservedRunningTime="2026-07-02 19:02:48.983167939 +0000 UTC m=+71.955829161"
Jul 02 19:02:48.998939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:48.998895    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zsqcz" podStartSLOduration=66.98506075 podStartE2EDuration="1m11.998882431s" totalImagesPullingTime="5.013821681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:48.997904353 +0000 UTC m=+71.970565506" watchObservedRunningTime="2026-07-02 19:02:48.998882431 +0000 UTC m=+71.971543585"
Jul 02 19:02:50.303303 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:02:50.303257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:02:50.303704 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:50.303399    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:50.303704 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:02:50.303461    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:22.303446756 +0000 UTC m=+105.276107888 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:19.974273 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:03:19.974245    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gllnw"
Jul 02 19:03:22.309757 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:03:22.309722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:03:22.310090 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:03:22.309867    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:22.310090 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:03:22.309928    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:26.309909494 +0000 UTC m=+169.282570629 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:47.372876 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:03:47.372819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:03:47.373402 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:03:47.372952    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:03:47.373402 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:03:47.373014    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:49.372997325 +0000 UTC m=+252.345658457 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : secret "metrics-daemon-secret" not found
Jul 02 19:04:21.325794 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:04:21.325757    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-drll2" podUID="4e78731a-8f8b-4527-9824-ead1338326c4"
Jul 02 19:04:21.746349 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:04:21.746266    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:04:22.185801 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:04:22.185771    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drll2"
Jul 02 19:04:26.319370 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:04:26.319328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:04:26.319744 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:04:26.319446    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:04:26.319744 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:04:26.319519    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls podName:4e78731a-8f8b-4527-9824-ead1338326c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:28.319504153 +0000 UTC m=+291.292165285 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls") pod "dns-default-drll2" (UID: "4e78731a-8f8b-4527-9824-ead1338326c4") : secret "dns-default-metrics-tls" not found
Jul 02 19:04:36.723104 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:04:36.723002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:05:39.744719 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.744683    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"]
Jul 02 19:05:39.746666 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.746643    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.752230 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.752206    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"]
Jul 02 19:05:39.752656 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.752625    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 19:05:39.752775 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.752681    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.753545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.753518    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qh5fh\""
Jul 02 19:05:39.753648 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.753543    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.753648 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.753587    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 19:05:39.754041 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.754025    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.763938 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.763913    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.764035 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.763914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 19:05:39.764652 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.764631    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8kpv7\""
Jul 02 19:05:39.764747 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.764686    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.764792 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.764772    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 19:05:39.786543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5vf\" (UniqueName: \"kubernetes.io/projected/57c9968b-b595-4179-ae45-07831798b858-kube-api-access-bg5vf\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.786639 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57c9968b-b595-4179-ae45-07831798b858-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.786639 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7970efff-bdc2-4183-bd90-dd7eabe39179-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.786727 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786647    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57c9968b-b595-4179-ae45-07831798b858-config\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.786727 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5z5\" (UniqueName: \"kubernetes.io/projected/7970efff-bdc2-4183-bd90-dd7eabe39179-kube-api-access-xc5z5\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.786727 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.786724    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.809582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.809563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"]
Jul 02 19:05:39.810178 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.810159    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"]
Jul 02 19:05:39.835399 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.835378    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"]
Jul 02 19:05:39.837078 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.837064    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"
Jul 02 19:05:39.840003 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.839987    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.840785 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.840764    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9xrtb\""
Jul 02 19:05:39.841185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.841166    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.862049 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.862030    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"]
Jul 02 19:05:39.887523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57c9968b-b595-4179-ae45-07831798b858-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.887615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7970efff-bdc2-4183-bd90-dd7eabe39179-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.887615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57c9968b-b595-4179-ae45-07831798b858-config\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.887615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5z5\" (UniqueName: \"kubernetes.io/projected/7970efff-bdc2-4183-bd90-dd7eabe39179-kube-api-access-xc5z5\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.887765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.887765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2dzl\" (UniqueName: \"kubernetes.io/projected/ba0ed475-4c8d-49ad-8237-d6c62bd22d34-kube-api-access-f2dzl\") pod \"volume-data-source-validator-5d456fdbcd-78fgh\" (UID: \"ba0ed475-4c8d-49ad-8237-d6c62bd22d34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"
Jul 02 19:05:39.887765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.887759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5vf\" (UniqueName: \"kubernetes.io/projected/57c9968b-b595-4179-ae45-07831798b858-kube-api-access-bg5vf\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.887944 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:39.887814    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:39.887944 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:39.887901    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:40.387885859 +0000 UTC m=+243.360546995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:39.888200 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.888182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57c9968b-b595-4179-ae45-07831798b858-config\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.888317 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.888301    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7970efff-bdc2-4183-bd90-dd7eabe39179-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.889930 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.889908    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57c9968b-b595-4179-ae45-07831798b858-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.907987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.907962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5z5\" (UniqueName: \"kubernetes.io/projected/7970efff-bdc2-4183-bd90-dd7eabe39179-kube-api-access-xc5z5\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:39.914741 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.914717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5vf\" (UniqueName: \"kubernetes.io/projected/57c9968b-b595-4179-ae45-07831798b858-kube-api-access-bg5vf\") pod \"service-ca-operator-5d46d9ffd4-gj28g\" (UID: \"57c9968b-b595-4179-ae45-07831798b858\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:39.918791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.918772    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"]
Jul 02 19:05:39.920790 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.920776    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:39.922549 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.922529    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56d5887d7-jftrq"]
Jul 02 19:05:39.923784 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.923769    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-54vs7\""
Jul 02 19:05:39.923991 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.923970    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.923991 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.923989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.924140 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.924004    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 19:05:39.924140 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.924055    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:39.926774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.926757    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 19:05:39.928389 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.928371    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 19:05:39.928518 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.928473    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.928586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.928573    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.935666 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.935650    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 19:05:39.935747 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.935653    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 19:05:39.937692 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.937674    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rj888\""
Jul 02 19:05:39.939203 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.939183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"]
Jul 02 19:05:39.950872 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.950839    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56d5887d7-jftrq"]
Jul 02 19:05:39.988225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx59k\" (UniqueName: \"kubernetes.io/projected/2365e06f-3e94-4b63-91d8-d3e330ad8f32-kube-api-access-kx59k\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:39.988305 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2dzl\" (UniqueName: \"kubernetes.io/projected/ba0ed475-4c8d-49ad-8237-d6c62bd22d34-kube-api-access-f2dzl\") pod \"volume-data-source-validator-5d456fdbcd-78fgh\" (UID: \"ba0ed475-4c8d-49ad-8237-d6c62bd22d34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"
Jul 02 19:05:39.988305 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:39.988305 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-stats-auth\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:39.988446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988427    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgzs\" (UniqueName: \"kubernetes.io/projected/269aad8f-01fb-42b1-be96-2df57f87f5d8-kube-api-access-vlgzs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:39.988488 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:39.988521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:39.988568 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:39.988553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-default-certificate\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.009775 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.009737    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2dzl\" (UniqueName: \"kubernetes.io/projected/ba0ed475-4c8d-49ad-8237-d6c62bd22d34-kube-api-access-f2dzl\") pod \"volume-data-source-validator-5d456fdbcd-78fgh\" (UID: \"ba0ed475-4c8d-49ad-8237-d6c62bd22d34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"
Jul 02 19:05:40.055906 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.055877    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"
Jul 02 19:05:40.088971 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.088947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:40.089069 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.088977    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-stats-auth\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.089069 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.088996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgzs\" (UniqueName: \"kubernetes.io/projected/269aad8f-01fb-42b1-be96-2df57f87f5d8-kube-api-access-vlgzs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.089139 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.089063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.089139 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.089098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.089139 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.089124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-default-certificate\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.089266 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.089162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx59k\" (UniqueName: \"kubernetes.io/projected/2365e06f-3e94-4b63-91d8-d3e330ad8f32-kube-api-access-kx59k\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:40.089266 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.089205    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:40.589184892 +0000 UTC m=+243.561846041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:40.089266 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.089238    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:40.089266 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.089256    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:40.089447 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.089296    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls podName:2365e06f-3e94-4b63-91d8-d3e330ad8f32 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:40.58927857 +0000 UTC m=+243.561939704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-spvb2" (UID: "2365e06f-3e94-4b63-91d8-d3e330ad8f32") : secret "samples-operator-tls" not found
Jul 02 19:05:40.089447 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.089384    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:40.589373123 +0000 UTC m=+243.562034262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : secret "router-metrics-certs-default" not found
Jul 02 19:05:40.091363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.091345    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-default-certificate\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.091431 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.091387    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-stats-auth\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.098121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.098099    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgzs\" (UniqueName: \"kubernetes.io/projected/269aad8f-01fb-42b1-be96-2df57f87f5d8-kube-api-access-vlgzs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.098799 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.098780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx59k\" (UniqueName: \"kubernetes.io/projected/2365e06f-3e94-4b63-91d8-d3e330ad8f32-kube-api-access-kx59k\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:40.145028 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.144997    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"
Jul 02 19:05:40.176766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.176740    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g"]
Jul 02 19:05:40.180407 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:05:40.180377    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c9968b_b595_4179_ae45_07831798b858.slice/crio-fccfd7a1681010a972d7320ff207f7a3597d4623931814eb7b208d0b810f1e5b WatchSource:0}: Error finding container fccfd7a1681010a972d7320ff207f7a3597d4623931814eb7b208d0b810f1e5b: Status 404 returned error can't find the container with id fccfd7a1681010a972d7320ff207f7a3597d4623931814eb7b208d0b810f1e5b
Jul 02 19:05:40.265811 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.265753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh"]
Jul 02 19:05:40.268422 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:05:40.268396    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0ed475_4c8d_49ad_8237_d6c62bd22d34.slice/crio-b1baf48ee1746b0455e690926742df4cd487332055b823a2088d7eba787417fc WatchSource:0}: Error finding container b1baf48ee1746b0455e690926742df4cd487332055b823a2088d7eba787417fc: Status 404 returned error can't find the container with id b1baf48ee1746b0455e690926742df4cd487332055b823a2088d7eba787417fc
Jul 02 19:05:40.371677 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.371642    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh" event={"ID":"ba0ed475-4c8d-49ad-8237-d6c62bd22d34","Type":"ContainerStarted","Data":"b1baf48ee1746b0455e690926742df4cd487332055b823a2088d7eba787417fc"}
Jul 02 19:05:40.372693 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.372671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g" event={"ID":"57c9968b-b595-4179-ae45-07831798b858","Type":"ContainerStarted","Data":"fccfd7a1681010a972d7320ff207f7a3597d4623931814eb7b208d0b810f1e5b"}
Jul 02 19:05:40.392042 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.392022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:40.392137 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.392124    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:40.392183 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.392178    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:41.392161832 +0000 UTC m=+244.364822964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:40.593036 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.593010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.593123 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.593041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:40.593123 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:40.593098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:40.593233 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.593164    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:41.593147996 +0000 UTC m=+244.565809128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:40.593233 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.593181    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:40.593233 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.593219    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls podName:2365e06f-3e94-4b63-91d8-d3e330ad8f32 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:41.593208209 +0000 UTC m=+244.565869342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-spvb2" (UID: "2365e06f-3e94-4b63-91d8-d3e330ad8f32") : secret "samples-operator-tls" not found
Jul 02 19:05:40.593370 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.593243    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:40.593370 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:40.593298    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:41.593282719 +0000 UTC m=+244.565943868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : secret "router-metrics-certs-default" not found
Jul 02 19:05:41.400311 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:41.400274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:41.400744 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.400443    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:41.400744 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.400514    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:43.400493134 +0000 UTC m=+246.373154279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:41.602016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:41.601986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:41.602214 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:41.602025    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:41.602214 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:41.602043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:41.602214 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.602168    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:41.602214 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.602197    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:43.602172008 +0000 UTC m=+246.574833159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:41.602426 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.602229    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:43.602218129 +0000 UTC m=+246.574879276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : secret "router-metrics-certs-default" not found
Jul 02 19:05:41.602426 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.602265    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:41.602426 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:41.602313    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls podName:2365e06f-3e94-4b63-91d8-d3e330ad8f32 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:43.602300003 +0000 UTC m=+246.574961134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-spvb2" (UID: "2365e06f-3e94-4b63-91d8-d3e330ad8f32") : secret "samples-operator-tls" not found
Jul 02 19:05:42.379775 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:42.379740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh" event={"ID":"ba0ed475-4c8d-49ad-8237-d6c62bd22d34","Type":"ContainerStarted","Data":"25f7872d78be65ed012eeb8dcf76131f474d14ea52c99e2bccbc4ff0198f89b4"}
Jul 02 19:05:42.396463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:42.396411    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-78fgh" podStartSLOduration=2.233683297 podStartE2EDuration="3.396397797s" totalImagesPullingTime="1.1627145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:42.395025548 +0000 UTC m=+245.367686703" watchObservedRunningTime="2026-07-02 19:05:42.396397797 +0000 UTC m=+245.369058929"
Jul 02 19:05:43.383900 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.383861    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g" event={"ID":"57c9968b-b595-4179-ae45-07831798b858","Type":"ContainerStarted","Data":"d288861e360121a80940a7fa761fbcfb4cf18d25c894b2ad09f06d3545994058"}
Jul 02 19:05:43.400055 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.400005    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g" podStartSLOduration=1.734328103 podStartE2EDuration="4.399985925s" totalImagesPullingTime="2.665657822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:43.398419642 +0000 UTC m=+246.371080791" watchObservedRunningTime="2026-07-02 19:05:43.399985925 +0000 UTC m=+246.372647079"
Jul 02 19:05:43.417505 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.417475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:43.417658 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.417638    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:43.417762 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.417708    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:47.417688498 +0000 UTC m=+250.390349634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:43.619598 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.619571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:43.619710 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.619607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:43.619710 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:43.619626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:43.619710 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.619699    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:43.619710 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.619703    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:43.619909 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.619732    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:47.619713626 +0000 UTC m=+250.592374778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:43.619909 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.619752    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:47.619743977 +0000 UTC m=+250.592405122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : secret "router-metrics-certs-default" not found
Jul 02 19:05:43.619909 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:43.619797    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls podName:2365e06f-3e94-4b63-91d8-d3e330ad8f32 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:47.619791555 +0000 UTC m=+250.592452686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-spvb2" (UID: "2365e06f-3e94-4b63-91d8-d3e330ad8f32") : secret "samples-operator-tls" not found
Jul 02 19:05:45.088262 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.088235    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"]
Jul 02 19:05:45.090358 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.090343    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"
Jul 02 19:05:45.092926 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.092895    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 19:05:45.093864 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.093831    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dwhlx\""
Jul 02 19:05:45.093959 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.093858    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:45.101304 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.101285    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"]
Jul 02 19:05:45.131128 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.131106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bwp\" (UniqueName: \"kubernetes.io/projected/2778f033-0eac-4313-8437-43e2a1822003-kube-api-access-c7bwp\") pod \"migrator-d57d58cc9-8qhqj\" (UID: \"2778f033-0eac-4313-8437-43e2a1822003\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"
Jul 02 19:05:45.217903 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.217872    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvkv"]
Jul 02 19:05:45.219959 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.219935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.223516 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.223495    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:05:45.223642 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.223550    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-969mm\""
Jul 02 19:05:45.223642 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.223580    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:05:45.223881 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.223867    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:05:45.224422 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.224408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:05:45.232275 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.232257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bwp\" (UniqueName: \"kubernetes.io/projected/2778f033-0eac-4313-8437-43e2a1822003-kube-api-access-c7bwp\") pod \"migrator-d57d58cc9-8qhqj\" (UID: \"2778f033-0eac-4313-8437-43e2a1822003\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"
Jul 02 19:05:45.236482 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.236461    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvkv"]
Jul 02 19:05:45.246738 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.246719    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bwp\" (UniqueName: \"kubernetes.io/projected/2778f033-0eac-4313-8437-43e2a1822003-kube-api-access-c7bwp\") pod \"migrator-d57d58cc9-8qhqj\" (UID: \"2778f033-0eac-4313-8437-43e2a1822003\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"
Jul 02 19:05:45.332758 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.332732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.332874 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.332770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d60656bf-98f0-4af5-a3a7-c98ef13327ab-crio-socket\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.332930 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.332898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-528x4\" (UniqueName: \"kubernetes.io/projected/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-api-access-528x4\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.332978 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.332929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.332978 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.332953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d60656bf-98f0-4af5-a3a7-c98ef13327ab-data-volume\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.398970 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.398901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"
Jul 02 19:05:45.433860 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.433805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d60656bf-98f0-4af5-a3a7-c98ef13327ab-crio-socket\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.433921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-528x4\" (UniqueName: \"kubernetes.io/projected/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-api-access-528x4\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.433954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.433925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d60656bf-98f0-4af5-a3a7-c98ef13327ab-crio-socket\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.433987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d60656bf-98f0-4af5-a3a7-c98ef13327ab-data-volume\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.434063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.434074    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.434139    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.934119872 +0000 UTC m=+248.906781008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.434143    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.434196    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.934177478 +0000 UTC m=+248.906838624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.434331 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.434288    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d60656bf-98f0-4af5-a3a7-c98ef13327ab-data-volume\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.442529 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.442482    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-528x4\" (UniqueName: \"kubernetes.io/projected/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-api-access-528x4\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.523534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.523509    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj"]
Jul 02 19:05:45.525481 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:05:45.525454    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2778f033_0eac_4313_8437_43e2a1822003.slice/crio-838ddf54c1d8932ec4f4f71137c341a1f10d3861e8650434104608aff2750a8a WatchSource:0}: Error finding container 838ddf54c1d8932ec4f4f71137c341a1f10d3861e8650434104608aff2750a8a: Status 404 returned error can't find the container with id 838ddf54c1d8932ec4f4f71137c341a1f10d3861e8650434104608aff2750a8a
Jul 02 19:05:45.937466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.937413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.937658 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:45.937489    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:45.937658 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.937569    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.937658 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.937617    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.937603572 +0000 UTC m=+249.910264704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.937658 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.937569    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.937791 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:45.937703    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.93768684 +0000 UTC m=+249.910347981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:46.393895 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:46.393858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj" event={"ID":"2778f033-0eac-4313-8437-43e2a1822003","Type":"ContainerStarted","Data":"838ddf54c1d8932ec4f4f71137c341a1f10d3861e8650434104608aff2750a8a"}
Jul 02 19:05:46.945395 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:46.945362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:46.945509 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:46.945434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:46.945572 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:46.945504    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:46.945572 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:46.945527    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:46.945572 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:46.945556    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.945541587 +0000 UTC m=+251.918202720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:46.945684 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:46.945579    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.94556181 +0000 UTC m=+251.918222955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:47.399026 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.398995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj" event={"ID":"2778f033-0eac-4313-8437-43e2a1822003","Type":"ContainerStarted","Data":"47f18f0e908b347e5c20b42dcc8619f458fa1c24d92c57df5659075c6f546f6c"}
Jul 02 19:05:47.399484 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.399050    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj" event={"ID":"2778f033-0eac-4313-8437-43e2a1822003","Type":"ContainerStarted","Data":"f418665f75f8b57b16deb233f317d3302837504b4e79f0c276193872b959ff7a"}
Jul 02 19:05:47.420071 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.419941    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8qhqj" podStartSLOduration=1.170821945 podStartE2EDuration="2.419926959s" totalImagesPullingTime="1.249105014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:47.419527422 +0000 UTC m=+250.392188577" watchObservedRunningTime="2026-07-02 19:05:47.419926959 +0000 UTC m=+250.392588113"
Jul 02 19:05:47.448292 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.448262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:47.448393 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.448381    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:47.448452 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.448441    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.448426326 +0000 UTC m=+258.421087478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:47.649806 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.649742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:47.649806 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.649777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:47.649806 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.649794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:47.650045 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.649903    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:47.650045 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.649918    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:47.650045 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.649928    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.649912854 +0000 UTC m=+258.622573986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:47.650045 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.649986    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.649968507 +0000 UTC m=+258.622629640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : secret "router-metrics-certs-default" not found
Jul 02 19:05:47.650045 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:47.650002    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls podName:2365e06f-3e94-4b63-91d8-d3e330ad8f32 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.649992758 +0000 UTC m=+258.622653894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-spvb2" (UID: "2365e06f-3e94-4b63-91d8-d3e330ad8f32") : secret "samples-operator-tls" not found
Jul 02 19:05:47.992605 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:47.992542    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2dmw_9c915941-fd74-4541-91c4-7bd76399139d/dns-node-resolver/0.log"
Jul 02 19:05:48.960500 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:48.960458    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:48.960960 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:48.960520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:48.960960 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:48.960582    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:48.960960 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:48.960633    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:48.960960 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:48.960637    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.96062415 +0000 UTC m=+255.933285281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:48.960960 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:48.960714    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.960695837 +0000 UTC m=+255.933356979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:48.991359 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:48.991333    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tcmtj_6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d/node-ca/0.log"
Jul 02 19:05:49.463596 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:49.463563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:05:49.463793 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:49.463673    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:05:49.463793 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:49.463725    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs podName:f7f5e59d-f851-4be3-8673-57c39de70955 nodeName:}" failed. No retries permitted until 2026-07-02 19:07:51.463712925 +0000 UTC m=+374.436374057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs") pod "network-metrics-daemon-n57s7" (UID: "f7f5e59d-f851-4be3-8673-57c39de70955") : secret "metrics-daemon-secret" not found
Jul 02 19:05:49.991468 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:49.991439    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zs5vr_1785f430-a4c3-4270-bbc2-4c93ac00ebb7/serve-healthcheck-canary/0.log"
Jul 02 19:05:50.191414 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:50.191348    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8qhqj_2778f033-0eac-4313-8437-43e2a1822003/migrator/0.log"
Jul 02 19:05:50.391571 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:50.391544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8qhqj_2778f033-0eac-4313-8437-43e2a1822003/graceful-termination/0.log"
Jul 02 19:05:52.989092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:52.989056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:52.989550 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:52.989119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:05:52.989550 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:52.989192    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:52.989550 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:52.989200    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:52.989550 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:52.989254    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:06:00.989239038 +0000 UTC m=+263.961900170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:52.989550 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:52.989275    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls podName:d60656bf-98f0-4af5-a3a7-c98ef13327ab nodeName:}" failed. No retries permitted until 2026-07-02 19:06:00.989260479 +0000 UTC m=+263.961921611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvkv" (UID: "d60656bf-98f0-4af5-a3a7-c98ef13327ab") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:55.507343 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.507307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:05:55.507741 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:55.507443    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:55.507741 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:55.507515    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls podName:7970efff-bdc2-4183-bd90-dd7eabe39179 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:11.507499219 +0000 UTC m=+274.480160351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9wwgx" (UID: "7970efff-bdc2-4183-bd90-dd7eabe39179") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:55.709145 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.709114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:55.709281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.709154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:55.709281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.709178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:55.709352 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:05:55.709313    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle podName:269aad8f-01fb-42b1-be96-2df57f87f5d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:11.709295329 +0000 UTC m=+274.681956461 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle") pod "router-default-56d5887d7-jftrq" (UID: "269aad8f-01fb-42b1-be96-2df57f87f5d8") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:55.711723 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.711691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/269aad8f-01fb-42b1-be96-2df57f87f5d8-metrics-certs\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:05:55.712280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.712253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2365e06f-3e94-4b63-91d8-d3e330ad8f32-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-spvb2\" (UID: \"2365e06f-3e94-4b63-91d8-d3e330ad8f32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:55.830651 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.830629    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"
Jul 02 19:05:55.946710 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:55.946688    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2"]
Jul 02 19:05:56.424505 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:56.424475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2" event={"ID":"2365e06f-3e94-4b63-91d8-d3e330ad8f32","Type":"ContainerStarted","Data":"988c96e1093211fa32afee4afd6924f15bdc60d9b1aa40e36988b69490cfca91"}
Jul 02 19:05:58.433057 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:58.433023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2" event={"ID":"2365e06f-3e94-4b63-91d8-d3e330ad8f32","Type":"ContainerStarted","Data":"3ed3b1e60f4c604dc3594c03c2fc9a87158f74dda795b17711ff1ab5043532d1"}
Jul 02 19:05:58.433401 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:58.433096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2" event={"ID":"2365e06f-3e94-4b63-91d8-d3e330ad8f32","Type":"ContainerStarted","Data":"3af8fc944be44d05d896b677eec9597ff4d6f8d27aa795fa90f3e94b90439147"}
Jul 02 19:05:58.449412 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:05:58.449355    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-spvb2" podStartSLOduration=17.612520837 podStartE2EDuration="19.449340771s" totalImagesPullingTime="1.836819934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:58.448668347 +0000 UTC m=+261.421329501" watchObservedRunningTime="2026-07-02 19:05:58.449340771 +0000 UTC m=+261.422001924"
Jul 02 19:06:01.050491 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.050446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:06:01.050992 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.050618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:06:01.051094 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.051076    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d60656bf-98f0-4af5-a3a7-c98ef13327ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:06:01.052689 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.052668    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d60656bf-98f0-4af5-a3a7-c98ef13327ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvkv\" (UID: \"d60656bf-98f0-4af5-a3a7-c98ef13327ab\") " pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:06:01.128937 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.128889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmvkv"
Jul 02 19:06:01.252161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.252133    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvkv"]
Jul 02 19:06:01.254941 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:01.254911    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60656bf_98f0_4af5_a3a7_c98ef13327ab.slice/crio-f1446daa64e9fa711b4368ceccb6bf88fe1356236502bd4ad10f4be9fba21669 WatchSource:0}: Error finding container f1446daa64e9fa711b4368ceccb6bf88fe1356236502bd4ad10f4be9fba21669: Status 404 returned error can't find the container with id f1446daa64e9fa711b4368ceccb6bf88fe1356236502bd4ad10f4be9fba21669
Jul 02 19:06:01.443390 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:01.443303    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvkv" event={"ID":"d60656bf-98f0-4af5-a3a7-c98ef13327ab","Type":"ContainerStarted","Data":"f1446daa64e9fa711b4368ceccb6bf88fe1356236502bd4ad10f4be9fba21669"}
Jul 02 19:06:05.459313 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:05.459275    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvkv" event={"ID":"d60656bf-98f0-4af5-a3a7-c98ef13327ab","Type":"ContainerStarted","Data":"30a2e12495323afbec240f37b7692a46626049c0940eb8d35a55cdcbefe3ea4b"}
Jul 02 19:06:06.465202 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:06.465161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvkv" event={"ID":"d60656bf-98f0-4af5-a3a7-c98ef13327ab","Type":"ContainerStarted","Data":"19870ad3e4d883be49d39d0a7ffc59d9d41b1db54ab57583588ae96d69d178cd"}
Jul 02 19:06:08.472700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:08.472623    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvkv" event={"ID":"d60656bf-98f0-4af5-a3a7-c98ef13327ab","Type":"ContainerStarted","Data":"d0cbc8fcda71a7e1740e39bdf29f8e151c49ae94ff908ab3ad4da65767f8f4d9"}
Jul 02 19:06:08.498252 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:08.498210    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmvkv" podStartSLOduration=16.805332947 podStartE2EDuration="23.498196151s" totalImagesPullingTime="6.692863204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:08.49764349 +0000 UTC m=+271.470304644" watchObservedRunningTime="2026-07-02 19:06:08.498196151 +0000 UTC m=+271.470857305"
Jul 02 19:06:11.524589 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.524547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:06:11.526872 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.526827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7970efff-bdc2-4183-bd90-dd7eabe39179-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9wwgx\" (UID: \"7970efff-bdc2-4183-bd90-dd7eabe39179\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:06:11.566739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.566718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"
Jul 02 19:06:11.685027 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.685000    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx"]
Jul 02 19:06:11.687249 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:11.687224    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7970efff_bdc2_4183_bd90_dd7eabe39179.slice/crio-148a701964195706e632c96269daa4319d8df361dfd49becd8b9a33649851aa1 WatchSource:0}: Error finding container 148a701964195706e632c96269daa4319d8df361dfd49becd8b9a33649851aa1: Status 404 returned error can't find the container with id 148a701964195706e632c96269daa4319d8df361dfd49becd8b9a33649851aa1
Jul 02 19:06:11.726253 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.726233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:11.726906 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.726887    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269aad8f-01fb-42b1-be96-2df57f87f5d8-service-ca-bundle\") pod \"router-default-56d5887d7-jftrq\" (UID: \"269aad8f-01fb-42b1-be96-2df57f87f5d8\") " pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:11.735329 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.735295    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:11.856875 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:11.856826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56d5887d7-jftrq"]
Jul 02 19:06:11.859268 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:11.859241    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269aad8f_01fb_42b1_be96_2df57f87f5d8.slice/crio-e92518e956a076520ad63ac06e6b05b7393726a26957c947d797c19d6626a97e WatchSource:0}: Error finding container e92518e956a076520ad63ac06e6b05b7393726a26957c947d797c19d6626a97e: Status 404 returned error can't find the container with id e92518e956a076520ad63ac06e6b05b7393726a26957c947d797c19d6626a97e
Jul 02 19:06:12.487690 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.487653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56d5887d7-jftrq" event={"ID":"269aad8f-01fb-42b1-be96-2df57f87f5d8","Type":"ContainerStarted","Data":"9c081138d846fb745c98fe3a365b8c0199785008d3dfbb598f571e0669e1a20d"}
Jul 02 19:06:12.487941 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.487713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56d5887d7-jftrq" event={"ID":"269aad8f-01fb-42b1-be96-2df57f87f5d8","Type":"ContainerStarted","Data":"e92518e956a076520ad63ac06e6b05b7393726a26957c947d797c19d6626a97e"}
Jul 02 19:06:12.488921 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.488899    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx" event={"ID":"7970efff-bdc2-4183-bd90-dd7eabe39179","Type":"ContainerStarted","Data":"148a701964195706e632c96269daa4319d8df361dfd49becd8b9a33649851aa1"}
Jul 02 19:06:12.507374 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.507333    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56d5887d7-jftrq" podStartSLOduration=33.50731861 podStartE2EDuration="33.50731861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:12.505523302 +0000 UTC m=+275.478184469" watchObservedRunningTime="2026-07-02 19:06:12.50731861 +0000 UTC m=+275.479979766"
Jul 02 19:06:12.736209 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.736177    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:12.738863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:12.738781    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:13.491831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:13.491806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:13.493028 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:13.493008    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56d5887d7-jftrq"
Jul 02 19:06:14.496535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:14.496491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx" event={"ID":"7970efff-bdc2-4183-bd90-dd7eabe39179","Type":"ContainerStarted","Data":"8b522b76c0e95f626642b1bcbeb00a715d35138937aa47a0336d46f80c7dcb1f"}
Jul 02 19:06:14.516117 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:14.516072    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9wwgx" podStartSLOduration=33.736122739 podStartE2EDuration="35.516057947s" totalImagesPullingTime="1.779935208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:14.514892835 +0000 UTC m=+277.487553989" watchObservedRunningTime="2026-07-02 19:06:14.516057947 +0000 UTC m=+277.488719101"
Jul 02 19:06:15.749807 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.749778    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:06:15.752874 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.752836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.755216 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.755195    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:06:15.756095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756079    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:06:15.756223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756201    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:06:15.756335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756210    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:06:15.756335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756219    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:06:15.756335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756235    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47vkx\""
Jul 02 19:06:15.756507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756271    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:06:15.756507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.756271    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:06:15.763803 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.763784    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:06:15.856663 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.856826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.856826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.856826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.856826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856772    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2dh\" (UniqueName: \"kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.856826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.856812    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957338 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2dh\" (UniqueName: \"kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957722 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.957722 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.957641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.958174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.958150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.958293 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.958188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.958293 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.958235    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.959639 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.959619    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.959778 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.959759    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:15.965027 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:15.965006    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2dh\" (UniqueName: \"kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh\") pod \"console-595b7b847f-xls2h\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") " pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:16.062096 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:16.062069    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:16.182654 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:16.182624    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:06:16.185756 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:16.185723    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cb6b52_3ccc_4431_b090_2268171b400d.slice/crio-145e3ca84ac101b9215c0324719eed299db851543d7ac108defa34b74df8035a WatchSource:0}: Error finding container 145e3ca84ac101b9215c0324719eed299db851543d7ac108defa34b74df8035a: Status 404 returned error can't find the container with id 145e3ca84ac101b9215c0324719eed299db851543d7ac108defa34b74df8035a
Jul 02 19:06:16.503871 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:16.503795    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b7b847f-xls2h" event={"ID":"d0cb6b52-3ccc-4431-b090-2268171b400d","Type":"ContainerStarted","Data":"145e3ca84ac101b9215c0324719eed299db851543d7ac108defa34b74df8035a"}
Jul 02 19:06:20.520123 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:20.520027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b7b847f-xls2h" event={"ID":"d0cb6b52-3ccc-4431-b090-2268171b400d","Type":"ContainerStarted","Data":"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"}
Jul 02 19:06:20.536975 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:20.536926    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595b7b847f-xls2h" podStartSLOduration=1.6725237320000002 podStartE2EDuration="5.536910288s" totalImagesPullingTime="3.864386556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:20.536468346 +0000 UTC m=+283.509129502" watchObservedRunningTime="2026-07-02 19:06:20.536910288 +0000 UTC m=+283.509571442"
Jul 02 19:06:21.395631 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.395601    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-js5xz"]
Jul 02 19:06:21.398939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.398918    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.401473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.401448    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:06:21.401688 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.401669    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:06:21.402285 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.402268    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jknhs\""
Jul 02 19:06:21.402367 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.402289    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:06:21.402367 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.402294    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:06:21.494685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-wtmp\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.494797 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.494797 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494754    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m2q\" (UniqueName: \"kubernetes.io/projected/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-kube-api-access-g7m2q\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.494911 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-root\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.494911 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-textfile\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.495002 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.495002 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-accelerators-collector-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.495002 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.494990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-metrics-client-ca\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.495134 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.495039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-sys\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.595911 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-sys\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-wtmp\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m2q\" (UniqueName: \"kubernetes.io/projected/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-kube-api-access-g7m2q\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-sys\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.595982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-root\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596000    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-textfile\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596045    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596070    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-root\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-accelerators-collector-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596129    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-wtmp\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-metrics-client-ca\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596222 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:06:21.596202    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:06:21.596706 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:06:21.596277    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls podName:d5ae7453-b602-48f5-9f4d-6b7d29a0e327 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:22.096258664 +0000 UTC m=+285.068919799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls") pod "node-exporter-js5xz" (UID: "d5ae7453-b602-48f5-9f4d-6b7d29a0e327") : secret "node-exporter-tls" not found
Jul 02 19:06:21.596706 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596484    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-textfile\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596778 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-accelerators-collector-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.596811 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.596771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-metrics-client-ca\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.598109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.598087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:21.605333 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:21.605310    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m2q\" (UniqueName: \"kubernetes.io/projected/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-kube-api-access-g7m2q\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:22.099896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:22.099863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:22.102061 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:22.102038    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5ae7453-b602-48f5-9f4d-6b7d29a0e327-node-exporter-tls\") pod \"node-exporter-js5xz\" (UID: \"d5ae7453-b602-48f5-9f4d-6b7d29a0e327\") " pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:22.307528 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:22.307500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js5xz"
Jul 02 19:06:22.319558 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:22.319537    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ae7453_b602_48f5_9f4d_6b7d29a0e327.slice/crio-756c6f267bda391685892811ae477f3d7585f7af3d5ab49ed55a128fcf776705 WatchSource:0}: Error finding container 756c6f267bda391685892811ae477f3d7585f7af3d5ab49ed55a128fcf776705: Status 404 returned error can't find the container with id 756c6f267bda391685892811ae477f3d7585f7af3d5ab49ed55a128fcf776705
Jul 02 19:06:22.530743 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:22.530707    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js5xz" event={"ID":"d5ae7453-b602-48f5-9f4d-6b7d29a0e327","Type":"ContainerStarted","Data":"756c6f267bda391685892811ae477f3d7585f7af3d5ab49ed55a128fcf776705"}
Jul 02 19:06:24.538521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:24.538487    2569 generic.go:356] "Generic (PLEG): container finished" podID="d5ae7453-b602-48f5-9f4d-6b7d29a0e327" containerID="5f098aacc93513eb83123dc40f6c2ab9084d46d07d3004209d9e893b2417f7fd" exitCode=0
Jul 02 19:06:24.538521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:24.538527    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js5xz" event={"ID":"d5ae7453-b602-48f5-9f4d-6b7d29a0e327","Type":"ContainerDied","Data":"5f098aacc93513eb83123dc40f6c2ab9084d46d07d3004209d9e893b2417f7fd"}
Jul 02 19:06:25.186698 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:06:25.186653    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-drll2" podUID="4e78731a-8f8b-4527-9824-ead1338326c4"
Jul 02 19:06:25.544244 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:25.544207    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js5xz" event={"ID":"d5ae7453-b602-48f5-9f4d-6b7d29a0e327","Type":"ContainerStarted","Data":"89f0b38df3bf5f498dd549c36989d70ef140531d91ffeac5b6268a0724c303cc"}
Jul 02 19:06:25.544688 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:25.544281    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js5xz" event={"ID":"d5ae7453-b602-48f5-9f4d-6b7d29a0e327","Type":"ContainerStarted","Data":"3b231b1b748fa7ef677f883bc33e7616159676ea2528a80aa90f52b1433093ea"}
Jul 02 19:06:25.544688 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:25.544221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:25.572234 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:25.572188    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-js5xz" podStartSLOduration=3.304550596 podStartE2EDuration="4.572172131s" totalImagesPullingTime="1.205654614s" totalInitContainerRuntime="61.966921ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:25.570970609 +0000 UTC m=+288.543631763" watchObservedRunningTime="2026-07-02 19:06:25.572172131 +0000 UTC m=+288.544833284"
Jul 02 19:06:26.062241 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.062207    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:26.062395 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.062264    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:26.067261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.067235    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:26.156689 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.156657    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"]
Jul 02 19:06:26.159839 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.159817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.162032 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.162013    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 19:06:26.162124 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.162042    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4lzxm\""
Jul 02 19:06:26.171443 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.168512    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"]
Jul 02 19:06:26.336712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.336635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0db938df-9c7e-4729-8830-4da205dfafb0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.336712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.336673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55dks\" (UniqueName: \"kubernetes.io/projected/0db938df-9c7e-4729-8830-4da205dfafb0-kube-api-access-55dks\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.437657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.437621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0db938df-9c7e-4729-8830-4da205dfafb0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.437657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.437658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55dks\" (UniqueName: \"kubernetes.io/projected/0db938df-9c7e-4729-8830-4da205dfafb0-kube-api-access-55dks\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.439958 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.439932    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0db938df-9c7e-4729-8830-4da205dfafb0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.446360 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.446330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55dks\" (UniqueName: \"kubernetes.io/projected/0db938df-9c7e-4729-8830-4da205dfafb0-kube-api-access-55dks\") pod \"monitoring-plugin-d5dcff7cf-fgc4g\" (UID: \"0db938df-9c7e-4729-8830-4da205dfafb0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.472898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.472872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:26.552588 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.552480    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:06:26.606099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:26.606073    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"]
Jul 02 19:06:26.608362 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:26.608329    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db938df_9c7e_4729_8830_4da205dfafb0.slice/crio-dedaf9f2094d891cc8f28058228ab1c89156e89a8d43d912cf0752b5968bc76d WatchSource:0}: Error finding container dedaf9f2094d891cc8f28058228ab1c89156e89a8d43d912cf0752b5968bc76d: Status 404 returned error can't find the container with id dedaf9f2094d891cc8f28058228ab1c89156e89a8d43d912cf0752b5968bc76d
Jul 02 19:06:27.554749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:27.554714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g" event={"ID":"0db938df-9c7e-4729-8830-4da205dfafb0","Type":"ContainerStarted","Data":"dedaf9f2094d891cc8f28058228ab1c89156e89a8d43d912cf0752b5968bc76d"}
Jul 02 19:06:28.352406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.352367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:28.354631 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.354603    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e78731a-8f8b-4527-9824-ead1338326c4-metrics-tls\") pod \"dns-default-drll2\" (UID: \"4e78731a-8f8b-4527-9824-ead1338326c4\") " pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:28.547326 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.547303    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\""
Jul 02 19:06:28.555388 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.555366    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:28.561955 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.561922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g" event={"ID":"0db938df-9c7e-4729-8830-4da205dfafb0","Type":"ContainerStarted","Data":"6ec3ed902f32b00f5ae0651adf647391a8fbf2f48b7b01d93f3c4ae634a39e8f"}
Jul 02 19:06:28.562143 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.562110    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:28.567878 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.567717    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g"
Jul 02 19:06:28.591021 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.590975    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fgc4g" podStartSLOduration=1.029893459 podStartE2EDuration="2.590959943s" totalImagesPullingTime="1.561066484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:28.576304131 +0000 UTC m=+291.548965297" watchObservedRunningTime="2026-07-02 19:06:28.590959943 +0000 UTC m=+291.563621074"
Jul 02 19:06:28.702416 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:28.702390    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drll2"]
Jul 02 19:06:28.703876 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:06:28.703834    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e78731a_8f8b_4527_9824_ead1338326c4.slice/crio-4a30e3c051636a9752ccad71573d090da1d8f19c3f7dd3b9f47b4db3d6b65941 WatchSource:0}: Error finding container 4a30e3c051636a9752ccad71573d090da1d8f19c3f7dd3b9f47b4db3d6b65941: Status 404 returned error can't find the container with id 4a30e3c051636a9752ccad71573d090da1d8f19c3f7dd3b9f47b4db3d6b65941
Jul 02 19:06:29.567547 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:29.567512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drll2" event={"ID":"4e78731a-8f8b-4527-9824-ead1338326c4","Type":"ContainerStarted","Data":"4a30e3c051636a9752ccad71573d090da1d8f19c3f7dd3b9f47b4db3d6b65941"}
Jul 02 19:06:31.577311 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:31.577274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drll2" event={"ID":"4e78731a-8f8b-4527-9824-ead1338326c4","Type":"ContainerStarted","Data":"201fc845f9acf428c7dd8ad7ba33872383c7a661f49dd304bd6b4f478b64d505"}
Jul 02 19:06:31.577785 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:31.577328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drll2" event={"ID":"4e78731a-8f8b-4527-9824-ead1338326c4","Type":"ContainerStarted","Data":"05fd8b621a09199b0b108bf0065138c4563f7691c9f2efce7d4671a285b4c442"}
Jul 02 19:06:31.577785 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:31.577358    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:31.596206 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:31.596161    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-drll2" podStartSLOduration=251.554321198 podStartE2EDuration="4m13.596145954s" totalImagesPullingTime="2.041824756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:31.59544721 +0000 UTC m=+294.568108365" watchObservedRunningTime="2026-07-02 19:06:31.596145954 +0000 UTC m=+294.568807108"
Jul 02 19:06:37.488956 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:37.488925    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:06:37.490022 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:37.489991    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:06:37.496217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:37.496199    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:06:39.723716 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:06:39.723675    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n57s7" podUID="f7f5e59d-f851-4be3-8673-57c39de70955"
Jul 02 19:06:41.584225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:41.584190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-drll2"
Jul 02 19:06:43.089729 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:43.089695    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:06:52.723019 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:06:52.722972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:07:08.109479 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.109408    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-595b7b847f-xls2h" podUID="d0cb6b52-3ccc-4431-b090-2268171b400d" containerName="console" containerID="cri-o://296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948" gracePeriod=15
Jul 02 19:07:08.363031 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.362980    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:07:08.430781 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.430759    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.430898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.430798    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn2dh\" (UniqueName: \"kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.430898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.430830    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.431005 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.430919    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.431005 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.430943    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.431106 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.431025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert\") pod \"d0cb6b52-3ccc-4431-b090-2268171b400d\" (UID: \"d0cb6b52-3ccc-4431-b090-2268171b400d\") "
Jul 02 19:07:08.431320 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.431294    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config" (OuterVolumeSpecName: "console-config") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:08.431320 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.431303    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:08.431458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.431321    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:08.432963 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.432939    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh" (OuterVolumeSpecName: "kube-api-access-cn2dh") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "kube-api-access-cn2dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:08.433046 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.433021    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:08.433096 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.433079    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0cb6b52-3ccc-4431-b090-2268171b400d" (UID: "d0cb6b52-3ccc-4431-b090-2268171b400d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:08.531686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531655    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.531686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531685    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn2dh\" (UniqueName: \"kubernetes.io/projected/d0cb6b52-3ccc-4431-b090-2268171b400d-kube-api-access-cn2dh\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.531686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531695    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.531831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531705    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cb6b52-3ccc-4431-b090-2268171b400d-console-oauth-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.531831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531713    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-console-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.531831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.531722    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cb6b52-3ccc-4431-b090-2268171b400d-oauth-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:07:08.707294 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.707237    2569 generic.go:356] "Generic (PLEG): container finished" podID="d0cb6b52-3ccc-4431-b090-2268171b400d" containerID="296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948" exitCode=0
Jul 02 19:07:08.707294 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.707281    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b7b847f-xls2h"
Jul 02 19:07:08.707430 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.707324    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b7b847f-xls2h" event={"ID":"d0cb6b52-3ccc-4431-b090-2268171b400d","Type":"ContainerDied","Data":"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"}
Jul 02 19:07:08.707430 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.707373    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b7b847f-xls2h" event={"ID":"d0cb6b52-3ccc-4431-b090-2268171b400d","Type":"ContainerDied","Data":"145e3ca84ac101b9215c0324719eed299db851543d7ac108defa34b74df8035a"}
Jul 02 19:07:08.707430 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.707415    2569 scope.go:117] "RemoveContainer" containerID="296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"
Jul 02 19:07:08.709014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.708980    2569 generic.go:356] "Generic (PLEG): container finished" podID="57c9968b-b595-4179-ae45-07831798b858" containerID="d288861e360121a80940a7fa761fbcfb4cf18d25c894b2ad09f06d3545994058" exitCode=0
Jul 02 19:07:08.709133 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.709013    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g" event={"ID":"57c9968b-b595-4179-ae45-07831798b858","Type":"ContainerDied","Data":"d288861e360121a80940a7fa761fbcfb4cf18d25c894b2ad09f06d3545994058"}
Jul 02 19:07:08.709300 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.709284    2569 scope.go:117] "RemoveContainer" containerID="d288861e360121a80940a7fa761fbcfb4cf18d25c894b2ad09f06d3545994058"
Jul 02 19:07:08.718803 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.718787    2569 scope.go:117] "RemoveContainer" containerID="296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"
Jul 02 19:07:08.719097 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:07:08.719072    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948\": container with ID starting with 296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948 not found: ID does not exist" containerID="296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"
Jul 02 19:07:08.719203 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.719102    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948"} err="failed to get container status \"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948\": rpc error: code = NotFound desc = could not find container \"296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948\": container with ID starting with 296ec20eb9e2982f85703b7880506c0c04e3488d02fa78f281ca038fa05f1948 not found: ID does not exist"
Jul 02 19:07:08.738748 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.738717    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:07:08.744398 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:08.744377    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595b7b847f-xls2h"]
Jul 02 19:07:09.715038 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:09.715003    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gj28g" event={"ID":"57c9968b-b595-4179-ae45-07831798b858","Type":"ContainerStarted","Data":"bce8bc42536383b59daf5b1ffdfd6a2dfa41a171ee069eb8977b3d7d2bf74106"}
Jul 02 19:07:09.727353 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:09.727329    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0cb6b52-3ccc-4431-b090-2268171b400d" path="/var/lib/kubelet/pods/d0cb6b52-3ccc-4431-b090-2268171b400d/volumes"
Jul 02 19:07:40.129353 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.129313    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:07:40.129791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.129581    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cb6b52-3ccc-4431-b090-2268171b400d" containerName="console"
Jul 02 19:07:40.129791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.129592    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cb6b52-3ccc-4431-b090-2268171b400d" containerName="console"
Jul 02 19:07:40.129791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.129638    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0cb6b52-3ccc-4431-b090-2268171b400d" containerName="console"
Jul 02 19:07:40.132090 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.132071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.136653 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.136632    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:07:40.136756 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.136653    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47vkx\""
Jul 02 19:07:40.137027 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.137003    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:07:40.137153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.137013    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:07:40.137153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.137013    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:07:40.137366 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.137349    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:07:40.141210 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.141193    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:07:40.144080 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.144067    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:07:40.145771 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.145754    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 19:07:40.162912 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.162888    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:07:40.258432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2rw\" (UniqueName: \"kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258467    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.258627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.258590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.359762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2rw\" (UniqueName: \"kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.359863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.359863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.359863 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360020 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360020 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360020 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.359962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.360660    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360771 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.360698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360873 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.360776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.360917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.360888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.362220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.362201    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.362315 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.362304    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.367370 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.367338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2rw\" (UniqueName: \"kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw\") pod \"console-68cd4f7cf9-dw85s\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") " pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.441516 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.441435    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:40.570633 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.570607    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:07:40.573014 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:07:40.572985    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091dbac0_34a9_4736_bbc3_9ed07c59d6ba.slice/crio-81e636eed468866362d5aae1dbab95c4bccd4ec615535b6656f7032d617337fe WatchSource:0}: Error finding container 81e636eed468866362d5aae1dbab95c4bccd4ec615535b6656f7032d617337fe: Status 404 returned error can't find the container with id 81e636eed468866362d5aae1dbab95c4bccd4ec615535b6656f7032d617337fe
Jul 02 19:07:40.821259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.821222    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd4f7cf9-dw85s" event={"ID":"091dbac0-34a9-4736-bbc3-9ed07c59d6ba","Type":"ContainerStarted","Data":"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"}
Jul 02 19:07:40.821414 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.821277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd4f7cf9-dw85s" event={"ID":"091dbac0-34a9-4736-bbc3-9ed07c59d6ba","Type":"ContainerStarted","Data":"81e636eed468866362d5aae1dbab95c4bccd4ec615535b6656f7032d617337fe"}
Jul 02 19:07:40.838733 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:40.838689    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68cd4f7cf9-dw85s" podStartSLOduration=0.838674485 podStartE2EDuration="838.674485ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:40.838276168 +0000 UTC m=+363.810937324" watchObservedRunningTime="2026-07-02 19:07:40.838674485 +0000 UTC m=+363.811335638"
Jul 02 19:07:50.442231 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:50.442194    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:50.442603 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:50.442259    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:50.446918 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:50.446892    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:50.859385 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:50.859334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:07:51.539628 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.539588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:07:51.541952 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.541931    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f5e59d-f851-4be3-8673-57c39de70955-metrics-certs\") pod \"network-metrics-daemon-n57s7\" (UID: \"f7f5e59d-f851-4be3-8673-57c39de70955\") " pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:07:51.825774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.825679    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\""
Jul 02 19:07:51.833473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.833452    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n57s7"
Jul 02 19:07:51.955229 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.955192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n57s7"]
Jul 02 19:07:51.958117 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:07:51.958091    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f5e59d_f851_4be3_8673_57c39de70955.slice/crio-203bee0e1dfd83e8c806b20d7e86533fd7978f4ffa70b25bdc9398cfeae89295 WatchSource:0}: Error finding container 203bee0e1dfd83e8c806b20d7e86533fd7978f4ffa70b25bdc9398cfeae89295: Status 404 returned error can't find the container with id 203bee0e1dfd83e8c806b20d7e86533fd7978f4ffa70b25bdc9398cfeae89295
Jul 02 19:07:51.959978 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:51.959962    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:07:52.866553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:52.866515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n57s7" event={"ID":"f7f5e59d-f851-4be3-8673-57c39de70955","Type":"ContainerStarted","Data":"203bee0e1dfd83e8c806b20d7e86533fd7978f4ffa70b25bdc9398cfeae89295"}
Jul 02 19:07:53.872286 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:53.872243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n57s7" event={"ID":"f7f5e59d-f851-4be3-8673-57c39de70955","Type":"ContainerStarted","Data":"e6d92ee3ede25b7758180dd313c8f7a08f8eb1e3c75c4ec54b66c4980215c3e8"}
Jul 02 19:07:53.872677 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:53.872311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n57s7" event={"ID":"f7f5e59d-f851-4be3-8673-57c39de70955","Type":"ContainerStarted","Data":"51b2f5f0b80d3d89d1de797c42a9233bde47234f9c285eb74f45edbd803ebd64"}
Jul 02 19:07:53.889280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:07:53.889227    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n57s7" podStartSLOduration=375.980157368 podStartE2EDuration="6m16.88921256s" totalImagesPullingTime="909.055192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:53.887949242 +0000 UTC m=+376.860610396" watchObservedRunningTime="2026-07-02 19:07:53.88921256 +0000 UTC m=+376.861873714"
Jul 02 19:08:41.289685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.289655    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"]
Jul 02 19:08:41.292739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.292722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.297076 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.297003    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 19:08:41.297076 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.297003    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 19:08:41.297801 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.297562    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:08:41.297801 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.297596    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:08:41.297994 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.297979    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 19:08:41.299485 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.298177    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 19:08:41.299485 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.298300    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:08:41.304530 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.304508    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"]
Jul 02 19:08:41.371584 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.371683 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.371683 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvp4m\" (UniqueName: \"kubernetes.io/projected/aed4ff7c-d840-4553-9e3a-d53994a29aea-kube-api-access-pvp4m\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.371683 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371642    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aed4ff7c-d840-4553-9e3a-d53994a29aea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.371683 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.371828 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.371685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.472885 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.472967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472898    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.472967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp4m\" (UniqueName: \"kubernetes.io/projected/aed4ff7c-d840-4553-9e3a-d53994a29aea-kube-api-access-pvp4m\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.472967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aed4ff7c-d840-4553-9e3a-d53994a29aea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.473088 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.473088 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.472999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.473720 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.473694    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aed4ff7c-d840-4553-9e3a-d53994a29aea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.475335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.475317    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.475414 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.475370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-ca\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.475453 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.475430    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.475682 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.475661    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aed4ff7c-d840-4553-9e3a-d53994a29aea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.481247 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.481224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvp4m\" (UniqueName: \"kubernetes.io/projected/aed4ff7c-d840-4553-9e3a-d53994a29aea-kube-api-access-pvp4m\") pod \"cluster-proxy-proxy-agent-758cfcbf94-9zq7x\" (UID: \"aed4ff7c-d840-4553-9e3a-d53994a29aea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.614219 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.614169    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"
Jul 02 19:08:41.739235 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:41.739208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x"]
Jul 02 19:08:41.742439 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:08:41.742414    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaed4ff7c_d840_4553_9e3a_d53994a29aea.slice/crio-1ba3f135bbf4621ff5c78a549c130d86133170f49142321fb1697ff640287d5f WatchSource:0}: Error finding container 1ba3f135bbf4621ff5c78a549c130d86133170f49142321fb1697ff640287d5f: Status 404 returned error can't find the container with id 1ba3f135bbf4621ff5c78a549c130d86133170f49142321fb1697ff640287d5f
Jul 02 19:08:42.038582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:42.038553    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x" event={"ID":"aed4ff7c-d840-4553-9e3a-d53994a29aea","Type":"ContainerStarted","Data":"1ba3f135bbf4621ff5c78a549c130d86133170f49142321fb1697ff640287d5f"}
Jul 02 19:08:46.056633 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:46.056593    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x" event={"ID":"aed4ff7c-d840-4553-9e3a-d53994a29aea","Type":"ContainerStarted","Data":"960993c629dd69f939e53eb104a678da62a31e2cfcc90f3be21be184e51e5105"}
Jul 02 19:08:46.057041 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:46.056643    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x" event={"ID":"aed4ff7c-d840-4553-9e3a-d53994a29aea","Type":"ContainerStarted","Data":"bfac1e74d356cecb6ef8de6d073421c83636bff3c1d81b244cffcdac510d371e"}
Jul 02 19:08:46.057041 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:46.056660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x" event={"ID":"aed4ff7c-d840-4553-9e3a-d53994a29aea","Type":"ContainerStarted","Data":"b30526ff0a1cda9cd482c020f7e2d3f5cb9ab410d5cf7cf947b495752a72fc9f"}
Jul 02 19:08:46.080051 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:08:46.079999    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758cfcbf94-9zq7x" podStartSLOduration=1.37268769 podStartE2EDuration="5.079981188s" totalImagesPullingTime="3.707293498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:46.079349025 +0000 UTC m=+429.052010181" watchObservedRunningTime="2026-07-02 19:08:46.079981188 +0000 UTC m=+429.052642363"
Jul 02 19:09:14.995204 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:14.995165    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"]
Jul 02 19:09:14.998788 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:14.998767    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.002214 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.002190    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 19:09:15.002451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.002434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:09:15.002545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.002457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qbg6l\""
Jul 02 19:09:15.012638 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.012605    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"]
Jul 02 19:09:15.107113 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.107080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae5390c-673b-47f8-880e-56e0814d4f3e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.107236 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.107192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvlc\" (UniqueName: \"kubernetes.io/projected/9ae5390c-673b-47f8-880e-56e0814d4f3e-kube-api-access-tsvlc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.208214 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.208165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvlc\" (UniqueName: \"kubernetes.io/projected/9ae5390c-673b-47f8-880e-56e0814d4f3e-kube-api-access-tsvlc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.208365 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.208232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae5390c-673b-47f8-880e-56e0814d4f3e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.208622 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.208604    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae5390c-673b-47f8-880e-56e0814d4f3e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.216817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.216791    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvlc\" (UniqueName: \"kubernetes.io/projected/9ae5390c-673b-47f8-880e-56e0814d4f3e-kube-api-access-tsvlc\") pod \"cert-manager-operator-controller-manager-55c444bf86-j6cpv\" (UID: \"9ae5390c-673b-47f8-880e-56e0814d4f3e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.308874 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.308806    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"
Jul 02 19:09:15.447403 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:15.447370    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv"]
Jul 02 19:09:15.450573 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:09:15.450546    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae5390c_673b_47f8_880e_56e0814d4f3e.slice/crio-5a82c3fd29df3becb4410bc6e4718e4b28eed9ebb3bcc8afa809f3f177d4900b WatchSource:0}: Error finding container 5a82c3fd29df3becb4410bc6e4718e4b28eed9ebb3bcc8afa809f3f177d4900b: Status 404 returned error can't find the container with id 5a82c3fd29df3becb4410bc6e4718e4b28eed9ebb3bcc8afa809f3f177d4900b
Jul 02 19:09:16.166968 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:16.166936    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv" event={"ID":"9ae5390c-673b-47f8-880e-56e0814d4f3e","Type":"ContainerStarted","Data":"5a82c3fd29df3becb4410bc6e4718e4b28eed9ebb3bcc8afa809f3f177d4900b"}
Jul 02 19:09:18.178192 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:18.178157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv" event={"ID":"9ae5390c-673b-47f8-880e-56e0814d4f3e","Type":"ContainerStarted","Data":"4430a355bbfa79e8e890bb1ca5fe8519c100d87d1f1ba2fd8ccb94b003d21385"}
Jul 02 19:09:18.207965 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:18.207917    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j6cpv" podStartSLOduration=1.573482241 podStartE2EDuration="4.207902667s" totalImagesPullingTime="2.634420426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:18.207141137 +0000 UTC m=+461.179802290" watchObservedRunningTime="2026-07-02 19:09:18.207902667 +0000 UTC m=+461.180563820"
Jul 02 19:09:49.555732 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.555694    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"]
Jul 02 19:09:49.559005 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.558982    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.561653 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.561635    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:09:49.562375 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.562360    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:09:49.562438 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.562410    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:09:49.562953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.562936    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:09:49.565754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.565734    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xghdc\""
Jul 02 19:09:49.599454 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.599436    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"]
Jul 02 19:09:49.742914 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.742894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.743013 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.742925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.743013 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.742947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwrv\" (UniqueName: \"kubernetes.io/projected/057c8efc-3fb4-4c80-b991-d34e34813b3d-kube-api-access-4lwrv\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.743013 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.742968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.743013 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.742996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844056 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844028    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844157 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844157 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844272 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844272 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwrv\" (UniqueName: \"kubernetes.io/projected/057c8efc-3fb4-4c80-b991-d34e34813b3d-kube-api-access-4lwrv\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.844529 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.844495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.846463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.846433    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057c8efc-3fb4-4c80-b991-d34e34813b3d-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.846612 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.846594    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.846674 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.846647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/057c8efc-3fb4-4c80-b991-d34e34813b3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.859617 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.859591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwrv\" (UniqueName: \"kubernetes.io/projected/057c8efc-3fb4-4c80-b991-d34e34813b3d-kube-api-access-4lwrv\") pod \"opendatahub-operator-controller-manager-d984f5d94-bcrkx\" (UID: \"057c8efc-3fb4-4c80-b991-d34e34813b3d\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:49.868310 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:49.868292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:50.009731 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:50.009705    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"]
Jul 02 19:09:50.012349 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:09:50.012323    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057c8efc_3fb4_4c80_b991_d34e34813b3d.slice/crio-bc9525447781b922c69c6e24c0f3e1ca6b648864eaba7bd0122418007f22f8a1 WatchSource:0}: Error finding container bc9525447781b922c69c6e24c0f3e1ca6b648864eaba7bd0122418007f22f8a1: Status 404 returned error can't find the container with id bc9525447781b922c69c6e24c0f3e1ca6b648864eaba7bd0122418007f22f8a1
Jul 02 19:09:50.306366 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:50.306333    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx" event={"ID":"057c8efc-3fb4-4c80-b991-d34e34813b3d","Type":"ContainerStarted","Data":"bc9525447781b922c69c6e24c0f3e1ca6b648864eaba7bd0122418007f22f8a1"}
Jul 02 19:09:54.327320 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:54.327276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx" event={"ID":"057c8efc-3fb4-4c80-b991-d34e34813b3d","Type":"ContainerStarted","Data":"7750bb66c3ed34009a2d7af4e2fca36fe785a0e191d88dfc4816b91494540e63"}
Jul 02 19:09:55.332918 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:55.332882    2569 generic.go:356] "Generic (PLEG): container finished" podID="057c8efc-3fb4-4c80-b991-d34e34813b3d" containerID="7750bb66c3ed34009a2d7af4e2fca36fe785a0e191d88dfc4816b91494540e63" exitCode=0
Jul 02 19:09:55.333377 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:55.332965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx" event={"ID":"057c8efc-3fb4-4c80-b991-d34e34813b3d","Type":"ContainerDied","Data":"7750bb66c3ed34009a2d7af4e2fca36fe785a0e191d88dfc4816b91494540e63"}
Jul 02 19:09:56.338490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:56.338451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx" event={"ID":"057c8efc-3fb4-4c80-b991-d34e34813b3d","Type":"ContainerStarted","Data":"036474c4e996e20be807d597c26678b6951cf1672f3c6b2063f73cd35d08a498"}
Jul 02 19:09:56.338982 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:56.338592    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:09:56.372498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:09:56.372448    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx" podStartSLOduration=2.491602658 podStartE2EDuration="7.37243168s" totalImagesPullingTime="3.803774475s" totalInitContainerRuntime="1.077054547s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:56.370972475 +0000 UTC m=+499.343633630" watchObservedRunningTime="2026-07-02 19:09:56.37243168 +0000 UTC m=+499.345092834"
Jul 02 19:10:07.345122 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:07.345091    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-bcrkx"
Jul 02 19:10:10.288198 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.288162    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-5n4f7"]
Jul 02 19:10:10.291405 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.291384    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.294803 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:10.294770    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 02 19:10:10.294931 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:10.294787    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-595b598896-5n4f7\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.294931 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:10.294770    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 02 19:10:10.294931 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:10.294795    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-hzckt\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hzckt\"" type="*v1.Secret"
Jul 02 19:10:10.340007 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.339980    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-5n4f7"]
Jul 02 19:10:10.381491 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.381464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tmp\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.381582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.381504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.381582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.381526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7ns\" (UniqueName: \"kubernetes.io/projected/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-kube-api-access-hx7ns\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.482628 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.482598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tmp\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.482828 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.482636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.482828 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.482653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7ns\" (UniqueName: \"kubernetes.io/projected/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-kube-api-access-hx7ns\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.484778 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.484756    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tmp\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:10.507012 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:10.506985    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7ns\" (UniqueName: \"kubernetes.io/projected/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-kube-api-access-hx7ns\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:11.125428 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:11.125403    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hzckt\""
Jul 02 19:10:11.483011 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:11.482929    2569 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Jul 02 19:10:11.483011 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:11.483002    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs podName:25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0 nodeName:}" failed. No retries permitted until 2026-07-02 19:10:11.982986715 +0000 UTC m=+514.955647848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs") pod "kube-auth-proxy-595b598896-5n4f7" (UID: "25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0") : failed to sync secret cache: timed out waiting for the condition
Jul 02 19:10:11.766115 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:11.766049    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:10:11.820076 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:11.820057    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:10:11.993075 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:11.993041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:11.995365 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:11.995341    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0-tls-certs\") pod \"kube-auth-proxy-595b598896-5n4f7\" (UID: \"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0\") " pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:12.100042 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.100011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7"
Jul 02 19:10:12.145640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.145612    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l4cm6"]
Jul 02 19:10:12.149465 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.149439    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.155893 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.155793    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9zlmp\""
Jul 02 19:10:12.170825 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.170805    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 19:10:12.177921 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.177894    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l4cm6"]
Jul 02 19:10:12.194808 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.194787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqst2\" (UniqueName: \"kubernetes.io/projected/e9489e82-4aaa-44da-b490-9d344842e6e3-kube-api-access-rqst2\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.194953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.194824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9489e82-4aaa-44da-b490-9d344842e6e3-tls-certs\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.273383 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:10:12.273352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ef06bb_1319_4e7d_8c8f_d1a2567ce1c0.slice/crio-4d44d7a3ab07c7ec337a9269b867fc851a6dc28929b3d4f3931d837be5d18910 WatchSource:0}: Error finding container 4d44d7a3ab07c7ec337a9269b867fc851a6dc28929b3d4f3931d837be5d18910: Status 404 returned error can't find the container with id 4d44d7a3ab07c7ec337a9269b867fc851a6dc28929b3d4f3931d837be5d18910
Jul 02 19:10:12.274121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.274090    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-5n4f7"]
Jul 02 19:10:12.295819 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.295795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqst2\" (UniqueName: \"kubernetes.io/projected/e9489e82-4aaa-44da-b490-9d344842e6e3-kube-api-access-rqst2\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.295917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.295831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9489e82-4aaa-44da-b490-9d344842e6e3-tls-certs\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.298033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.298003    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9489e82-4aaa-44da-b490-9d344842e6e3-tls-certs\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.323501 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.323474    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqst2\" (UniqueName: \"kubernetes.io/projected/e9489e82-4aaa-44da-b490-9d344842e6e3-kube-api-access-rqst2\") pod \"model-serving-api-54d89bd5fc-l4cm6\" (UID: \"e9489e82-4aaa-44da-b490-9d344842e6e3\") " pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.403338 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.403285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7" event={"ID":"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0","Type":"ContainerStarted","Data":"4d44d7a3ab07c7ec337a9269b867fc851a6dc28929b3d4f3931d837be5d18910"}
Jul 02 19:10:12.462450 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.462426    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:12.614889 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.614864    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l4cm6"]
Jul 02 19:10:12.617154 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:10:12.617122    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9489e82_4aaa_44da_b490_9d344842e6e3.slice/crio-ecc75e7273b0e2f48b67e437e1a0d0cf1f076817b9fa39af22ba61cb45fa9807 WatchSource:0}: Error finding container ecc75e7273b0e2f48b67e437e1a0d0cf1f076817b9fa39af22ba61cb45fa9807: Status 404 returned error can't find the container with id ecc75e7273b0e2f48b67e437e1a0d0cf1f076817b9fa39af22ba61cb45fa9807
Jul 02 19:10:12.890129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.890104    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:12.894050 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.894032    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:12.896973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.896949    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n6hsn\""
Jul 02 19:10:12.897080 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.897001    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 19:10:12.897080 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.897003    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:10:12.897766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.897753    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 19:10:12.897986 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.897971    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 19:10:12.938582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:12.938559    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:13.001534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmk9\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001829 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001829 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001724    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.001829 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.001749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmk9\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102421 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102381    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102870 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102870 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.102870 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.102556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.103399 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.103372    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.105004 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.104977    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.105142 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.105119    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.105244 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.105204    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.105493 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.105471    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.113518 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.113495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmk9\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.115889 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.115866    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token\") pod \"istiod-openshift-gateway-7574459656-cs4sx\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.203142 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.203083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:13.410524 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:10:13.410493    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38642883_7762_4054_9e55_cd3f98fa4629.slice/crio-b6276798d02af7146f5ccfeb770545be15b19bbb0228ac41f5755dea07dc5a0e WatchSource:0}: Error finding container b6276798d02af7146f5ccfeb770545be15b19bbb0228ac41f5755dea07dc5a0e: Status 404 returned error can't find the container with id b6276798d02af7146f5ccfeb770545be15b19bbb0228ac41f5755dea07dc5a0e
Jul 02 19:10:13.410858 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.410694    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:13.411248 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:13.411190    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6" event={"ID":"e9489e82-4aaa-44da-b490-9d344842e6e3","Type":"ContainerStarted","Data":"ecc75e7273b0e2f48b67e437e1a0d0cf1f076817b9fa39af22ba61cb45fa9807"}
Jul 02 19:10:14.419242 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:14.419179    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" event={"ID":"38642883-7762-4054-9e55-cd3f98fa4629","Type":"ContainerStarted","Data":"b6276798d02af7146f5ccfeb770545be15b19bbb0228ac41f5755dea07dc5a0e"}
Jul 02 19:10:15.425503 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:15.425457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6" event={"ID":"e9489e82-4aaa-44da-b490-9d344842e6e3","Type":"ContainerStarted","Data":"9e76f924819f75ab90b777e7590a15ac98f6375a6bbdb2e782edd3ec59682f8d"}
Jul 02 19:10:15.425957 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:15.425626    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:15.456654 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:15.456600    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6" podStartSLOduration=1.337592151 podStartE2EDuration="3.456582621s" totalImagesPullingTime="2.11899047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:15.455950976 +0000 UTC m=+518.428612329" watchObservedRunningTime="2026-07-02 19:10:15.456582621 +0000 UTC m=+518.429243775"
Jul 02 19:10:15.665172 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:15.665115    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:10:15.665292 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:15.665213    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:10:16.434050 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:16.434004    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" event={"ID":"38642883-7762-4054-9e55-cd3f98fa4629","Type":"ContainerStarted","Data":"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"}
Jul 02 19:10:16.434490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:16.434082    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:16.435810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:16.435783    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cs4sx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:10:16.435953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:16.435838    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" podUID="38642883-7762-4054-9e55-cd3f98fa4629" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:10:16.478970 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:16.478923    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" podStartSLOduration=2.227189572 podStartE2EDuration="4.478910503s" totalImagesPullingTime="2.251720931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:16.4736738 +0000 UTC m=+519.446334955" watchObservedRunningTime="2026-07-02 19:10:16.478910503 +0000 UTC m=+519.451571656"
Jul 02 19:10:17.440091 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:17.440057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7" event={"ID":"25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0","Type":"ContainerStarted","Data":"15a8f4623f156ab990f407b48dffd1e652815abfcdc8b7f6b1838bfe657ac785"}
Jul 02 19:10:17.440802 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:17.440782    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:17.501813 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:17.501773    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-595b598896-5n4f7" podStartSLOduration=2.8749069240000003 podStartE2EDuration="7.501758983s" totalImagesPullingTime="4.626852059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:17.500524147 +0000 UTC m=+520.473185301" watchObservedRunningTime="2026-07-02 19:10:17.501758983 +0000 UTC m=+520.474420137"
Jul 02 19:10:23.757953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.757918    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"]
Jul 02 19:10:23.766377 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.766352    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:23.773781 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.773742    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 19:10:23.774034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.774018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kb8b6\""
Jul 02 19:10:23.787034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.787005    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"]
Jul 02 19:10:23.792954 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.792932    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"]
Jul 02 19:10:23.797040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.797020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:23.801722 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.801694    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 19:10:23.801930 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.801740    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vfxcr\""
Jul 02 19:10:23.808917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.808897    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"]
Jul 02 19:10:23.885920 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.885894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x95c\" (UniqueName: \"kubernetes.io/projected/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-kube-api-access-9x95c\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:23.886016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.885933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:23.886016 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.885950    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0913da59-b9f3-46a8-bd04-b161f631390e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:23.886092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.886033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfkw\" (UniqueName: \"kubernetes.io/projected/0913da59-b9f3-46a8-bd04-b161f631390e-kube-api-access-gnfkw\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:23.986943 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.986923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:23.987039 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.986950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0913da59-b9f3-46a8-bd04-b161f631390e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:23.987039 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.986974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfkw\" (UniqueName: \"kubernetes.io/projected/0913da59-b9f3-46a8-bd04-b161f631390e-kube-api-access-gnfkw\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:23.987039 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.987018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x95c\" (UniqueName: \"kubernetes.io/projected/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-kube-api-access-9x95c\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:23.987146 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:23.987078    2569 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 02 19:10:23.987146 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:23.987142    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert podName:7d7da5c5-de5a-4017-bfab-aee8f8b425d7 nodeName:}" failed. No retries permitted until 2026-07-02 19:10:24.487123917 +0000 UTC m=+527.459785050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert") pod "kserve-controller-manager-d6f4b65b8-ffslw" (UID: "7d7da5c5-de5a-4017-bfab-aee8f8b425d7") : secret "kserve-webhook-server-cert" not found
Jul 02 19:10:23.989318 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:23.989293    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0913da59-b9f3-46a8-bd04-b161f631390e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:24.005914 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.005896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfkw\" (UniqueName: \"kubernetes.io/projected/0913da59-b9f3-46a8-bd04-b161f631390e-kube-api-access-gnfkw\") pod \"llmisvc-controller-manager-777c6bd7d5-n29pk\" (UID: \"0913da59-b9f3-46a8-bd04-b161f631390e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:24.008987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.008943    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x95c\" (UniqueName: \"kubernetes.io/projected/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-kube-api-access-9x95c\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:24.106917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.106887    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:24.317853 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:10:24.317814    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0913da59_b9f3_46a8_bd04_b161f631390e.slice/crio-0f1ae01a620b68dad4107f04f60aa555c09bef07e7284cf37f9af360e1974e49 WatchSource:0}: Error finding container 0f1ae01a620b68dad4107f04f60aa555c09bef07e7284cf37f9af360e1974e49: Status 404 returned error can't find the container with id 0f1ae01a620b68dad4107f04f60aa555c09bef07e7284cf37f9af360e1974e49
Jul 02 19:10:24.329568 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.329547    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"]
Jul 02 19:10:24.470144 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.470111    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk" event={"ID":"0913da59-b9f3-46a8-bd04-b161f631390e","Type":"ContainerStarted","Data":"0f1ae01a620b68dad4107f04f60aa555c09bef07e7284cf37f9af360e1974e49"}
Jul 02 19:10:24.491419 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.491398    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:24.493670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.493653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7da5c5-de5a-4017-bfab-aee8f8b425d7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ffslw\" (UID: \"7d7da5c5-de5a-4017-bfab-aee8f8b425d7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:24.676683 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.676621    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:24.822628 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:10:24.822601    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7da5c5_de5a_4017_bfab_aee8f8b425d7.slice/crio-926c9ff4246a5af6feeadb99e5a02c52b2687553f53d94d4cf6adf287c7c1988 WatchSource:0}: Error finding container 926c9ff4246a5af6feeadb99e5a02c52b2687553f53d94d4cf6adf287c7c1988: Status 404 returned error can't find the container with id 926c9ff4246a5af6feeadb99e5a02c52b2687553f53d94d4cf6adf287c7c1988
Jul 02 19:10:24.823396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:24.823375    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"]
Jul 02 19:10:25.475438 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:25.475405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw" event={"ID":"7d7da5c5-de5a-4017-bfab-aee8f8b425d7","Type":"ContainerStarted","Data":"926c9ff4246a5af6feeadb99e5a02c52b2687553f53d94d4cf6adf287c7c1988"}
Jul 02 19:10:25.998832 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:25.998804    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:25.999221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:25.999024    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" podUID="38642883-7762-4054-9e55-cd3f98fa4629" containerName="discovery" containerID="cri-o://65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431" gracePeriod=30
Jul 02 19:10:26.256887 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.256814    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:26.306519 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306492    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306545    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306584    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttmk9\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306825 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306825 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306692    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306825 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306756    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token\") pod \"38642883-7762-4054-9e55-cd3f98fa4629\" (UID: \"38642883-7762-4054-9e55-cd3f98fa4629\") "
Jul 02 19:10:26.306991 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.306918    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:10:26.307070 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.307052    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-ca-configmap\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.309064 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309013    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs" (OuterVolumeSpecName: "local-certs") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:10:26.309064 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309012    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9" (OuterVolumeSpecName: "kube-api-access-ttmk9") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "kube-api-access-ttmk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:10:26.309230 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309197    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:10:26.309292 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309258    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts" (OuterVolumeSpecName: "cacerts") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:10:26.309416 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309395    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token" (OuterVolumeSpecName: "istio-token") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:10:26.309498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.309463    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "38642883-7762-4054-9e55-cd3f98fa4629" (UID: "38642883-7762-4054-9e55-cd3f98fa4629"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:10:26.408121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408095    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttmk9\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-kube-api-access-ttmk9\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.408121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408118    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-cacerts\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.408121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408127    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-kubeconfig\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.408313 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408137    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38642883-7762-4054-9e55-cd3f98fa4629-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.408313 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408150    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38642883-7762-4054-9e55-cd3f98fa4629-istio-csr-dns-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.408313 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.408161    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38642883-7762-4054-9e55-cd3f98fa4629-local-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:10:26.440727 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.440691    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l4cm6"
Jul 02 19:10:26.486968 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.486936    2569 generic.go:356] "Generic (PLEG): container finished" podID="38642883-7762-4054-9e55-cd3f98fa4629" containerID="65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431" exitCode=0
Jul 02 19:10:26.487202 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.487039    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"
Jul 02 19:10:26.487202 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.487093    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" event={"ID":"38642883-7762-4054-9e55-cd3f98fa4629","Type":"ContainerDied","Data":"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"}
Jul 02 19:10:26.487202 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.487175    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx" event={"ID":"38642883-7762-4054-9e55-cd3f98fa4629","Type":"ContainerDied","Data":"b6276798d02af7146f5ccfeb770545be15b19bbb0228ac41f5755dea07dc5a0e"}
Jul 02 19:10:26.487361 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.487203    2569 scope.go:117] "RemoveContainer" containerID="65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"
Jul 02 19:10:26.499376 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.499340    2569 scope.go:117] "RemoveContainer" containerID="65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"
Jul 02 19:10:26.499671 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:10:26.499651    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431\": container with ID starting with 65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431 not found: ID does not exist" containerID="65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"
Jul 02 19:10:26.499772 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.499704    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431"} err="failed to get container status \"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431\": rpc error: code = NotFound desc = could not find container \"65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431\": container with ID starting with 65f868038d3556ff9f0c3c56a85b5a16b8b6adfdacb57e8ba13ee10d8721c431 not found: ID does not exist"
Jul 02 19:10:26.532985 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.532962    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:26.563363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:26.563341    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cs4sx"]
Jul 02 19:10:27.729467 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:27.729434    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38642883-7762-4054-9e55-cd3f98fa4629" path="/var/lib/kubelet/pods/38642883-7762-4054-9e55-cd3f98fa4629/volumes"
Jul 02 19:10:28.498422 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:28.498394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw" event={"ID":"7d7da5c5-de5a-4017-bfab-aee8f8b425d7","Type":"ContainerStarted","Data":"889e6fc93649a26387b678d0154b1ef5afa9d1f4e64ba380413f656c2846fbfe"}
Jul 02 19:10:28.498545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:28.498535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:28.529622 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:28.529577    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw" podStartSLOduration=1.9638253589999999 podStartE2EDuration="5.529561936s" totalImagesPullingTime="3.565736577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:28.527491157 +0000 UTC m=+531.500152311" watchObservedRunningTime="2026-07-02 19:10:28.529561936 +0000 UTC m=+531.502223089"
Jul 02 19:10:29.504582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:29.504542    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk" event={"ID":"0913da59-b9f3-46a8-bd04-b161f631390e","Type":"ContainerStarted","Data":"0455499965d26bbe2aa9a8d6ce47b4a67866b4aa3a243b0c7de61b862735eccd"}
Jul 02 19:10:29.505108 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:29.504708    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:10:59.510093 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:59.510057    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ffslw"
Jul 02 19:10:59.533610 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:10:59.533559    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk" podStartSLOduration=32.460572472 podStartE2EDuration="36.533543989s" totalImagesPullingTime="4.072971517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:29.527397869 +0000 UTC m=+532.500059034" watchObservedRunningTime="2026-07-02 19:10:59.533543989 +0000 UTC m=+562.506205146"
Jul 02 19:11:00.511615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:00.511586    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n29pk"
Jul 02 19:11:11.445935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.445897    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:11.446299 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.446240    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38642883-7762-4054-9e55-cd3f98fa4629" containerName="discovery"
Jul 02 19:11:11.446299 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.446255    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38642883-7762-4054-9e55-cd3f98fa4629" containerName="discovery"
Jul 02 19:11:11.446375 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.446303    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="38642883-7762-4054-9e55-cd3f98fa4629" containerName="discovery"
Jul 02 19:11:11.449411 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.449387    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:11.453174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.453143    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:11:11.453336 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.453313    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:11:11.453990 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.453960    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5zdfz\""
Jul 02 19:11:11.465644 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.465624    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:11.546376 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.546348    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxfjx\" (UniqueName: \"kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx\") pod \"kuadrant-operator-catalog-cr6xn\" (UID: \"49d85ac0-15a5-4b3c-9300-a0045a2c0eef\") " pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:11.646652 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.646627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxfjx\" (UniqueName: \"kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx\") pod \"kuadrant-operator-catalog-cr6xn\" (UID: \"49d85ac0-15a5-4b3c-9300-a0045a2c0eef\") " pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:11.654643 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.654625    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxfjx\" (UniqueName: \"kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx\") pod \"kuadrant-operator-catalog-cr6xn\" (UID: \"49d85ac0-15a5-4b3c-9300-a0045a2c0eef\") " pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:11.705402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.705349    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:11.705566 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.705552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:11.840403 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.840380    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:11.842486 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:11.842451    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d85ac0_15a5_4b3c_9300_a0045a2c0eef.slice/crio-2a68a20afb413f766d7baa0738c1a2f38a0319f919408c6ef8e2b7220da44a55 WatchSource:0}: Error finding container 2a68a20afb413f766d7baa0738c1a2f38a0319f919408c6ef8e2b7220da44a55: Status 404 returned error can't find the container with id 2a68a20afb413f766d7baa0738c1a2f38a0319f919408c6ef8e2b7220da44a55
Jul 02 19:11:11.934892 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.934867    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cnfm"]
Jul 02 19:11:11.937670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.937649    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:11.958780 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:11.958730    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cnfm"]
Jul 02 19:11:12.048824 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.048801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs8kt\" (UniqueName: \"kubernetes.io/projected/039ee53a-b293-4987-9cbf-728f00d681b1-kube-api-access-rs8kt\") pod \"kuadrant-operator-catalog-9cnfm\" (UID: \"039ee53a-b293-4987-9cbf-728f00d681b1\") " pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:12.149983 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.149956    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs8kt\" (UniqueName: \"kubernetes.io/projected/039ee53a-b293-4987-9cbf-728f00d681b1-kube-api-access-rs8kt\") pod \"kuadrant-operator-catalog-9cnfm\" (UID: \"039ee53a-b293-4987-9cbf-728f00d681b1\") " pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:12.162774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.162749    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs8kt\" (UniqueName: \"kubernetes.io/projected/039ee53a-b293-4987-9cbf-728f00d681b1-kube-api-access-rs8kt\") pod \"kuadrant-operator-catalog-9cnfm\" (UID: \"039ee53a-b293-4987-9cbf-728f00d681b1\") " pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:12.247010 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.246961    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:12.389911 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.389881    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9cnfm"]
Jul 02 19:11:12.391601 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:12.391571    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039ee53a_b293_4987_9cbf_728f00d681b1.slice/crio-10b30465871cbc00c20f76f4322aed06552270d0fe0a70c010e410407c8b5137 WatchSource:0}: Error finding container 10b30465871cbc00c20f76f4322aed06552270d0fe0a70c010e410407c8b5137: Status 404 returned error can't find the container with id 10b30465871cbc00c20f76f4322aed06552270d0fe0a70c010e410407c8b5137
Jul 02 19:11:12.697106 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.697075    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm" event={"ID":"039ee53a-b293-4987-9cbf-728f00d681b1","Type":"ContainerStarted","Data":"10b30465871cbc00c20f76f4322aed06552270d0fe0a70c010e410407c8b5137"}
Jul 02 19:11:12.698451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:12.698424    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" event={"ID":"49d85ac0-15a5-4b3c-9300-a0045a2c0eef","Type":"ContainerStarted","Data":"2a68a20afb413f766d7baa0738c1a2f38a0319f919408c6ef8e2b7220da44a55"}
Jul 02 19:11:14.706991 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.706949    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm" event={"ID":"039ee53a-b293-4987-9cbf-728f00d681b1","Type":"ContainerStarted","Data":"67d263a4134c413ad5da75bb6c6377a6290f4c6eb1a0cb21aef4ddf998c9d1c9"}
Jul 02 19:11:14.708507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.708482    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" event={"ID":"49d85ac0-15a5-4b3c-9300-a0045a2c0eef","Type":"ContainerStarted","Data":"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"}
Jul 02 19:11:14.708622 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.708596    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" podUID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" containerName="registry-server" containerID="cri-o://07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d" gracePeriod=2
Jul 02 19:11:14.727349 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.727308    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm" podStartSLOduration=2.456123158 podStartE2EDuration="3.727295436s" totalImagesPullingTime="1.271172278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:14.72627285 +0000 UTC m=+577.698934004" watchObservedRunningTime="2026-07-02 19:11:14.727295436 +0000 UTC m=+577.699956589"
Jul 02 19:11:14.747535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.747496    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" podStartSLOduration=1.927807968 podStartE2EDuration="3.747484139s" totalImagesPullingTime="1.819676171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:14.747314999 +0000 UTC m=+577.719976155" watchObservedRunningTime="2026-07-02 19:11:14.747484139 +0000 UTC m=+577.720145293"
Jul 02 19:11:14.945391 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.945371    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:14.971466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.971400    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxfjx\" (UniqueName: \"kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx\") pod \"49d85ac0-15a5-4b3c-9300-a0045a2c0eef\" (UID: \"49d85ac0-15a5-4b3c-9300-a0045a2c0eef\") "
Jul 02 19:11:14.973424 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:14.973394    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx" (OuterVolumeSpecName: "kube-api-access-mxfjx") pod "49d85ac0-15a5-4b3c-9300-a0045a2c0eef" (UID: "49d85ac0-15a5-4b3c-9300-a0045a2c0eef"). InnerVolumeSpecName "kube-api-access-mxfjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:11:15.072922 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.072897    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxfjx\" (UniqueName: \"kubernetes.io/projected/49d85ac0-15a5-4b3c-9300-a0045a2c0eef-kube-api-access-mxfjx\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:11:15.713967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.713929    2569 generic.go:356] "Generic (PLEG): container finished" podID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" containerID="07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d" exitCode=0
Jul 02 19:11:15.713967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.713969    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn"
Jul 02 19:11:15.714402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.714021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" event={"ID":"49d85ac0-15a5-4b3c-9300-a0045a2c0eef","Type":"ContainerDied","Data":"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"}
Jul 02 19:11:15.714402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.714066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr6xn" event={"ID":"49d85ac0-15a5-4b3c-9300-a0045a2c0eef","Type":"ContainerDied","Data":"2a68a20afb413f766d7baa0738c1a2f38a0319f919408c6ef8e2b7220da44a55"}
Jul 02 19:11:15.714402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.714090    2569 scope.go:117] "RemoveContainer" containerID="07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"
Jul 02 19:11:15.722768 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.722751    2569 scope.go:117] "RemoveContainer" containerID="07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"
Jul 02 19:11:15.723047 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:11:15.723017    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d\": container with ID starting with 07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d not found: ID does not exist" containerID="07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"
Jul 02 19:11:15.723103 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.723055    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d"} err="failed to get container status \"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d\": rpc error: code = NotFound desc = could not find container \"07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d\": container with ID starting with 07aba6f211721d5632e5577494b1cf6ccfae8b85458c51d961ff5c952310f15d not found: ID does not exist"
Jul 02 19:11:15.734948 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.734923    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:15.738531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:15.738511    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr6xn"]
Jul 02 19:11:17.727245 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:17.727212    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" path="/var/lib/kubelet/pods/49d85ac0-15a5-4b3c-9300-a0045a2c0eef/volumes"
Jul 02 19:11:22.247970 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:22.247927    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:22.248381 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:22.247997    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:22.270565 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:22.270541    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:22.769989 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:22.769957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9cnfm"
Jul 02 19:11:37.514864 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:37.514819    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:11:37.515434 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:37.515135    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:11:39.773027 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.772903    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66979b5dbd-m7h6s"]
Jul 02 19:11:39.778109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.773209    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" containerName="registry-server"
Jul 02 19:11:39.778109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.773222    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" containerName="registry-server"
Jul 02 19:11:39.778109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.773275    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d85ac0-15a5-4b3c-9300-a0045a2c0eef" containerName="registry-server"
Jul 02 19:11:39.778109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.777370    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.790313 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.790290    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66979b5dbd-m7h6s"]
Jul 02 19:11:39.843371 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843352    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-service-ca\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-trusted-ca-bundle\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-oauth-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xxkr\" (UniqueName: \"kubernetes.io/projected/0247f7af-d1ac-4aaa-bf73-bd839ea74612-kube-api-access-2xxkr\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.843678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.843545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-oauth-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944038 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-trusted-ca-bundle\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944077    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-oauth-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxkr\" (UniqueName: \"kubernetes.io/projected/0247f7af-d1ac-4aaa-bf73-bd839ea74612-kube-api-access-2xxkr\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-oauth-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-service-ca\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.944956 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944928    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.945082 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.944966    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-oauth-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.945082 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.945003    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-service-ca\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.945082 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.945073    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0247f7af-d1ac-4aaa-bf73-bd839ea74612-trusted-ca-bundle\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.946811 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.946787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-serving-cert\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.946955 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.946934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0247f7af-d1ac-4aaa-bf73-bd839ea74612-console-oauth-config\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:39.952945 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:39.952923    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxkr\" (UniqueName: \"kubernetes.io/projected/0247f7af-d1ac-4aaa-bf73-bd839ea74612-kube-api-access-2xxkr\") pod \"console-66979b5dbd-m7h6s\" (UID: \"0247f7af-d1ac-4aaa-bf73-bd839ea74612\") " pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:40.087204 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:40.087181    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:40.223707 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:40.223683    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66979b5dbd-m7h6s"]
Jul 02 19:11:40.225985 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:40.225962    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0247f7af_d1ac_4aaa_bf73_bd839ea74612.slice/crio-0076584d26214e0d9a9100e3eee9a405b221554226b4621b254a6a9850015735 WatchSource:0}: Error finding container 0076584d26214e0d9a9100e3eee9a405b221554226b4621b254a6a9850015735: Status 404 returned error can't find the container with id 0076584d26214e0d9a9100e3eee9a405b221554226b4621b254a6a9850015735
Jul 02 19:11:40.825914 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:40.825873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66979b5dbd-m7h6s" event={"ID":"0247f7af-d1ac-4aaa-bf73-bd839ea74612","Type":"ContainerStarted","Data":"cb53179c68345a56aa5fc7d84488ff895ea1547753abc5b1be4167693c11eb71"}
Jul 02 19:11:40.826286 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:40.825932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66979b5dbd-m7h6s" event={"ID":"0247f7af-d1ac-4aaa-bf73-bd839ea74612","Type":"ContainerStarted","Data":"0076584d26214e0d9a9100e3eee9a405b221554226b4621b254a6a9850015735"}
Jul 02 19:11:40.858282 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:40.858211    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66979b5dbd-m7h6s" podStartSLOduration=1.858196259 podStartE2EDuration="1.858196259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:40.85633291 +0000 UTC m=+603.828994064" watchObservedRunningTime="2026-07-02 19:11:40.858196259 +0000 UTC m=+603.830857412"
Jul 02 19:11:45.956194 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:45.956155    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"]
Jul 02 19:11:45.962762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:45.962742    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:45.966261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:45.966237    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68jph\""
Jul 02 19:11:45.976424 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:45.976405    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"]
Jul 02 19:11:46.091957 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.091921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.091957 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.091970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h4kh\" (UniqueName: \"kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.193161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.193117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.193161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.193171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h4kh\" (UniqueName: \"kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.193488 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.193466    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.208138 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.208071    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h4kh\" (UniqueName: \"kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.273652 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.273616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:46.403830 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.403805    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"]
Jul 02 19:11:46.406182 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:46.406152    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bcd280_f8d4_4e0e_83c7_096fab6e2701.slice/crio-5fd7c1e0613cfde5d89a9d4c8eca9a1b0efa0fcc30b0c2c3ca54155eec1f7962 WatchSource:0}: Error finding container 5fd7c1e0613cfde5d89a9d4c8eca9a1b0efa0fcc30b0c2c3ca54155eec1f7962: Status 404 returned error can't find the container with id 5fd7c1e0613cfde5d89a9d4c8eca9a1b0efa0fcc30b0c2c3ca54155eec1f7962
Jul 02 19:11:46.851198 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:46.851161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp" event={"ID":"63bcd280-f8d4-4e0e-83c7-096fab6e2701","Type":"ContainerStarted","Data":"5fd7c1e0613cfde5d89a9d4c8eca9a1b0efa0fcc30b0c2c3ca54155eec1f7962"}
Jul 02 19:11:47.835495 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.835464    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"]
Jul 02 19:11:47.839329 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.839311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:47.841625 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.841607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qg7nc\""
Jul 02 19:11:47.841838 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.841826    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 19:11:47.852597 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.852574    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"]
Jul 02 19:11:47.906811 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:47.906781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2q7d\" (UniqueName: \"kubernetes.io/projected/ce0d276d-c87b-4923-8e52-b9f1db7842e5-kube-api-access-j2q7d\") pod \"dns-operator-controller-manager-864dd78c4c-sx28d\" (UID: \"ce0d276d-c87b-4923-8e52-b9f1db7842e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:48.007340 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:48.007320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2q7d\" (UniqueName: \"kubernetes.io/projected/ce0d276d-c87b-4923-8e52-b9f1db7842e5-kube-api-access-j2q7d\") pod \"dns-operator-controller-manager-864dd78c4c-sx28d\" (UID: \"ce0d276d-c87b-4923-8e52-b9f1db7842e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:48.035171 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:48.035147    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2q7d\" (UniqueName: \"kubernetes.io/projected/ce0d276d-c87b-4923-8e52-b9f1db7842e5-kube-api-access-j2q7d\") pod \"dns-operator-controller-manager-864dd78c4c-sx28d\" (UID: \"ce0d276d-c87b-4923-8e52-b9f1db7842e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:48.149195 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:48.149135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:48.326907 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:48.326875    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"]
Jul 02 19:11:48.329310 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:48.329278    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0d276d_c87b_4923_8e52_b9f1db7842e5.slice/crio-271611be6e4dcbef20e751c016c9d567b69a83dad67d211f0c3d78212e308c3c WatchSource:0}: Error finding container 271611be6e4dcbef20e751c016c9d567b69a83dad67d211f0c3d78212e308c3c: Status 404 returned error can't find the container with id 271611be6e4dcbef20e751c016c9d567b69a83dad67d211f0c3d78212e308c3c
Jul 02 19:11:48.861384 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:48.861355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d" event={"ID":"ce0d276d-c87b-4923-8e52-b9f1db7842e5","Type":"ContainerStarted","Data":"271611be6e4dcbef20e751c016c9d567b69a83dad67d211f0c3d78212e308c3c"}
Jul 02 19:11:49.869001 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:49.868920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp" event={"ID":"63bcd280-f8d4-4e0e-83c7-096fab6e2701","Type":"ContainerStarted","Data":"3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d"}
Jul 02 19:11:49.869384 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:49.869024    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:11:49.918594 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:49.918540    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp" podStartSLOduration=1.744164394 podStartE2EDuration="4.918519721s" totalImagesPullingTime="3.174355327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:49.914996387 +0000 UTC m=+612.887657540" watchObservedRunningTime="2026-07-02 19:11:49.918519721 +0000 UTC m=+612.891180890"
Jul 02 19:11:50.087672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.087613    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:50.087871 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.087710    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:50.092927 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.092899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:50.797157 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.797119    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"]
Jul 02 19:11:50.800657 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.800636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:50.804082 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.803999    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m766g\""
Jul 02 19:11:50.822401 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.822370    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"]
Jul 02 19:11:50.879184 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.878959    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66979b5dbd-m7h6s"
Jul 02 19:11:50.936707 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.936666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27d6f\" (UniqueName: \"kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f\") pod \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" (UID: \"992d2451-36a8-4828-9faf-c910d1abd9ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:50.961237 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:50.961199    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:11:51.037855 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.037819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27d6f\" (UniqueName: \"kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f\") pod \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" (UID: \"992d2451-36a8-4828-9faf-c910d1abd9ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:51.051597 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.051542    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27d6f\" (UniqueName: \"kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f\") pod \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" (UID: \"992d2451-36a8-4828-9faf-c910d1abd9ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:51.112777 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.112748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:51.264893 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.264870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"]
Jul 02 19:11:51.267434 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:51.267410    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992d2451_36a8_4828_9faf_c910d1abd9ae.slice/crio-20d63e57bd8706cf1242913524c78fad69b048d763d9f7db8865f7fb2b8b78de WatchSource:0}: Error finding container 20d63e57bd8706cf1242913524c78fad69b048d763d9f7db8865f7fb2b8b78de: Status 404 returned error can't find the container with id 20d63e57bd8706cf1242913524c78fad69b048d763d9f7db8865f7fb2b8b78de
Jul 02 19:11:51.880711 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.880680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr" event={"ID":"992d2451-36a8-4828-9faf-c910d1abd9ae","Type":"ContainerStarted","Data":"20d63e57bd8706cf1242913524c78fad69b048d763d9f7db8865f7fb2b8b78de"}
Jul 02 19:11:51.882462 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.882433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d" event={"ID":"ce0d276d-c87b-4923-8e52-b9f1db7842e5","Type":"ContainerStarted","Data":"7aee808cfb1a24c1bea06bcb8ac06091dcadf540a77d1c253662e116b032458b"}
Jul 02 19:11:51.939663 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:51.939608    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d" podStartSLOduration=2.250302895 podStartE2EDuration="4.939591495s" totalImagesPullingTime="2.6892886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:51.93715588 +0000 UTC m=+614.909817034" watchObservedRunningTime="2026-07-02 19:11:51.939591495 +0000 UTC m=+614.912252649"
Jul 02 19:11:52.601905 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.601875    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"]
Jul 02 19:11:52.605350 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.605332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.608039 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.608018    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 19:11:52.608161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.608018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gfjmq\""
Jul 02 19:11:52.608161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.608018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 19:11:52.622415 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.622393    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"]
Jul 02 19:11:52.651059 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.651034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeabaef5-c002-4ee1-b686-e0cee7812f5d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.651179 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.651105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.651267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.651246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2tc\" (UniqueName: \"kubernetes.io/projected/eeabaef5-c002-4ee1-b686-e0cee7812f5d-kube-api-access-kk2tc\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.752402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.752370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.752576 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.752557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2tc\" (UniqueName: \"kubernetes.io/projected/eeabaef5-c002-4ee1-b686-e0cee7812f5d-kube-api-access-kk2tc\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.752651 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.752613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeabaef5-c002-4ee1-b686-e0cee7812f5d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.752720 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:11:52.752560    2569 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 02 19:11:52.752720 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:11:52.752718    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert podName:eeabaef5-c002-4ee1-b686-e0cee7812f5d nodeName:}" failed. No retries permitted until 2026-07-02 19:11:53.252696214 +0000 UTC m=+616.225357357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rstkr" (UID: "eeabaef5-c002-4ee1-b686-e0cee7812f5d") : secret "plugin-serving-cert" not found
Jul 02 19:11:52.753308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.753280    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeabaef5-c002-4ee1-b686-e0cee7812f5d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.765297 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.765274    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2tc\" (UniqueName: \"kubernetes.io/projected/eeabaef5-c002-4ee1-b686-e0cee7812f5d-kube-api-access-kk2tc\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:52.888337 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:52.888253    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:11:53.257446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.257374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:53.259675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.259651    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeabaef5-c002-4ee1-b686-e0cee7812f5d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rstkr\" (UID: \"eeabaef5-c002-4ee1-b686-e0cee7812f5d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:53.515502 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.515430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"
Jul 02 19:11:53.651362 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.651339    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr"]
Jul 02 19:11:53.653463 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:53.653433    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeabaef5_c002_4ee1_b686_e0cee7812f5d.slice/crio-c6570640d53f1a2298d2d4b6a9fa769663886b934f8ca9a833eb342fa9e396fe WatchSource:0}: Error finding container c6570640d53f1a2298d2d4b6a9fa769663886b934f8ca9a833eb342fa9e396fe: Status 404 returned error can't find the container with id c6570640d53f1a2298d2d4b6a9fa769663886b934f8ca9a833eb342fa9e396fe
Jul 02 19:11:53.894209 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.894180    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr" event={"ID":"eeabaef5-c002-4ee1-b686-e0cee7812f5d","Type":"ContainerStarted","Data":"c6570640d53f1a2298d2d4b6a9fa769663886b934f8ca9a833eb342fa9e396fe"}
Jul 02 19:11:53.895798 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.895770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr" event={"ID":"992d2451-36a8-4828-9faf-c910d1abd9ae","Type":"ContainerStarted","Data":"010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932"}
Jul 02 19:11:53.896097 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.896078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:11:53.921298 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:53.921259    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr" podStartSLOduration=2.23251275 podStartE2EDuration="3.921245661s" totalImagesPullingTime="1.688732911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:53.919626418 +0000 UTC m=+616.892287574" watchObservedRunningTime="2026-07-02 19:11:53.921245661 +0000 UTC m=+616.893906815"
Jul 02 19:11:54.363898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.363834    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"]
Jul 02 19:11:54.367605 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.367585    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:54.373138 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.373119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hd6pb\""
Jul 02 19:11:54.382637 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.382615    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"]
Jul 02 19:11:54.468622 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.468591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvf94\" (UniqueName: \"kubernetes.io/projected/190fdf57-0b4e-45fe-9478-9804afa33f16-kube-api-access-gvf94\") pod \"authorino-operator-75cc8d5cb7-7tsrc\" (UID: \"190fdf57-0b4e-45fe-9478-9804afa33f16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:54.569889 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.569837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvf94\" (UniqueName: \"kubernetes.io/projected/190fdf57-0b4e-45fe-9478-9804afa33f16-kube-api-access-gvf94\") pod \"authorino-operator-75cc8d5cb7-7tsrc\" (UID: \"190fdf57-0b4e-45fe-9478-9804afa33f16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:54.581362 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.581334    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvf94\" (UniqueName: \"kubernetes.io/projected/190fdf57-0b4e-45fe-9478-9804afa33f16-kube-api-access-gvf94\") pod \"authorino-operator-75cc8d5cb7-7tsrc\" (UID: \"190fdf57-0b4e-45fe-9478-9804afa33f16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:54.680705 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.680463    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:54.830112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.830079    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"]
Jul 02 19:11:54.831492 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:11:54.831459    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190fdf57_0b4e_45fe_9478_9804afa33f16.slice/crio-88d85c420393e2e9110c6ebf96c7a822a1a972e647c434ee62a1eb1d7b8ccfbb WatchSource:0}: Error finding container 88d85c420393e2e9110c6ebf96c7a822a1a972e647c434ee62a1eb1d7b8ccfbb: Status 404 returned error can't find the container with id 88d85c420393e2e9110c6ebf96c7a822a1a972e647c434ee62a1eb1d7b8ccfbb
Jul 02 19:11:54.903984 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:54.903902    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc" event={"ID":"190fdf57-0b4e-45fe-9478-9804afa33f16","Type":"ContainerStarted","Data":"88d85c420393e2e9110c6ebf96c7a822a1a972e647c434ee62a1eb1d7b8ccfbb"}
Jul 02 19:11:59.934561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:59.934521    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc" event={"ID":"190fdf57-0b4e-45fe-9478-9804afa33f16","Type":"ContainerStarted","Data":"e93ba263bb20eed10a51acf741cedc32ffd89b7eb29c8ad2bfb8c4909895fd33"}
Jul 02 19:11:59.935071 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:59.934620    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:11:59.954508 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:11:59.954464    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc" podStartSLOduration=1.728775217 podStartE2EDuration="5.95445132s" totalImagesPullingTime="4.225676103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:59.952514791 +0000 UTC m=+622.925175946" watchObservedRunningTime="2026-07-02 19:11:59.95445132 +0000 UTC m=+622.927112474"
Jul 02 19:12:00.877061 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:00.877030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:02.628878 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.628832    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"]
Jul 02 19:12:02.629392 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.629081    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" containerName="manager" containerID="cri-o://3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d" gracePeriod=2
Jul 02 19:12:02.636455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.636426    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"]
Jul 02 19:12:02.653686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.653658    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:02.654086 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.654069    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" containerName="manager"
Jul 02 19:12:02.654086 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.654087    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" containerName="manager"
Jul 02 19:12:02.654267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.654183    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" containerName="manager"
Jul 02 19:12:02.660773 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.660496    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"]
Jul 02 19:12:02.660773 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.660732    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" containerName="manager" containerID="cri-o://010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932" gracePeriod=2
Jul 02 19:12:02.661008 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.660925    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.662953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.662902    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:02.663553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.663528    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"]
Jul 02 19:12:02.665283 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.665169    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:02.667269 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.667244    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:02.669917 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.669888    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:02.672314 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.672285    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:02.677672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.677617    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:02.695474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.695448    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"]
Jul 02 19:12:02.695936 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.695917    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" containerName="manager"
Jul 02 19:12:02.695936 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.695937    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" containerName="manager"
Jul 02 19:12:02.696081 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.696034    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" containerName="manager"
Jul 02 19:12:02.699276 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.699255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:02.713827 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.713785    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:02.716120 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:02.715999    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:02.719098 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.719077    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"]
Jul 02 19:12:02.743739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.743711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.743856 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.743800    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jff72\" (UniqueName: \"kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.844729 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.844701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.844964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.844773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jff72\" (UniqueName: \"kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.844964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.844829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfcjp\" (UniqueName: \"kubernetes.io/projected/dbe61f0c-83a0-41f8-a546-a5d5ca927562-kube-api-access-hfcjp\") pod \"limitador-operator-controller-manager-859d7b78bd-glf8k\" (UID: \"dbe61f0c-83a0-41f8-a546-a5d5ca927562\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:02.845212 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.845191    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.853764 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.853738    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jff72\" (UniqueName: \"kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9cpw8\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:02.946343 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.946286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfcjp\" (UniqueName: \"kubernetes.io/projected/dbe61f0c-83a0-41f8-a546-a5d5ca927562-kube-api-access-hfcjp\") pod \"limitador-operator-controller-manager-859d7b78bd-glf8k\" (UID: \"dbe61f0c-83a0-41f8-a546-a5d5ca927562\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:02.958529 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:02.958504    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfcjp\" (UniqueName: \"kubernetes.io/projected/dbe61f0c-83a0-41f8-a546-a5d5ca927562-kube-api-access-hfcjp\") pod \"limitador-operator-controller-manager-859d7b78bd-glf8k\" (UID: \"dbe61f0c-83a0-41f8-a546-a5d5ca927562\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:03.061471 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:03.061440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:03.068715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:03.068693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:03.898707 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:03.898676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sx28d"
Jul 02 19:12:10.942948 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:10.942906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tsrc"
Jul 02 19:12:14.753752 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.753713    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:14.755947 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:12:14.755912    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf690b773_00e9_4821_87c2_1c9a76b21bda.slice/crio-f4d3c2fcd6dc058a659f5d4138611b4507dad03849c7dd9efcd0070228ad723a WatchSource:0}: Error finding container f4d3c2fcd6dc058a659f5d4138611b4507dad03849c7dd9efcd0070228ad723a: Status 404 returned error can't find the container with id f4d3c2fcd6dc058a659f5d4138611b4507dad03849c7dd9efcd0070228ad723a
Jul 02 19:12:14.758611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.758509    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:14.760646 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:14.760623    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:14.763246 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.763227    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:14.765090 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:14.765067    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:14.766899 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:14.766856    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:14.771303 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.771281    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"]
Jul 02 19:12:14.773890 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:12:14.773838    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe61f0c_83a0_41f8_a546_a5d5ca927562.slice/crio-8d1c1f987c20d87ad67f5ec6e03128eb5698555ba167e447f1d577e344f1d64b WatchSource:0}: Error finding container 8d1c1f987c20d87ad67f5ec6e03128eb5698555ba167e447f1d577e344f1d64b: Status 404 returned error can't find the container with id 8d1c1f987c20d87ad67f5ec6e03128eb5698555ba167e447f1d577e344f1d64b
Jul 02 19:12:14.955563 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.955490    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h4kh\" (UniqueName: \"kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh\") pod \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") "
Jul 02 19:12:14.955563 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.955553    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume\") pod \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\" (UID: \"63bcd280-f8d4-4e0e-83c7-096fab6e2701\") "
Jul 02 19:12:14.955721 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.955621    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27d6f\" (UniqueName: \"kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f\") pod \"992d2451-36a8-4828-9faf-c910d1abd9ae\" (UID: \"992d2451-36a8-4828-9faf-c910d1abd9ae\") "
Jul 02 19:12:14.956089 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.956056    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "63bcd280-f8d4-4e0e-83c7-096fab6e2701" (UID: "63bcd280-f8d4-4e0e-83c7-096fab6e2701"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:12:14.957405 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.957383    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh" (OuterVolumeSpecName: "kube-api-access-7h4kh") pod "63bcd280-f8d4-4e0e-83c7-096fab6e2701" (UID: "63bcd280-f8d4-4e0e-83c7-096fab6e2701"). InnerVolumeSpecName "kube-api-access-7h4kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:14.957543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:14.957522    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f" (OuterVolumeSpecName: "kube-api-access-27d6f") pod "992d2451-36a8-4828-9faf-c910d1abd9ae" (UID: "992d2451-36a8-4828-9faf-c910d1abd9ae"). InnerVolumeSpecName "kube-api-access-27d6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:15.020738 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.020706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr" event={"ID":"eeabaef5-c002-4ee1-b686-e0cee7812f5d","Type":"ContainerStarted","Data":"4ec4394dd96dfff1f381b2e8b45f477144da1404fc5f2d8e3787e26de2545320"}
Jul 02 19:12:15.022012 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.021988    2569 generic.go:356] "Generic (PLEG): container finished" podID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" containerID="3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d" exitCode=0
Jul 02 19:12:15.022112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.022019    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:15.022112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.022089    2569 scope.go:117] "RemoveContainer" containerID="3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d"
Jul 02 19:12:15.023340 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.023308    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:15.023862 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.023821    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" event={"ID":"f690b773-00e9-4821-87c2-1c9a76b21bda","Type":"ContainerStarted","Data":"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"}
Jul 02 19:12:15.023956 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.023928    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:15.024010 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.023956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" event={"ID":"f690b773-00e9-4821-87c2-1c9a76b21bda","Type":"ContainerStarted","Data":"f4d3c2fcd6dc058a659f5d4138611b4507dad03849c7dd9efcd0070228ad723a"}
Jul 02 19:12:15.025438 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.025417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k" event={"ID":"dbe61f0c-83a0-41f8-a546-a5d5ca927562","Type":"ContainerStarted","Data":"a301b5335ba78584cef5ab0ddd8d05ab650106e4ce64e259e70a2b259213f1cc"}
Jul 02 19:12:15.025523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.025460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k" event={"ID":"dbe61f0c-83a0-41f8-a546-a5d5ca927562","Type":"ContainerStarted","Data":"8d1c1f987c20d87ad67f5ec6e03128eb5698555ba167e447f1d577e344f1d64b"}
Jul 02 19:12:15.025523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.025504    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:15.026760 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.026737    2569 generic.go:356] "Generic (PLEG): container finished" podID="992d2451-36a8-4828-9faf-c910d1abd9ae" containerID="010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932" exitCode=0
Jul 02 19:12:15.026872 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.026787    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:15.031172 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.031155    2569 scope.go:117] "RemoveContainer" containerID="3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d"
Jul 02 19:12:15.031417 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.031398    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d\": container with ID starting with 3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d not found: ID does not exist" containerID="3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d"
Jul 02 19:12:15.031490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.031424    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d"} err="failed to get container status \"3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d\": rpc error: code = NotFound desc = could not find container \"3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d\": container with ID starting with 3f1611fd2aec0831a32fea2c7501056cfcf3cf0d3da66ee8ed7858d37cd6c44d not found: ID does not exist"
Jul 02 19:12:15.031490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.031439    2569 scope.go:117] "RemoveContainer" containerID="010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932"
Jul 02 19:12:15.039515 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.039499    2569 scope.go:117] "RemoveContainer" containerID="010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932"
Jul 02 19:12:15.039739 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.039722    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932\": container with ID starting with 010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932 not found: ID does not exist" containerID="010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932"
Jul 02 19:12:15.039782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.039743    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932"} err="failed to get container status \"010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932\": rpc error: code = NotFound desc = could not find container \"010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932\": container with ID starting with 010a530e10b5d9a63dda7ec0f5dd98b20b221380354547c22bfbe2e757050932 not found: ID does not exist"
Jul 02 19:12:15.043140 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.043105    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rstkr" podStartSLOduration=2.013716609 podStartE2EDuration="23.043093164s" totalImagesPullingTime="21.029376555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:15.042040408 +0000 UTC m=+638.014701562" watchObservedRunningTime="2026-07-02 19:12:15.043093164 +0000 UTC m=+638.015754320"
Jul 02 19:12:15.043862 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.043818    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:15.056804 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.056785    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27d6f\" (UniqueName: \"kubernetes.io/projected/992d2451-36a8-4828-9faf-c910d1abd9ae-kube-api-access-27d6f\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:15.057025 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.057003    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h4kh\" (UniqueName: \"kubernetes.io/projected/63bcd280-f8d4-4e0e-83c7-096fab6e2701-kube-api-access-7h4kh\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:15.057109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.057027    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63bcd280-f8d4-4e0e-83c7-096fab6e2701-extensions-socket-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:15.066204 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.066157    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" podStartSLOduration=13.06614 podStartE2EDuration="13.06614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:15.064283767 +0000 UTC m=+638.036944922" watchObservedRunningTime="2026-07-02 19:12:15.06614 +0000 UTC m=+638.038801154"
Jul 02 19:12:15.066563 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.066538    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lwzbp\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lwzbp"
Jul 02 19:12:15.092056 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.092016    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k" podStartSLOduration=13.09200446 podStartE2EDuration="13.09200446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:15.090052019 +0000 UTC m=+638.062713173" watchObservedRunningTime="2026-07-02 19:12:15.09200446 +0000 UTC m=+638.064665613"
Jul 02 19:12:15.092547 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:15.092525    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ptqr\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ptqr"
Jul 02 19:12:15.729143 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.729111    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63bcd280-f8d4-4e0e-83c7-096fab6e2701" path="/var/lib/kubelet/pods/63bcd280-f8d4-4e0e-83c7-096fab6e2701/volumes"
Jul 02 19:12:15.729446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.729433    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992d2451-36a8-4828-9faf-c910d1abd9ae" path="/var/lib/kubelet/pods/992d2451-36a8-4828-9faf-c910d1abd9ae/volumes"
Jul 02 19:12:15.982316 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:15.982216    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68cd4f7cf9-dw85s" podUID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" containerName="console" containerID="cri-o://099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356" gracePeriod=15
Jul 02 19:12:16.223310 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.223288    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:12:16.266300 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266245    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266300 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266278    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266304    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266339    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266375    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266415    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp2rw\" (UniqueName: \"kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config\") pod \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\" (UID: \"091dbac0-34a9-4736-bbc3-9ed07c59d6ba\") "
Jul 02 19:12:16.266754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266731    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:12:16.266966 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.266939    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config" (OuterVolumeSpecName: "console-config") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:12:16.267120 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.267004    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:12:16.267120 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.267054    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:12:16.268557 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.268528    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:12:16.268945 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.268924    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:12:16.268945 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.268933    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw" (OuterVolumeSpecName: "kube-api-access-jp2rw") pod "091dbac0-34a9-4736-bbc3-9ed07c59d6ba" (UID: "091dbac0-34a9-4736-bbc3-9ed07c59d6ba"). InnerVolumeSpecName "kube-api-access-jp2rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:16.367299 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367276    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp2rw\" (UniqueName: \"kubernetes.io/projected/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-kube-api-access-jp2rw\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367299 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367301    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-oauth-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367310    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-oauth-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367319    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367328    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367335    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-trusted-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:16.367410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:16.367343    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091dbac0-34a9-4736-bbc3-9ed07c59d6ba-console-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:17.039985 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.039946    2569 generic.go:356] "Generic (PLEG): container finished" podID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" containerID="099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356" exitCode=0
Jul 02 19:12:17.040413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.039993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd4f7cf9-dw85s" event={"ID":"091dbac0-34a9-4736-bbc3-9ed07c59d6ba","Type":"ContainerDied","Data":"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"}
Jul 02 19:12:17.040413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.040034    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd4f7cf9-dw85s" event={"ID":"091dbac0-34a9-4736-bbc3-9ed07c59d6ba","Type":"ContainerDied","Data":"81e636eed468866362d5aae1dbab95c4bccd4ec615535b6656f7032d617337fe"}
Jul 02 19:12:17.040413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.040055    2569 scope.go:117] "RemoveContainer" containerID="099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"
Jul 02 19:12:17.040413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.039994    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd4f7cf9-dw85s"
Jul 02 19:12:17.049178 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.049155    2569 scope.go:117] "RemoveContainer" containerID="099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"
Jul 02 19:12:17.049475 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:17.049457    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356\": container with ID starting with 099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356 not found: ID does not exist" containerID="099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"
Jul 02 19:12:17.049535 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.049482    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356"} err="failed to get container status \"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356\": rpc error: code = NotFound desc = could not find container \"099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356\": container with ID starting with 099ed79a49bf2f328637d4be0a43c737f9302713cbcb1db5817efa68143eb356 not found: ID does not exist"
Jul 02 19:12:17.064286 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.064264    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:12:17.069106 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.069088    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68cd4f7cf9-dw85s"]
Jul 02 19:12:17.731334 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:17.731305    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" path="/var/lib/kubelet/pods/091dbac0-34a9-4736-bbc3-9ed07c59d6ba/volumes"
Jul 02 19:12:20.453242 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.453213    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:20.453621 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.453385    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" podUID="f690b773-00e9-4821-87c2-1c9a76b21bda" containerName="manager" containerID="cri-o://63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73" gracePeriod=10
Jul 02 19:12:20.455121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.455100    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:20.731742 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.731721    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:20.798498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.798474    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jff72\" (UniqueName: \"kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72\") pod \"f690b773-00e9-4821-87c2-1c9a76b21bda\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") "
Jul 02 19:12:20.798634 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.798548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume\") pod \"f690b773-00e9-4821-87c2-1c9a76b21bda\" (UID: \"f690b773-00e9-4821-87c2-1c9a76b21bda\") "
Jul 02 19:12:20.798977 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.798950    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f690b773-00e9-4821-87c2-1c9a76b21bda" (UID: "f690b773-00e9-4821-87c2-1c9a76b21bda"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:12:20.800531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.800502    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72" (OuterVolumeSpecName: "kube-api-access-jff72") pod "f690b773-00e9-4821-87c2-1c9a76b21bda" (UID: "f690b773-00e9-4821-87c2-1c9a76b21bda"). InnerVolumeSpecName "kube-api-access-jff72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:20.899014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.898990    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jff72\" (UniqueName: \"kubernetes.io/projected/f690b773-00e9-4821-87c2-1c9a76b21bda-kube-api-access-jff72\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:20.899014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:20.899011    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f690b773-00e9-4821-87c2-1c9a76b21bda-extensions-socket-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:21.059565 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.059481    2569 generic.go:356] "Generic (PLEG): container finished" podID="f690b773-00e9-4821-87c2-1c9a76b21bda" containerID="63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73" exitCode=0
Jul 02 19:12:21.059565 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.059527    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"
Jul 02 19:12:21.059709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.059572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" event={"ID":"f690b773-00e9-4821-87c2-1c9a76b21bda","Type":"ContainerDied","Data":"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"}
Jul 02 19:12:21.059709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.059630    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8" event={"ID":"f690b773-00e9-4821-87c2-1c9a76b21bda","Type":"ContainerDied","Data":"f4d3c2fcd6dc058a659f5d4138611b4507dad03849c7dd9efcd0070228ad723a"}
Jul 02 19:12:21.059709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.059654    2569 scope.go:117] "RemoveContainer" containerID="63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"
Jul 02 19:12:21.069041 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.069012    2569 scope.go:117] "RemoveContainer" containerID="63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"
Jul 02 19:12:21.069385 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:21.069364    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73\": container with ID starting with 63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73 not found: ID does not exist" containerID="63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"
Jul 02 19:12:21.069480 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.069391    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73"} err="failed to get container status \"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73\": rpc error: code = NotFound desc = could not find container \"63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73\": container with ID starting with 63f660f843bed00ca9f01a918f97114f635c9dbf8719e1219d30941f750bbf73 not found: ID does not exist"
Jul 02 19:12:21.085080 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.085052    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:21.093091 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.093067    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9cpw8"]
Jul 02 19:12:21.728980 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:21.728943    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f690b773-00e9-4821-87c2-1c9a76b21bda" path="/var/lib/kubelet/pods/f690b773-00e9-4821-87c2-1c9a76b21bda/volumes"
Jul 02 19:12:26.036045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:26.036015    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glf8k"
Jul 02 19:12:36.771408 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.771369    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"]
Jul 02 19:12:36.771929 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.771911    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" containerName="console"
Jul 02 19:12:36.771929 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.771931    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" containerName="console"
Jul 02 19:12:36.772018 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.771946    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f690b773-00e9-4821-87c2-1c9a76b21bda" containerName="manager"
Jul 02 19:12:36.772018 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.771952    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f690b773-00e9-4821-87c2-1c9a76b21bda" containerName="manager"
Jul 02 19:12:36.772018 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.772007    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f690b773-00e9-4821-87c2-1c9a76b21bda" containerName="manager"
Jul 02 19:12:36.772018 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.772018    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="091dbac0-34a9-4736-bbc3-9ed07c59d6ba" containerName="console"
Jul 02 19:12:36.899316 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.899276    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"]
Jul 02 19:12:36.899487 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.899410    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.901976 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.901956    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gn5h5\""
Jul 02 19:12:36.901976 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.901963    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:12:36.919553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf0eb511-558a-4c30-81fa-88cfd3912b70-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919761 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919761 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919837 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919837 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919837 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:36.919966 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:36.919869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6xt\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-kube-api-access-2f6xt\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021278 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021278 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6xt\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-kube-api-access-2f6xt\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021800 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf0eb511-558a-4c30-81fa-88cfd3912b70-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021800 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021604    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021800 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021689    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.021989 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.021821    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.022048 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.022017    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.022048 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.022036    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.022360 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.022338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf0eb511-558a-4c30-81fa-88cfd3912b70-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.023704 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.023684    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.023984 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.023966    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.029526 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.029503    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.029712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.029695    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6xt\" (UniqueName: \"kubernetes.io/projected/cf0eb511-558a-4c30-81fa-88cfd3912b70-kube-api-access-2f6xt\") pod \"maas-default-gateway-openshift-default-56654dcf7-ldpfl\" (UID: \"cf0eb511-558a-4c30-81fa-88cfd3912b70\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.211220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.211187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:37.336504 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:37.336472    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"]
Jul 02 19:12:37.339304 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:12:37.339282    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0eb511_558a_4c30_81fa_88cfd3912b70.slice/crio-2121235a6969e659b3b849e5aa26ad429501e15b5c7f1a88a7143ab7eec25ca5 WatchSource:0}: Error finding container 2121235a6969e659b3b849e5aa26ad429501e15b5c7f1a88a7143ab7eec25ca5: Status 404 returned error can't find the container with id 2121235a6969e659b3b849e5aa26ad429501e15b5c7f1a88a7143ab7eec25ca5
Jul 02 19:12:38.142274 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:38.142233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" event={"ID":"cf0eb511-558a-4c30-81fa-88cfd3912b70","Type":"ContainerStarted","Data":"2121235a6969e659b3b849e5aa26ad429501e15b5c7f1a88a7143ab7eec25ca5"}
Jul 02 19:12:39.717181 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:39.717135    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:12:39.717548 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:39.717236    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:12:39.717548 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:39.717284    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:12:40.153638 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:40.153602    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" event={"ID":"cf0eb511-558a-4c30-81fa-88cfd3912b70","Type":"ContainerStarted","Data":"346883ce5969e5eb3b36c40f276e786fe3112cfa7536a99708d936878abefc0d"}
Jul 02 19:12:40.182767 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:40.182716    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" podStartSLOduration=1.807171522 podStartE2EDuration="4.182697905s" totalImagesPullingTime="2.375526383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:40.179809558 +0000 UTC m=+663.152470713" watchObservedRunningTime="2026-07-02 19:12:40.182697905 +0000 UTC m=+663.155359058"
Jul 02 19:12:40.211625 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:40.211593    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:40.216133 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:40.216108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:41.158456 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.158427    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:41.159359 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.159341    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:12:41.244203 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.244172    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:41.246634 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.246616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.249103 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.249084    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 19:12:41.260893 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.260867    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:41.342455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.342424    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:41.359943 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.359918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.360077 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.359962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2mq\" (UniqueName: \"kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.460854 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.460762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.460854 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.460806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2mq\" (UniqueName: \"kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.461407 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.461386    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.474283 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.474258    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2mq\" (UniqueName: \"kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq\") pod \"limitador-limitador-64c94fd64f-2gmtx\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.556463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.556429    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:41.685112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:41.684899    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:41.687315 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:12:41.687288    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c437e4_1820_4e27_9095_43c6654681d5.slice/crio-fb1c3707c04f79955d85a5e538993bc103e28b397eeb68046605254ce5cd692c WatchSource:0}: Error finding container fb1c3707c04f79955d85a5e538993bc103e28b397eeb68046605254ce5cd692c: Status 404 returned error can't find the container with id fb1c3707c04f79955d85a5e538993bc103e28b397eeb68046605254ce5cd692c
Jul 02 19:12:42.166279 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:42.166238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" event={"ID":"d3c437e4-1820-4e27-9095-43c6654681d5","Type":"ContainerStarted","Data":"fb1c3707c04f79955d85a5e538993bc103e28b397eeb68046605254ce5cd692c"}
Jul 02 19:12:44.177814 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:44.177787    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" event={"ID":"d3c437e4-1820-4e27-9095-43c6654681d5","Type":"ContainerStarted","Data":"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"}
Jul 02 19:12:44.178202 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:44.177882    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:44.194956 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:44.194910    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" podStartSLOduration=0.773716508 podStartE2EDuration="3.194894746s" totalImagesPullingTime="2.421178238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:44.192412628 +0000 UTC m=+667.165073782" watchObservedRunningTime="2026-07-02 19:12:44.194894746 +0000 UTC m=+667.167555900"
Jul 02 19:12:55.184359 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:55.184324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:56.629085 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:56.629052    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:56.629476 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:56.629218    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" podUID="d3c437e4-1820-4e27-9095-43c6654681d5" containerName="limitador" containerID="cri-o://917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15" gracePeriod=30
Jul 02 19:12:57.075773 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.075749    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:57.207211 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.207125    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt2mq\" (UniqueName: \"kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq\") pod \"d3c437e4-1820-4e27-9095-43c6654681d5\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") "
Jul 02 19:12:57.207211 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.207168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file\") pod \"d3c437e4-1820-4e27-9095-43c6654681d5\" (UID: \"d3c437e4-1820-4e27-9095-43c6654681d5\") "
Jul 02 19:12:57.207575 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.207543    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file" (OuterVolumeSpecName: "config-file") pod "d3c437e4-1820-4e27-9095-43c6654681d5" (UID: "d3c437e4-1820-4e27-9095-43c6654681d5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:12:57.209234 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.209214    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq" (OuterVolumeSpecName: "kube-api-access-tt2mq") pod "d3c437e4-1820-4e27-9095-43c6654681d5" (UID: "d3c437e4-1820-4e27-9095-43c6654681d5"). InnerVolumeSpecName "kube-api-access-tt2mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:57.237424 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.237395    2569 generic.go:356] "Generic (PLEG): container finished" podID="d3c437e4-1820-4e27-9095-43c6654681d5" containerID="917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15" exitCode=0
Jul 02 19:12:57.237527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.237449    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"
Jul 02 19:12:57.237527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.237460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" event={"ID":"d3c437e4-1820-4e27-9095-43c6654681d5","Type":"ContainerDied","Data":"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"}
Jul 02 19:12:57.237527 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.237513    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2gmtx" event={"ID":"d3c437e4-1820-4e27-9095-43c6654681d5","Type":"ContainerDied","Data":"fb1c3707c04f79955d85a5e538993bc103e28b397eeb68046605254ce5cd692c"}
Jul 02 19:12:57.237633 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.237542    2569 scope.go:117] "RemoveContainer" containerID="917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"
Jul 02 19:12:57.246459 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.246442    2569 scope.go:117] "RemoveContainer" containerID="917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"
Jul 02 19:12:57.246701 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:12:57.246680    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15\": container with ID starting with 917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15 not found: ID does not exist" containerID="917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"
Jul 02 19:12:57.246785 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.246706    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15"} err="failed to get container status \"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15\": rpc error: code = NotFound desc = could not find container \"917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15\": container with ID starting with 917d83eba9f88761f6512358ffce05a0b37801ffe89fb846c942b56b17528a15 not found: ID does not exist"
Jul 02 19:12:57.262571 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.262519    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:57.264158 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.264136    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2gmtx"]
Jul 02 19:12:57.308252 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.308225    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt2mq\" (UniqueName: \"kubernetes.io/projected/d3c437e4-1820-4e27-9095-43c6654681d5-kube-api-access-tt2mq\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:57.308252 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.308248    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3c437e4-1820-4e27-9095-43c6654681d5-config-file\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:12:57.728534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:12:57.728494    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3c437e4-1820-4e27-9095-43c6654681d5" path="/var/lib/kubelet/pods/d3c437e4-1820-4e27-9095-43c6654681d5/volumes"
Jul 02 19:13:02.840828 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.840784    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-l2lrl"]
Jul 02 19:13:02.841352 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.841334    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c437e4-1820-4e27-9095-43c6654681d5" containerName="limitador"
Jul 02 19:13:02.841406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.841357    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c437e4-1820-4e27-9095-43c6654681d5" containerName="limitador"
Jul 02 19:13:02.841463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.841452    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c437e4-1820-4e27-9095-43c6654681d5" containerName="limitador"
Jul 02 19:13:02.844410 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.844389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:02.846854 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.846817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 19:13:02.846963 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.846943    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lvzjk\""
Jul 02 19:13:02.853433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.853407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-l2lrl"]
Jul 02 19:13:02.953720 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.953690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j4hz\" (UniqueName: \"kubernetes.io/projected/6ee673dd-64fb-418f-b71d-3b9d6afaee66-kube-api-access-4j4hz\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:02.953720 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:02.953725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ee673dd-64fb-418f-b71d-3b9d6afaee66-data\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.055174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.055125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j4hz\" (UniqueName: \"kubernetes.io/projected/6ee673dd-64fb-418f-b71d-3b9d6afaee66-kube-api-access-4j4hz\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.055174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.055178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ee673dd-64fb-418f-b71d-3b9d6afaee66-data\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.055577 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.055558    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ee673dd-64fb-418f-b71d-3b9d6afaee66-data\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.063392 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.063365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j4hz\" (UniqueName: \"kubernetes.io/projected/6ee673dd-64fb-418f-b71d-3b9d6afaee66-kube-api-access-4j4hz\") pod \"postgres-69fb4594cf-l2lrl\" (UID: \"6ee673dd-64fb-418f-b71d-3b9d6afaee66\") " pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.155818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.155711    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:03.318763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.318731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-l2lrl"]
Jul 02 19:13:03.321005 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:13:03.320975    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee673dd_64fb_418f_b71d_3b9d6afaee66.slice/crio-f8a59e487f786a7f0213cddf70b831312e67d517148db6d8f241bc62557ad860 WatchSource:0}: Error finding container f8a59e487f786a7f0213cddf70b831312e67d517148db6d8f241bc62557ad860: Status 404 returned error can't find the container with id f8a59e487f786a7f0213cddf70b831312e67d517148db6d8f241bc62557ad860
Jul 02 19:13:03.322498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:03.322479    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:13:04.281272 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:04.281232    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-l2lrl" event={"ID":"6ee673dd-64fb-418f-b71d-3b9d6afaee66","Type":"ContainerStarted","Data":"f8a59e487f786a7f0213cddf70b831312e67d517148db6d8f241bc62557ad860"}
Jul 02 19:13:09.309615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:09.309579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-l2lrl" event={"ID":"6ee673dd-64fb-418f-b71d-3b9d6afaee66","Type":"ContainerStarted","Data":"32486a62a72f83d5d8350d328a2e7d719c25ecdd7f11d6b5ac0c7a2898a56da0"}
Jul 02 19:13:09.310053 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:09.309716    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:15.347226 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:15.347199    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-l2lrl"
Jul 02 19:13:15.365372 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:15.365324    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-l2lrl" podStartSLOduration=7.989607389 podStartE2EDuration="13.365309616s" totalImagesPullingTime="5.375702227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:09.32752704 +0000 UTC m=+692.300188197" watchObservedRunningTime="2026-07-02 19:13:15.365309616 +0000 UTC m=+698.337970769"
Jul 02 19:13:22.121583 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.121549    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:22.129514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.129494    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.132052 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.132030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nb5h2\""
Jul 02 19:13:22.132154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.132034    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 19:13:22.132154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.132070    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 19:13:22.135672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.135652    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:22.220113 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.220086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.220225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.220122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gdqw\" (UniqueName: \"kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.320790 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.320769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.320913 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.320799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gdqw\" (UniqueName: \"kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.323052 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.323024    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.333590 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.333568    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gdqw\" (UniqueName: \"kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw\") pod \"maas-controller-5bf8fcfd79-bbmtf\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") " pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.344066 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.344046    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:13:22.346406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.346390    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.375901 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.375828    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:13:22.421310 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.421290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.421413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.421326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjrmj\" (UniqueName: \"kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.441700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.441677    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:22.522236 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.522209    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.522341 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.522255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjrmj\" (UniqueName: \"kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.525455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.525424    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.530706 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.530626    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjrmj\" (UniqueName: \"kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj\") pod \"maas-controller-77955f86f7-s2rjc\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") " pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.569718 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.569695    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:22.571504 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:13:22.571478    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b1fdd1_3c4d_4c0c_9220_1b73e5456bc3.slice/crio-c70435ca3531e0a12a0f7c7b8c74fae21c9b2548069275b8a9a36eaf1f45e95e WatchSource:0}: Error finding container c70435ca3531e0a12a0f7c7b8c74fae21c9b2548069275b8a9a36eaf1f45e95e: Status 404 returned error can't find the container with id c70435ca3531e0a12a0f7c7b8c74fae21c9b2548069275b8a9a36eaf1f45e95e
Jul 02 19:13:22.656021 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.655970    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:22.781560 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:22.781535    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:13:22.783118 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:13:22.783088    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1583b12e_28e8_48a7_bd49_739114154b32.slice/crio-75466d60a51b7f22ba20cf75984b42643ce0629b48a0508e668813465c885a99 WatchSource:0}: Error finding container 75466d60a51b7f22ba20cf75984b42643ce0629b48a0508e668813465c885a99: Status 404 returned error can't find the container with id 75466d60a51b7f22ba20cf75984b42643ce0629b48a0508e668813465c885a99
Jul 02 19:13:23.381834 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:23.381742    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-s2rjc" event={"ID":"1583b12e-28e8-48a7-bd49-739114154b32","Type":"ContainerStarted","Data":"75466d60a51b7f22ba20cf75984b42643ce0629b48a0508e668813465c885a99"}
Jul 02 19:13:23.384118 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:23.384083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" event={"ID":"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3","Type":"ContainerStarted","Data":"c70435ca3531e0a12a0f7c7b8c74fae21c9b2548069275b8a9a36eaf1f45e95e"}
Jul 02 19:13:25.395282 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.395247    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-s2rjc" event={"ID":"1583b12e-28e8-48a7-bd49-739114154b32","Type":"ContainerStarted","Data":"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"}
Jul 02 19:13:25.395744 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.395377    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:25.396895 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.396866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" event={"ID":"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3","Type":"ContainerStarted","Data":"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"}
Jul 02 19:13:25.397029 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.396928    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:25.423573 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.423527    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77955f86f7-s2rjc" podStartSLOduration=1.517852625 podStartE2EDuration="3.423511534s" totalImagesPullingTime="1.905658909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:25.422011156 +0000 UTC m=+708.394672311" watchObservedRunningTime="2026-07-02 19:13:25.423511534 +0000 UTC m=+708.396172688"
Jul 02 19:13:25.451449 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:25.451400    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" podStartSLOduration=1.344118082 podStartE2EDuration="3.45138085s" totalImagesPullingTime="2.107262768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:25.449622476 +0000 UTC m=+708.422283631" watchObservedRunningTime="2026-07-02 19:13:25.45138085 +0000 UTC m=+708.424042004"
Jul 02 19:13:36.408729 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.408654    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:36.409284 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.409263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:13:36.517624 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.517594    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:36.517820 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.517794    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" podUID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" containerName="manager" containerID="cri-o://e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33" gracePeriod=30
Jul 02 19:13:36.755357 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.755327    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:36.834675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.834650    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gdqw\" (UniqueName: \"kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw\") pod \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") "
Jul 02 19:13:36.834855 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.834687    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert\") pod \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\" (UID: \"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3\") "
Jul 02 19:13:36.836868 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.836817    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" (UID: "f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:13:36.837000 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.836900    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw" (OuterVolumeSpecName: "kube-api-access-9gdqw") pod "f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" (UID: "f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3"). InnerVolumeSpecName "kube-api-access-9gdqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:36.935712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.935624    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gdqw\" (UniqueName: \"kubernetes.io/projected/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-kube-api-access-9gdqw\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:13:36.935712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:36.935655    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3-webhook-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:13:37.451827 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.451787    2569 generic.go:356] "Generic (PLEG): container finished" podID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" containerID="e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33" exitCode=0
Jul 02 19:13:37.452221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.451869    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf"
Jul 02 19:13:37.452221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.451877    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" event={"ID":"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3","Type":"ContainerDied","Data":"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"}
Jul 02 19:13:37.452221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.451961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf8fcfd79-bbmtf" event={"ID":"f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3","Type":"ContainerDied","Data":"c70435ca3531e0a12a0f7c7b8c74fae21c9b2548069275b8a9a36eaf1f45e95e"}
Jul 02 19:13:37.452221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.451984    2569 scope.go:117] "RemoveContainer" containerID="e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"
Jul 02 19:13:37.460439 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.460423    2569 scope.go:117] "RemoveContainer" containerID="e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"
Jul 02 19:13:37.460693 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:13:37.460673    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33\": container with ID starting with e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33 not found: ID does not exist" containerID="e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"
Jul 02 19:13:37.460766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.460706    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33"} err="failed to get container status \"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33\": rpc error: code = NotFound desc = could not find container \"e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33\": container with ID starting with e7095b3b36cf4341d14c87172c9a1595762ce43e45e2b8856b8e25c28e411e33 not found: ID does not exist"
Jul 02 19:13:37.484780 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.484757    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:37.488766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.488746    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bf8fcfd79-bbmtf"]
Jul 02 19:13:37.728167 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:37.728108    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" path="/var/lib/kubelet/pods/f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3/volumes"
Jul 02 19:13:54.558711 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.558679    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-74ddc86c7d-cc2lz"]
Jul 02 19:13:54.559153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.559085    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" containerName="manager"
Jul 02 19:13:54.559153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.559102    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" containerName="manager"
Jul 02 19:13:54.559240 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.559168    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b1fdd1-3c4d-4c0c-9220-1b73e5456bc3" containerName="manager"
Jul 02 19:13:54.579944 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.579915    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74ddc86c7d-cc2lz"]
Jul 02 19:13:54.580078 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.580005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.582977 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.582936    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n2w8x\""
Jul 02 19:13:54.583168 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.583150    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 19:13:54.679245 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.679217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-maas-api-tls\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.679430 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.679288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-openshift-service-ca\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.679430 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.679347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7qz\" (UniqueName: \"kubernetes.io/projected/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-kube-api-access-cz7qz\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.780106 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.780076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-openshift-service-ca\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.780246 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.780119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7qz\" (UniqueName: \"kubernetes.io/projected/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-kube-api-access-cz7qz\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.780246 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.780154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-maas-api-tls\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.780810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.780752    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-openshift-service-ca\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.782831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.782809    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-maas-api-tls\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.790389 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.790366    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7qz\" (UniqueName: \"kubernetes.io/projected/1702e2c8-0fa8-4a79-9952-709e2ba8d7e9-kube-api-access-cz7qz\") pod \"maas-api-74ddc86c7d-cc2lz\" (UID: \"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9\") " pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:54.892315 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:54.892260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:55.025413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.025389    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74ddc86c7d-cc2lz"]
Jul 02 19:13:55.026855 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:13:55.026811    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1702e2c8_0fa8_4a79_9952_709e2ba8d7e9.slice/crio-2aac6bfe418da17e4d22ea2937bcd6e627a4c9621a168f7a372a529823d83d94 WatchSource:0}: Error finding container 2aac6bfe418da17e4d22ea2937bcd6e627a4c9621a168f7a372a529823d83d94: Status 404 returned error can't find the container with id 2aac6bfe418da17e4d22ea2937bcd6e627a4c9621a168f7a372a529823d83d94
Jul 02 19:13:55.041942 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.041917    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wfxrh"]
Jul 02 19:13:55.044890 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.044872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.047208 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.047187    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 19:13:55.056034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.056012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wfxrh"]
Jul 02 19:13:55.082196 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.082171    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kzjh5"]
Jul 02 19:13:55.084566 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.084550    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.087050 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.087033    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k7z95\""
Jul 02 19:13:55.097681 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.097663    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kzjh5"]
Jul 02 19:13:55.184346 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.184225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g57p\" (UniqueName: \"kubernetes.io/projected/714f7a99-7290-4748-8059-639331219a5c-kube-api-access-7g57p\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.184499 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.184389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx58q\" (UniqueName: \"kubernetes.io/projected/01f12fc7-d607-431b-945d-3bc799f388dd-kube-api-access-bx58q\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.184499 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.184456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f12fc7-d607-431b-945d-3bc799f388dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.184631 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.184539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/714f7a99-7290-4748-8059-639331219a5c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.285858 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.285818    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/714f7a99-7290-4748-8059-639331219a5c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.286014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.285888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g57p\" (UniqueName: \"kubernetes.io/projected/714f7a99-7290-4748-8059-639331219a5c-kube-api-access-7g57p\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.286014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.285952    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx58q\" (UniqueName: \"kubernetes.io/projected/01f12fc7-d607-431b-945d-3bc799f388dd-kube-api-access-bx58q\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.286014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.285988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f12fc7-d607-431b-945d-3bc799f388dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.286648 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.286628    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/714f7a99-7290-4748-8059-639331219a5c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.286700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.286646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f12fc7-d607-431b-945d-3bc799f388dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.294571 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.294552    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx58q\" (UniqueName: \"kubernetes.io/projected/01f12fc7-d607-431b-945d-3bc799f388dd-kube-api-access-bx58q\") pod \"payload-processing-58f86c7798-kzjh5\" (UID: \"01f12fc7-d607-431b-945d-3bc799f388dd\") " pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.294675 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.294630    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g57p\" (UniqueName: \"kubernetes.io/projected/714f7a99-7290-4748-8059-639331219a5c-kube-api-access-7g57p\") pod \"payload-pre-processing-7964457696-wfxrh\" (UID: \"714f7a99-7290-4748-8059-639331219a5c\") " pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.356297 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.356272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:55.393409 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.393374    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:55.507812 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.507389    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wfxrh"]
Jul 02 19:13:55.549457 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.549419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74ddc86c7d-cc2lz" event={"ID":"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9","Type":"ContainerStarted","Data":"2aac6bfe418da17e4d22ea2937bcd6e627a4c9621a168f7a372a529823d83d94"}
Jul 02 19:13:55.551076 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.551051    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh" event={"ID":"714f7a99-7290-4748-8059-639331219a5c","Type":"ContainerStarted","Data":"bd98ac1ca4d318a44ecb2e626aa38d32ec3e84a8d7a2722996387090c8d51509"}
Jul 02 19:13:55.572639 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:55.572613    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kzjh5"]
Jul 02 19:13:55.574045 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:13:55.574023    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f12fc7_d607_431b_945d_3bc799f388dd.slice/crio-e0ce43f0d23f3d63888e375d35d957100ee9db810d37a367b17b32a14e35d772 WatchSource:0}: Error finding container e0ce43f0d23f3d63888e375d35d957100ee9db810d37a367b17b32a14e35d772: Status 404 returned error can't find the container with id e0ce43f0d23f3d63888e375d35d957100ee9db810d37a367b17b32a14e35d772
Jul 02 19:13:56.560406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:56.560369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5" event={"ID":"01f12fc7-d607-431b-945d-3bc799f388dd","Type":"ContainerStarted","Data":"e0ce43f0d23f3d63888e375d35d957100ee9db810d37a367b17b32a14e35d772"}
Jul 02 19:13:58.577029 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.576993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74ddc86c7d-cc2lz" event={"ID":"1702e2c8-0fa8-4a79-9952-709e2ba8d7e9","Type":"ContainerStarted","Data":"852abf97e35eb41f6b7b34a14b2d3e5dbab164e1df2140f607fecb81034e2ea7"}
Jul 02 19:13:58.577503 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.577125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:13:58.578439 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.578415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh" event={"ID":"714f7a99-7290-4748-8059-639331219a5c","Type":"ContainerStarted","Data":"07220f9742520beed5d49a364dbb23742e166d07ec5dd3941b02c2883c55e477"}
Jul 02 19:13:58.578555 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.578467    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:13:58.579768 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.579749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5" event={"ID":"01f12fc7-d607-431b-945d-3bc799f388dd","Type":"ContainerStarted","Data":"98f95cf0f3747557627aa3c7d3f8b885331edff8a9e4e82a785f3bae082ccd55"}
Jul 02 19:13:58.579896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.579881    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:13:58.595425 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.595387    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-74ddc86c7d-cc2lz" podStartSLOduration=2.11851804 podStartE2EDuration="4.595374401s" totalImagesPullingTime="2.476856361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:58.59357443 +0000 UTC m=+741.566235585" watchObservedRunningTime="2026-07-02 19:13:58.595374401 +0000 UTC m=+741.568035554"
Jul 02 19:13:58.642992 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.642933    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh" podStartSLOduration=1.639722607 podStartE2EDuration="3.642914269s" totalImagesPullingTime="2.003191662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:58.623894552 +0000 UTC m=+741.596555706" watchObservedRunningTime="2026-07-02 19:13:58.642914269 +0000 UTC m=+741.615575423"
Jul 02 19:13:58.643366 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:13:58.643334    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5" podStartSLOduration=1.720709324 podStartE2EDuration="3.643325332s" totalImagesPullingTime="1.922616008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:58.641815621 +0000 UTC m=+741.614476778" watchObservedRunningTime="2026-07-02 19:13:58.643325332 +0000 UTC m=+741.615986546"
Jul 02 19:14:02.601606 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.601575    2569 generic.go:356] "Generic (PLEG): container finished" podID="cf0eb511-558a-4c30-81fa-88cfd3912b70" containerID="346883ce5969e5eb3b36c40f276e786fe3112cfa7536a99708d936878abefc0d" exitCode=0
Jul 02 19:14:02.601947 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.601653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" event={"ID":"cf0eb511-558a-4c30-81fa-88cfd3912b70","Type":"ContainerDied","Data":"346883ce5969e5eb3b36c40f276e786fe3112cfa7536a99708d936878abefc0d"}
Jul 02 19:14:02.602153 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.602137    2569 scope.go:117] "RemoveContainer" containerID="346883ce5969e5eb3b36c40f276e786fe3112cfa7536a99708d936878abefc0d"
Jul 02 19:14:02.603176 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.603146    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:14:02.603252 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.603235    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:14:02.603288 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:02.603278    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:14:03.610523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:03.610480    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" event={"ID":"cf0eb511-558a-4c30-81fa-88cfd3912b70","Type":"ContainerStarted","Data":"b4873d81d896142c1f49ceecd55cb2334119a6caa1e5a0dccdf778586525bac6"}
Jul 02 19:14:04.211948 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:04.211898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:14:04.212197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:04.212167    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ldpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 19:14:04.212277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:04.212230    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" podUID="cf0eb511-558a-4c30-81fa-88cfd3912b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 19:14:04.590138 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:04.590107    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-74ddc86c7d-cc2lz"
Jul 02 19:14:05.211834 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:05.211793    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ldpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 19:14:05.212465 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:05.212430    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" podUID="cf0eb511-558a-4c30-81fa-88cfd3912b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 19:14:06.212112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:06.212065    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ldpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 19:14:06.212614 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:06.212135    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" podUID="cf0eb511-558a-4c30-81fa-88cfd3912b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 19:14:07.212237 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:07.212199    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ldpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 19:14:07.212867 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:07.212805    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl" podUID="cf0eb511-558a-4c30-81fa-88cfd3912b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 19:14:08.215428 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:08.215397    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:14:08.215935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:08.215830    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:14:08.216598 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:08.216576    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ldpfl"
Jul 02 19:14:09.587436 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:09.587404    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-kzjh5"
Jul 02 19:14:09.587880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:09.587863    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-wfxrh"
Jul 02 19:14:15.746040 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.746006    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"]
Jul 02 19:14:15.749179 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.749157    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.751984 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.751962    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 02 19:14:15.752112 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.751989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 19:14:15.752917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.752900    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 19:14:15.753011 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.752947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwxgv\""
Jul 02 19:14:15.762307 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.762285    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"]
Jul 02 19:14:15.766525 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rx99\" (UniqueName: \"kubernetes.io/projected/6a33df26-413c-4890-b1cf-fbfed952b95c-kube-api-access-8rx99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.766640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.766640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a33df26-413c-4890-b1cf-fbfed952b95c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.766713 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.766713 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.766784 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.766769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867208 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rx99\" (UniqueName: \"kubernetes.io/projected/6a33df26-413c-4890-b1cf-fbfed952b95c-kube-api-access-8rx99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867208 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867450 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a33df26-413c-4890-b1cf-fbfed952b95c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867450 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867450 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867450 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867658 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867632    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867703 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867668    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.867743 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.867720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.869643 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.869621    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a33df26-413c-4890-b1cf-fbfed952b95c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.870044 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.870023    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a33df26-413c-4890-b1cf-fbfed952b95c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:15.875888 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:15.875864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rx99\" (UniqueName: \"kubernetes.io/projected/6a33df26-413c-4890-b1cf-fbfed952b95c-kube-api-access-8rx99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm\" (UID: \"6a33df26-413c-4890-b1cf-fbfed952b95c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:16.060936 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:16.060899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:16.199662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:16.199638    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"]
Jul 02 19:14:16.202291 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:14:16.202257    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a33df26_413c_4890_b1cf_fbfed952b95c.slice/crio-f84761bfe75b99ba84e94f5acde99d783480b43d20cdec19faf82766e1fe6904 WatchSource:0}: Error finding container f84761bfe75b99ba84e94f5acde99d783480b43d20cdec19faf82766e1fe6904: Status 404 returned error can't find the container with id f84761bfe75b99ba84e94f5acde99d783480b43d20cdec19faf82766e1fe6904
Jul 02 19:14:16.682407 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:16.682367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm" event={"ID":"6a33df26-413c-4890-b1cf-fbfed952b95c","Type":"ContainerStarted","Data":"f84761bfe75b99ba84e94f5acde99d783480b43d20cdec19faf82766e1fe6904"}
Jul 02 19:14:17.688456 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:17.688417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm" event={"ID":"6a33df26-413c-4890-b1cf-fbfed952b95c","Type":"ContainerStarted","Data":"bbf644d91b68001f33e33a06c780d478556f1792317234a6f94d56bcb948d1c7"}
Jul 02 19:14:17.705945 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:17.705890    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm" podStartSLOduration=1.692836066 podStartE2EDuration="2.705872895s" totalImagesPullingTime="1.013036829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:17.705779661 +0000 UTC m=+760.678440815" watchObservedRunningTime="2026-07-02 19:14:17.705872895 +0000 UTC m=+760.678534043"
Jul 02 19:14:26.061288 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:26.061240    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:26.061932 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:26.061315    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:26.074236 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:26.074203    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:26.752302 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:26.752270    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm"
Jul 02 19:14:29.760867 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.760825    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"]
Jul 02 19:14:29.766326 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.766304    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.773283 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.773267    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 19:14:29.777549 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.777525    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"]
Jul 02 19:14:29.885669 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.885669 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/a6bbbd5b-ca11-4f96-87bb-9255e2934250-kube-api-access-8jcw2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.885826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.885826 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.885920 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.885920 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.885884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986387 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/a6bbbd5b-ca11-4f96-87bb-9255e2934250-kube-api-access-8jcw2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986642 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986860 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986983 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986904    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.986983 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.986939    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.988553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.988527    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bbbd5b-ca11-4f96-87bb-9255e2934250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:29.988837 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:29.988820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bbbd5b-ca11-4f96-87bb-9255e2934250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:30.000641 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.000615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/a6bbbd5b-ca11-4f96-87bb-9255e2934250-kube-api-access-8jcw2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7g4zs\" (UID: \"a6bbbd5b-ca11-4f96-87bb-9255e2934250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:30.076662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.076630    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:30.207894 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.207832    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"]
Jul 02 19:14:30.208952 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:14:30.208924    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bbbd5b_ca11_4f96_87bb_9255e2934250.slice/crio-a0207abfc3a9227b1365cec7823a2dded689ac90d863faec63fa535a614d3396 WatchSource:0}: Error finding container a0207abfc3a9227b1365cec7823a2dded689ac90d863faec63fa535a614d3396: Status 404 returned error can't find the container with id a0207abfc3a9227b1365cec7823a2dded689ac90d863faec63fa535a614d3396
Jul 02 19:14:30.759710 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.759614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs" event={"ID":"a6bbbd5b-ca11-4f96-87bb-9255e2934250","Type":"ContainerStarted","Data":"fc3e7865f52d8c6ee467aa2b64cc8f2ef804771f2370d7b211f48d9a9b8040fb"}
Jul 02 19:14:30.759710 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.759673    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs" event={"ID":"a6bbbd5b-ca11-4f96-87bb-9255e2934250","Type":"ContainerStarted","Data":"a0207abfc3a9227b1365cec7823a2dded689ac90d863faec63fa535a614d3396"}
Jul 02 19:14:30.780023 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:30.779972    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs" podStartSLOduration=1.60110506 podStartE2EDuration="1.779956066s" totalImagesPullingTime="178.851006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:30.77764517 +0000 UTC m=+773.750306325" watchObservedRunningTime="2026-07-02 19:14:30.779956066 +0000 UTC m=+773.752617219"
Jul 02 19:14:40.077264 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:40.077226    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:40.077720 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:40.077318    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:40.090081 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:40.090060    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:40.828814 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:40.828784    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7g4zs"
Jul 02 19:14:42.742773 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.742739    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"]
Jul 02 19:14:42.746531 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.746511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.748909 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.748820    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 19:14:42.757364 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.757170    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"]
Jul 02 19:14:42.902699 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsngl\" (UniqueName: \"kubernetes.io/projected/512d53ae-f6ed-43a5-8783-d7b9e861980a-kube-api-access-vsngl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.902880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.902880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.902880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902798    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.902880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:42.902880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:42.902863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512d53ae-f6ed-43a5-8783-d7b9e861980a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004481 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004481 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512d53ae-f6ed-43a5-8783-d7b9e861980a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsngl\" (UniqueName: \"kubernetes.io/projected/512d53ae-f6ed-43a5-8783-d7b9e861980a-kube-api-access-vsngl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.004947 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.004907    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.005067 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.005037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.005157 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.005135    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.006808 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.006785    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512d53ae-f6ed-43a5-8783-d7b9e861980a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.007138 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.007120    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512d53ae-f6ed-43a5-8783-d7b9e861980a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.013619 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.013595    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsngl\" (UniqueName: \"kubernetes.io/projected/512d53ae-f6ed-43a5-8783-d7b9e861980a-kube-api-access-vsngl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz\" (UID: \"512d53ae-f6ed-43a5-8783-d7b9e861980a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.062295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.062269    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:43.208672 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.208645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"]
Jul 02 19:14:43.211062 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:14:43.211022    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512d53ae_f6ed_43a5_8783_d7b9e861980a.slice/crio-9c9529295c15b5978a1b39de3c507e60d582eeb5b4b74c9a67d7ed0d3af201e3 WatchSource:0}: Error finding container 9c9529295c15b5978a1b39de3c507e60d582eeb5b4b74c9a67d7ed0d3af201e3: Status 404 returned error can't find the container with id 9c9529295c15b5978a1b39de3c507e60d582eeb5b4b74c9a67d7ed0d3af201e3
Jul 02 19:14:43.833625 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.833589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz" event={"ID":"512d53ae-f6ed-43a5-8783-d7b9e861980a","Type":"ContainerStarted","Data":"9fb32814da32fa5999138ce2de296c3a5225cb6d67827512355fd971db41028f"}
Jul 02 19:14:43.834033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.833645    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz" event={"ID":"512d53ae-f6ed-43a5-8783-d7b9e861980a","Type":"ContainerStarted","Data":"9c9529295c15b5978a1b39de3c507e60d582eeb5b4b74c9a67d7ed0d3af201e3"}
Jul 02 19:14:43.851955 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:43.851908    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz" podStartSLOduration=1.656971413 podStartE2EDuration="1.851892598s" totalImagesPullingTime="194.921185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:43.850177525 +0000 UTC m=+786.822838676" watchObservedRunningTime="2026-07-02 19:14:43.851892598 +0000 UTC m=+786.824553751"
Jul 02 19:14:53.063281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:53.063230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:53.063678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:53.063349    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:53.075918 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:53.075891    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:14:53.900883 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:14:53.900831    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz"
Jul 02 19:16:37.546663 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:16:37.546581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:16:37.549898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:16:37.549877    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:17:45.170392 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.170353    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:17:45.170942 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.170593    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77955f86f7-s2rjc" podUID="1583b12e-28e8-48a7-bd49-739114154b32" containerName="manager" containerID="cri-o://a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd" gracePeriod=30
Jul 02 19:17:45.432774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.432706    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:17:45.533808 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.533756    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert\") pod \"1583b12e-28e8-48a7-bd49-739114154b32\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") "
Jul 02 19:17:45.533808 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.533824    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjrmj\" (UniqueName: \"kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj\") pod \"1583b12e-28e8-48a7-bd49-739114154b32\" (UID: \"1583b12e-28e8-48a7-bd49-739114154b32\") "
Jul 02 19:17:45.535935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.535895    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj" (OuterVolumeSpecName: "kube-api-access-jjrmj") pod "1583b12e-28e8-48a7-bd49-739114154b32" (UID: "1583b12e-28e8-48a7-bd49-739114154b32"). InnerVolumeSpecName "kube-api-access-jjrmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:17:45.535935 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.535895    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1583b12e-28e8-48a7-bd49-739114154b32" (UID: "1583b12e-28e8-48a7-bd49-739114154b32"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:17:45.635541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.635502    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583b12e-28e8-48a7-bd49-739114154b32-webhook-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:17:45.635541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.635533    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjrmj\" (UniqueName: \"kubernetes.io/projected/1583b12e-28e8-48a7-bd49-739114154b32-kube-api-access-jjrmj\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:17:45.741596 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.741567    2569 generic.go:356] "Generic (PLEG): container finished" podID="1583b12e-28e8-48a7-bd49-739114154b32" containerID="a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd" exitCode=0
Jul 02 19:17:45.741724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.741611    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-s2rjc"
Jul 02 19:17:45.741724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.741653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-s2rjc" event={"ID":"1583b12e-28e8-48a7-bd49-739114154b32","Type":"ContainerDied","Data":"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"}
Jul 02 19:17:45.741724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.741701    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-s2rjc" event={"ID":"1583b12e-28e8-48a7-bd49-739114154b32","Type":"ContainerDied","Data":"75466d60a51b7f22ba20cf75984b42643ce0629b48a0508e668813465c885a99"}
Jul 02 19:17:45.741724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.741723    2569 scope.go:117] "RemoveContainer" containerID="a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"
Jul 02 19:17:45.750461 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.750443    2569 scope.go:117] "RemoveContainer" containerID="a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"
Jul 02 19:17:45.750712 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:17:45.750694    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd\": container with ID starting with a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd not found: ID does not exist" containerID="a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"
Jul 02 19:17:45.750765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.750722    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd"} err="failed to get container status \"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd\": rpc error: code = NotFound desc = could not find container \"a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd\": container with ID starting with a22f0c99398fe538f784c9d20b0854855e404cbb80968715cce85a7d3700aacd not found: ID does not exist"
Jul 02 19:17:45.757440 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.757417    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:17:45.761331 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:45.761306    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77955f86f7-s2rjc"]
Jul 02 19:17:46.549684 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.549647    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77955f86f7-dpg2n"]
Jul 02 19:17:46.550094 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.550066    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1583b12e-28e8-48a7-bd49-739114154b32" containerName="manager"
Jul 02 19:17:46.550094 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.550078    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1583b12e-28e8-48a7-bd49-739114154b32" containerName="manager"
Jul 02 19:17:46.550169 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.550140    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1583b12e-28e8-48a7-bd49-739114154b32" containerName="manager"
Jul 02 19:17:46.554497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.554474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.557966 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.557942    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 19:17:46.558381 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.558359    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 19:17:46.558762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.558745    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nb5h2\""
Jul 02 19:17:46.565653 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.565630    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77955f86f7-dpg2n"]
Jul 02 19:17:46.646088 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.646048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc126a82-7fb4-45bb-acd7-1198046655d3-webhook-cert\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.646253 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.646171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jpg9\" (UniqueName: \"kubernetes.io/projected/bc126a82-7fb4-45bb-acd7-1198046655d3-kube-api-access-2jpg9\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.746789 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.746753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jpg9\" (UniqueName: \"kubernetes.io/projected/bc126a82-7fb4-45bb-acd7-1198046655d3-kube-api-access-2jpg9\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.747001 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.746878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc126a82-7fb4-45bb-acd7-1198046655d3-webhook-cert\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.749544 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.749516    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc126a82-7fb4-45bb-acd7-1198046655d3-webhook-cert\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.755762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.755737    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jpg9\" (UniqueName: \"kubernetes.io/projected/bc126a82-7fb4-45bb-acd7-1198046655d3-kube-api-access-2jpg9\") pod \"maas-controller-77955f86f7-dpg2n\" (UID: \"bc126a82-7fb4-45bb-acd7-1198046655d3\") " pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:46.873146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:46.873051    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:47.009101 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.008872    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77955f86f7-dpg2n"]
Jul 02 19:17:47.011368 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:17:47.011340    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc126a82_7fb4_45bb_acd7_1198046655d3.slice/crio-3c95ff7dc0bbd4e66563e8aa1f8eddd72eb1b45c5de914ed0858bd79abb6328b WatchSource:0}: Error finding container 3c95ff7dc0bbd4e66563e8aa1f8eddd72eb1b45c5de914ed0858bd79abb6328b: Status 404 returned error can't find the container with id 3c95ff7dc0bbd4e66563e8aa1f8eddd72eb1b45c5de914ed0858bd79abb6328b
Jul 02 19:17:47.731190 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.731108    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1583b12e-28e8-48a7-bd49-739114154b32" path="/var/lib/kubelet/pods/1583b12e-28e8-48a7-bd49-739114154b32/volumes"
Jul 02 19:17:47.754736 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.754699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-dpg2n" event={"ID":"bc126a82-7fb4-45bb-acd7-1198046655d3","Type":"ContainerStarted","Data":"0f5c03a317718ccb15ae3c43d83b487c29c1f1575dc6898f994eefe223273a0b"}
Jul 02 19:17:47.754894 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.754756    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77955f86f7-dpg2n" event={"ID":"bc126a82-7fb4-45bb-acd7-1198046655d3","Type":"ContainerStarted","Data":"3c95ff7dc0bbd4e66563e8aa1f8eddd72eb1b45c5de914ed0858bd79abb6328b"}
Jul 02 19:17:47.754894 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.754806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:17:47.772375 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:47.772318    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77955f86f7-dpg2n" podStartSLOduration=1.312939453 podStartE2EDuration="1.77230282s" totalImagesPullingTime="459.363367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:17:47.770553045 +0000 UTC m=+970.743214202" watchObservedRunningTime="2026-07-02 19:17:47.77230282 +0000 UTC m=+970.744963973"
Jul 02 19:17:58.765457 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:17:58.765364    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77955f86f7-dpg2n"
Jul 02 19:21:37.581855 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:21:37.581810    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:21:37.586552 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:21:37.586531    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:26:37.610667 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:26:37.610635    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:26:37.616798 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:26:37.616774    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:30:00.157260 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.157228    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-ndlbb"]
Jul 02 19:30:00.160645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.160628    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:00.184946 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.184918    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-ndlbb"]
Jul 02 19:30:00.275162 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.275132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwk9s\" (UniqueName: \"kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s\") pod \"maas-api-key-cleanup-29717010-ndlbb\" (UID: \"3b5c5300-57d1-4d22-b701-1e82dc289588\") " pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:00.376042 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.376003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwk9s\" (UniqueName: \"kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s\") pod \"maas-api-key-cleanup-29717010-ndlbb\" (UID: \"3b5c5300-57d1-4d22-b701-1e82dc289588\") " pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:00.388956 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.388922    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwk9s\" (UniqueName: \"kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s\") pod \"maas-api-key-cleanup-29717010-ndlbb\" (UID: \"3b5c5300-57d1-4d22-b701-1e82dc289588\") " pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:00.470963 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.470874    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:00.614436 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.614411    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-ndlbb"]
Jul 02 19:30:00.616338 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:30:00.616312    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5c5300_57d1_4d22_b701_1e82dc289588.slice/crio-a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a WatchSource:0}: Error finding container a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a: Status 404 returned error can't find the container with id a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a
Jul 02 19:30:00.618580 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:00.618563    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:30:01.172280 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.172242    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:01.177499 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.177474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.180546 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.180522    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-53a62efa-serving-cert\""
Jul 02 19:30:01.191079 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.191053    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:01.285278 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.285240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.285452 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.285301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.285452 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.285361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppnz\" (UniqueName: \"kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.386500 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.386466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppnz\" (UniqueName: \"kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.386686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.386535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.386686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.386577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.387128 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.387106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.388999 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.388977    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.396998 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.396970    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppnz\" (UniqueName: \"kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz\") pod \"maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") " pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.403191 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.403161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb" event={"ID":"3b5c5300-57d1-4d22-b701-1e82dc289588","Type":"ContainerStarted","Data":"a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a"}
Jul 02 19:30:01.489502 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.489409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:01.630963 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:01.630939    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:01.633895 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:30:01.633866    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c301f96_aba8_45cf_97e1_c2bb33685aa0.slice/crio-a075e3444289e5677904a229833d6b604fa551d66b09a682079db40aa8c9c50a WatchSource:0}: Error finding container a075e3444289e5677904a229833d6b604fa551d66b09a682079db40aa8c9c50a: Status 404 returned error can't find the container with id a075e3444289e5677904a229833d6b604fa551d66b09a682079db40aa8c9c50a
Jul 02 19:30:02.412262 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:02.412223    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" event={"ID":"3c301f96-aba8-45cf-97e1-c2bb33685aa0","Type":"ContainerStarted","Data":"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"}
Jul 02 19:30:02.412707 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:02.412286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" event={"ID":"3c301f96-aba8-45cf-97e1-c2bb33685aa0","Type":"ContainerStarted","Data":"a075e3444289e5677904a229833d6b604fa551d66b09a682079db40aa8c9c50a"}
Jul 02 19:30:02.412707 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:02.412372    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:02.430697 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:02.430602    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" podStartSLOduration=0.899285174 podStartE2EDuration="1.430581335s" totalImagesPullingTime="531.296161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:02.429063819 +0000 UTC m=+1705.401724982" watchObservedRunningTime="2026-07-02 19:30:02.430581335 +0000 UTC m=+1705.403242491"
Jul 02 19:30:03.418467 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:03.418428    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb" event={"ID":"3b5c5300-57d1-4d22-b701-1e82dc289588","Type":"ContainerStarted","Data":"7694a0abef3a5552f51f65313748aa02cb3cdffe99142d3bbc419f0c119e63dd"}
Jul 02 19:30:03.433073 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:03.433025    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb" podStartSLOduration=0.957564143 podStartE2EDuration="3.433008809s" totalImagesPullingTime="2.475444666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:03.432369769 +0000 UTC m=+1706.405030921" watchObservedRunningTime="2026-07-02 19:30:03.433008809 +0000 UTC m=+1706.405669964"
Jul 02 19:30:04.425656 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:04.425619    2569 generic.go:356] "Generic (PLEG): container finished" podID="3b5c5300-57d1-4d22-b701-1e82dc289588" containerID="7694a0abef3a5552f51f65313748aa02cb3cdffe99142d3bbc419f0c119e63dd" exitCode=0
Jul 02 19:30:04.426129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:04.425705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb" event={"ID":"3b5c5300-57d1-4d22-b701-1e82dc289588","Type":"ContainerDied","Data":"7694a0abef3a5552f51f65313748aa02cb3cdffe99142d3bbc419f0c119e63dd"}
Jul 02 19:30:05.568298 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:05.568273    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:05.726335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:05.726242    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwk9s\" (UniqueName: \"kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s\") pod \"3b5c5300-57d1-4d22-b701-1e82dc289588\" (UID: \"3b5c5300-57d1-4d22-b701-1e82dc289588\") "
Jul 02 19:30:05.728412 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:05.728378    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s" (OuterVolumeSpecName: "kube-api-access-lwk9s") pod "3b5c5300-57d1-4d22-b701-1e82dc289588" (UID: "3b5c5300-57d1-4d22-b701-1e82dc289588"). InnerVolumeSpecName "kube-api-access-lwk9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:05.827957 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:05.827928    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwk9s\" (UniqueName: \"kubernetes.io/projected/3b5c5300-57d1-4d22-b701-1e82dc289588-kube-api-access-lwk9s\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:06.438341 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.438312    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb"
Jul 02 19:30:06.438525 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.438375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-ndlbb" event={"ID":"3b5c5300-57d1-4d22-b701-1e82dc289588","Type":"ContainerDied","Data":"a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a"}
Jul 02 19:30:06.438525 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.438421    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a03c21dbcb8e7b33b8fd7308fb53d2707489bc94d3825996e58a446c7e29368a"
Jul 02 19:30:06.544197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.544157    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:06.544652 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.544617    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" podUID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" containerName="maas-api" containerID="cri-o://596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47" gracePeriod=30
Jul 02 19:30:06.789132 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.789106    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:06.938001 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.937965    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qppnz\" (UniqueName: \"kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz\") pod \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") "
Jul 02 19:30:06.938001 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.938006    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls\") pod \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") "
Jul 02 19:30:06.938206 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.938075    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca\") pod \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\" (UID: \"3c301f96-aba8-45cf-97e1-c2bb33685aa0\") "
Jul 02 19:30:06.938468 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.938446    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c301f96-aba8-45cf-97e1-c2bb33685aa0" (UID: "3c301f96-aba8-45cf-97e1-c2bb33685aa0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:30:06.940136 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.940112    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c301f96-aba8-45cf-97e1-c2bb33685aa0" (UID: "3c301f96-aba8-45cf-97e1-c2bb33685aa0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:30:06.940240 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:06.940143    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz" (OuterVolumeSpecName: "kube-api-access-qppnz") pod "3c301f96-aba8-45cf-97e1-c2bb33685aa0" (UID: "3c301f96-aba8-45cf-97e1-c2bb33685aa0"). InnerVolumeSpecName "kube-api-access-qppnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:07.038896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.038831    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qppnz\" (UniqueName: \"kubernetes.io/projected/3c301f96-aba8-45cf-97e1-c2bb33685aa0-kube-api-access-qppnz\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:07.038896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.038884    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c301f96-aba8-45cf-97e1-c2bb33685aa0-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:07.038896 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.038893    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c301f96-aba8-45cf-97e1-c2bb33685aa0-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:07.444274 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.444176    2569 generic.go:356] "Generic (PLEG): container finished" podID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" containerID="596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47" exitCode=0
Jul 02 19:30:07.444274 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.444223    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"
Jul 02 19:30:07.444497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.444266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" event={"ID":"3c301f96-aba8-45cf-97e1-c2bb33685aa0","Type":"ContainerDied","Data":"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"}
Jul 02 19:30:07.444497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.444335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4" event={"ID":"3c301f96-aba8-45cf-97e1-c2bb33685aa0","Type":"ContainerDied","Data":"a075e3444289e5677904a229833d6b604fa551d66b09a682079db40aa8c9c50a"}
Jul 02 19:30:07.444497 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.444357    2569 scope.go:117] "RemoveContainer" containerID="596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"
Jul 02 19:30:07.454069 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.454050    2569 scope.go:117] "RemoveContainer" containerID="596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"
Jul 02 19:30:07.454429 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:07.454409    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47\": container with ID starting with 596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47 not found: ID does not exist" containerID="596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"
Jul 02 19:30:07.454470 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.454441    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47"} err="failed to get container status \"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47\": rpc error: code = NotFound desc = could not find container \"596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47\": container with ID starting with 596d037f97a21e762381ee2ca18621c9874931791988df83951a6dfaf872cb47 not found: ID does not exist"
Jul 02 19:30:07.466328 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.466293    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:07.469790 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.469766    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-53a62efa-54b78f7658-mv6b4"]
Jul 02 19:30:07.730125 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:07.730043    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" path="/var/lib/kubelet/pods/3c301f96-aba8-45cf-97e1-c2bb33685aa0/volumes"
Jul 02 19:30:13.506487 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.506449    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:13.507104 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507081    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b5c5300-57d1-4d22-b701-1e82dc289588" containerName="cleanup"
Jul 02 19:30:13.507197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507106    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5c5300-57d1-4d22-b701-1e82dc289588" containerName="cleanup"
Jul 02 19:30:13.507197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507133    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" containerName="maas-api"
Jul 02 19:30:13.507197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507143    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" containerName="maas-api"
Jul 02 19:30:13.507344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507242    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b5c5300-57d1-4d22-b701-1e82dc289588" containerName="cleanup"
Jul 02 19:30:13.507344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.507254    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c301f96-aba8-45cf-97e1-c2bb33685aa0" containerName="maas-api"
Jul 02 19:30:13.510631 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.510611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.516582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.516562    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-40a50560-openshift-default-dockercfg-x2jp2\""
Jul 02 19:30:13.532044 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.532022    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:13.600196 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600222    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdf5\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.600490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.600442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701461 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701461 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701461 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701625 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701752 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.701857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.701831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdf5\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.702200 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.702172    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.702290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.702171    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.702376 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.702357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.702540 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.702518    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.704200 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.704171    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.704353 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.704297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.710786 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.710765    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.711154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.711134    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdf5\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5\") pod \"e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") " pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.821919 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.821880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:13.963067 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.963027    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:13.966103 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:30:13.966070    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30b1d73_5c88_41f7_9619_bd0bc2cfa798.slice/crio-2ad6518438bcd52639326e866603f7a54cb3284aa2b430653a9a1306ee089a42 WatchSource:0}: Error finding container 2ad6518438bcd52639326e866603f7a54cb3284aa2b430653a9a1306ee089a42: Status 404 returned error can't find the container with id 2ad6518438bcd52639326e866603f7a54cb3284aa2b430653a9a1306ee089a42
Jul 02 19:30:13.968185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.968151    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:13.968275 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.968217    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:13.968275 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:13.968252    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:14.482604 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.482563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerStarted","Data":"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"}
Jul 02 19:30:14.482793 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.482633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerStarted","Data":"2ad6518438bcd52639326e866603f7a54cb3284aa2b430653a9a1306ee089a42"}
Jul 02 19:30:14.505517 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.505463    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" podStartSLOduration=1.50544636 podStartE2EDuration="1.50544636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:14.503729262 +0000 UTC m=+1717.476390418" watchObservedRunningTime="2026-07-02 19:30:14.50544636 +0000 UTC m=+1717.478107516"
Jul 02 19:30:14.804607 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.804572    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:14.808903 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.808880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.811482 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.811465    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-40a50560-serving-cert\""
Jul 02 19:30:14.812216 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.812195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.812320 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.812223    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d6vr\" (UniqueName: \"kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.812320 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.812281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.822186 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.822163    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:14.823530 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.823501    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:14.913350 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.913318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.913520 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.913391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.913520 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.913410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d6vr\" (UniqueName: \"kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.914137 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.914112    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.915860 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.915824    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:14.926679 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:14.926647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d6vr\" (UniqueName: \"kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr\") pod \"maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") " pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:15.120326 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:15.120237    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:15.262411 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:15.262385    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:15.263701 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:30:15.263658    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa64984b_9faf_47e5_b581_f41052fc59a0.slice/crio-714e45880588841347a5716d4aa780b374171f1e417a1f1cab20845320b2e9cb WatchSource:0}: Error finding container 714e45880588841347a5716d4aa780b374171f1e417a1f1cab20845320b2e9cb: Status 404 returned error can't find the container with id 714e45880588841347a5716d4aa780b374171f1e417a1f1cab20845320b2e9cb
Jul 02 19:30:15.488620 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:15.488529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" event={"ID":"fa64984b-9faf-47e5-b581-f41052fc59a0","Type":"ContainerStarted","Data":"714e45880588841347a5716d4aa780b374171f1e417a1f1cab20845320b2e9cb"}
Jul 02 19:30:15.827969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:15.827930    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:16.494709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:16.494670    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" event={"ID":"fa64984b-9faf-47e5-b581-f41052fc59a0","Type":"ContainerStarted","Data":"25df8ce4bae501693fa4ca752e1300fd320cc76a81fd24a9898e16012314b372"}
Jul 02 19:30:16.494937 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:16.494875    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:16.495749 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:16.495727    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:16.514116 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:16.514065    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" podStartSLOduration=2.139119954 podStartE2EDuration="2.514048721s" totalImagesPullingTime="374.928767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:16.512790793 +0000 UTC m=+1719.485451943" watchObservedRunningTime="2026-07-02 19:30:16.514048721 +0000 UTC m=+1719.486709874"
Jul 02 19:30:17.500734 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:17.500697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:20.325664 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.325620    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:20.332528 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.332209    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" podUID="fa64984b-9faf-47e5-b581-f41052fc59a0" containerName="maas-api" containerID="cri-o://25df8ce4bae501693fa4ca752e1300fd320cc76a81fd24a9898e16012314b372" gracePeriod=30
Jul 02 19:30:20.347307 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.347271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:20.531892 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.531631    2569 generic.go:356] "Generic (PLEG): container finished" podID="fa64984b-9faf-47e5-b581-f41052fc59a0" containerID="25df8ce4bae501693fa4ca752e1300fd320cc76a81fd24a9898e16012314b372" exitCode=0
Jul 02 19:30:20.531892 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.531764    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" event={"ID":"fa64984b-9faf-47e5-b581-f41052fc59a0","Type":"ContainerDied","Data":"25df8ce4bae501693fa4ca752e1300fd320cc76a81fd24a9898e16012314b372"}
Jul 02 19:30:20.633623 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.633590    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:20.664558 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.664523    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d6vr\" (UniqueName: \"kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr\") pod \"fa64984b-9faf-47e5-b581-f41052fc59a0\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") "
Jul 02 19:30:20.664716 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.664617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls\") pod \"fa64984b-9faf-47e5-b581-f41052fc59a0\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") "
Jul 02 19:30:20.664716 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.664652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca\") pod \"fa64984b-9faf-47e5-b581-f41052fc59a0\" (UID: \"fa64984b-9faf-47e5-b581-f41052fc59a0\") "
Jul 02 19:30:20.665041 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.665015    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa64984b-9faf-47e5-b581-f41052fc59a0" (UID: "fa64984b-9faf-47e5-b581-f41052fc59a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:30:20.666681 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.666656    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa64984b-9faf-47e5-b581-f41052fc59a0" (UID: "fa64984b-9faf-47e5-b581-f41052fc59a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:30:20.666777 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.666756    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr" (OuterVolumeSpecName: "kube-api-access-5d6vr") pod "fa64984b-9faf-47e5-b581-f41052fc59a0" (UID: "fa64984b-9faf-47e5-b581-f41052fc59a0"). InnerVolumeSpecName "kube-api-access-5d6vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:20.765699 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.765662    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d6vr\" (UniqueName: \"kubernetes.io/projected/fa64984b-9faf-47e5-b581-f41052fc59a0-kube-api-access-5d6vr\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:20.765699 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.765694    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa64984b-9faf-47e5-b581-f41052fc59a0-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:20.765699 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:20.765704    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa64984b-9faf-47e5-b581-f41052fc59a0-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:21.537679 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.537648    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"
Jul 02 19:30:21.538108 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.537651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6" event={"ID":"fa64984b-9faf-47e5-b581-f41052fc59a0","Type":"ContainerDied","Data":"714e45880588841347a5716d4aa780b374171f1e417a1f1cab20845320b2e9cb"}
Jul 02 19:30:21.538108 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.537782    2569 scope.go:117] "RemoveContainer" containerID="25df8ce4bae501693fa4ca752e1300fd320cc76a81fd24a9898e16012314b372"
Jul 02 19:30:21.558823 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.558794    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:21.562756 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.562734    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-40a50560-5944f6bb7d-kfcv6"]
Jul 02 19:30:21.732232 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:21.732200    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa64984b-9faf-47e5-b581-f41052fc59a0" path="/var/lib/kubelet/pods/fa64984b-9faf-47e5-b581-f41052fc59a0/volumes"
Jul 02 19:30:25.561143 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.561111    2569 generic.go:356] "Generic (PLEG): container finished" podID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerID="2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a" exitCode=0
Jul 02 19:30:25.561521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.561196    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerDied","Data":"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"}
Jul 02 19:30:25.561627 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.561609    2569 scope.go:117] "RemoveContainer" containerID="2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"
Jul 02 19:30:25.562645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.562611    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:25.562715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.562681    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:25.562752 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:25.562713    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:30:26.256923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:26.256888    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:26.568411 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:26.568379    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerStarted","Data":"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"}
Jul 02 19:30:26.568834 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:26.568497    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy" containerID="cri-o://4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d" gracePeriod=30
Jul 02 19:30:31.495328 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.495274    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:31.832670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.832640    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:31.870787 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870755    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.870973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870805    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.870973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870826    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.870973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870868    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.870973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870909    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjdf5\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.871217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.870988    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.871217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871026    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.871217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871057    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.871217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871130    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs\") pod \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\" (UID: \"e30b1d73-5c88-41f7-9619-bd0bc2cfa798\") "
Jul 02 19:30:31.871217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871197    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:30:31.871473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871441    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.871473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871462    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:31.871673 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871646    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:31.871746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.871657    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:31.872442 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.872413    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data" (OuterVolumeSpecName: "istio-data") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:31.873352 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.873327    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:31.873700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.873662    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5" (OuterVolumeSpecName: "kube-api-access-pjdf5") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "kube-api-access-pjdf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:31.873774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.873733    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:30:31.874084 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.874054    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token" (OuterVolumeSpecName: "istio-token") pod "e30b1d73-5c88-41f7-9619-bd0bc2cfa798" (UID: "e30b1d73-5c88-41f7-9619-bd0bc2cfa798"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:31.972925 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972889    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.972925 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972919    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.972925 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972927    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.972925 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972936    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjdf5\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-kube-api-access-pjdf5\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.973174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972945    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.973174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972953    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.973174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972961    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:31.973174 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:31.972969    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30b1d73-5c88-41f7-9619-bd0bc2cfa798-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:32.608678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.608641    2569 generic.go:356] "Generic (PLEG): container finished" podID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerID="4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d" exitCode=0
Jul 02 19:30:32.609166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.608687    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerDied","Data":"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"}
Jul 02 19:30:32.609166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.608694    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"
Jul 02 19:30:32.609166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.608740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd" event={"ID":"e30b1d73-5c88-41f7-9619-bd0bc2cfa798","Type":"ContainerDied","Data":"2ad6518438bcd52639326e866603f7a54cb3284aa2b430653a9a1306ee089a42"}
Jul 02 19:30:32.609166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.608771    2569 scope.go:117] "RemoveContainer" containerID="4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"
Jul 02 19:30:32.618267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.618246    2569 scope.go:117] "RemoveContainer" containerID="2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"
Jul 02 19:30:32.626354 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.626335    2569 scope.go:117] "RemoveContainer" containerID="4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"
Jul 02 19:30:32.626591 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:32.626573    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d\": container with ID starting with 4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d not found: ID does not exist" containerID="4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"
Jul 02 19:30:32.626655 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.626600    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d"} err="failed to get container status \"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d\": rpc error: code = NotFound desc = could not find container \"4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d\": container with ID starting with 4895bab323865a93bbee3548c17ab96b3c16cfef9240bcadd9f84a14cbba300d not found: ID does not exist"
Jul 02 19:30:32.626655 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.626618    2569 scope.go:117] "RemoveContainer" containerID="2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"
Jul 02 19:30:32.626914 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:32.626827    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a\": container with ID starting with 2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a not found: ID does not exist" containerID="2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"
Jul 02 19:30:32.626914 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.626875    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a"} err="failed to get container status \"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a\": rpc error: code = NotFound desc = could not find container \"2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a\": container with ID starting with 2306445d84824df7c56420126ef76b1319a549d2e2dfd6afca3ca3b745170c3a not found: ID does not exist"
Jul 02 19:30:32.630978 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.630957    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:32.635156 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:32.635136    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-40a50560-openshift-default-7dd7c465cc-dn8rd"]
Jul 02 19:30:33.730645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:33.730609    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" path="/var/lib/kubelet/pods/e30b1d73-5c88-41f7-9619-bd0bc2cfa798/volumes"
Jul 02 19:30:34.078967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.078932    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:34.079370 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079353    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:30:34.079458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079376    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:30:34.079458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079406    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa64984b-9faf-47e5-b581-f41052fc59a0" containerName="maas-api"
Jul 02 19:30:34.079458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079416    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa64984b-9faf-47e5-b581-f41052fc59a0" containerName="maas-api"
Jul 02 19:30:34.079553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079529    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa64984b-9faf-47e5-b581-f41052fc59a0" containerName="maas-api"
Jul 02 19:30:34.079553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.079539    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:30:34.084495 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.084478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.087045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.087020    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-6782a705-serving-cert\""
Jul 02 19:30:34.092989 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.092955    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:34.194277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.194246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbqqp\" (UniqueName: \"kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.194463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.194282    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.194463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.194309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.295901 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.295858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbqqp\" (UniqueName: \"kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.295901 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.295900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.296182 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.295928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.296182 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:34.296044    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-6782a705-serving-cert: secret "maas-api-e2e-derive-6782a705-serving-cert" not found
Jul 02 19:30:34.296182 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:34.296120    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls podName:3022ab9e-3379-4e54-980e-fccaded2ca4e nodeName:}" failed. No retries permitted until 2026-07-02 19:30:34.796103791 +0000 UTC m=+1737.768764922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls") pod "maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" (UID: "3022ab9e-3379-4e54-980e-fccaded2ca4e") : secret "maas-api-e2e-derive-6782a705-serving-cert" not found
Jul 02 19:30:34.296564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.296546    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.307507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.307468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbqqp\" (UniqueName: \"kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.799724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.799690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.802617 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.802586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") pod \"maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") " pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:34.997147 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:34.997111    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:35.141307 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:35.141283    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:35.143663 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:30:35.143635    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3022ab9e_3379_4e54_980e_fccaded2ca4e.slice/crio-81ca579502df7d2daa0b5f98cc07ce1dfb7a759992389cda5b5829dd0eee3c0c WatchSource:0}: Error finding container 81ca579502df7d2daa0b5f98cc07ce1dfb7a759992389cda5b5829dd0eee3c0c: Status 404 returned error can't find the container with id 81ca579502df7d2daa0b5f98cc07ce1dfb7a759992389cda5b5829dd0eee3c0c
Jul 02 19:30:35.627093 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:35.627054    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" event={"ID":"3022ab9e-3379-4e54-980e-fccaded2ca4e","Type":"ContainerStarted","Data":"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"}
Jul 02 19:30:35.627256 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:35.627119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" event={"ID":"3022ab9e-3379-4e54-980e-fccaded2ca4e","Type":"ContainerStarted","Data":"81ca579502df7d2daa0b5f98cc07ce1dfb7a759992389cda5b5829dd0eee3c0c"}
Jul 02 19:30:35.627256 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:35.627142    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:35.646720 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:35.646673    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" podStartSLOduration=1.265466697 podStartE2EDuration="1.646656614s" totalImagesPullingTime="381.189917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:35.645307905 +0000 UTC m=+1738.617969062" watchObservedRunningTime="2026-07-02 19:30:35.646656614 +0000 UTC m=+1738.619317768"
Jul 02 19:30:39.003702 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.003665    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:39.004129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.003972    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" podUID="3022ab9e-3379-4e54-980e-fccaded2ca4e" containerName="maas-api" containerID="cri-o://0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d" gracePeriod=30
Jul 02 19:30:39.256323 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.256252    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:39.338787 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.338756    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbqqp\" (UniqueName: \"kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp\") pod \"3022ab9e-3379-4e54-980e-fccaded2ca4e\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") "
Jul 02 19:30:39.338959 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.338806    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") pod \"3022ab9e-3379-4e54-980e-fccaded2ca4e\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") "
Jul 02 19:30:39.338959 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.338951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca\") pod \"3022ab9e-3379-4e54-980e-fccaded2ca4e\" (UID: \"3022ab9e-3379-4e54-980e-fccaded2ca4e\") "
Jul 02 19:30:39.339316 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.339281    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3022ab9e-3379-4e54-980e-fccaded2ca4e" (UID: "3022ab9e-3379-4e54-980e-fccaded2ca4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:30:39.340899 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.340871    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3022ab9e-3379-4e54-980e-fccaded2ca4e" (UID: "3022ab9e-3379-4e54-980e-fccaded2ca4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:30:39.340899 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.340886    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp" (OuterVolumeSpecName: "kube-api-access-fbqqp") pod "3022ab9e-3379-4e54-980e-fccaded2ca4e" (UID: "3022ab9e-3379-4e54-980e-fccaded2ca4e"). InnerVolumeSpecName "kube-api-access-fbqqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:39.440224 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.440198    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3022ab9e-3379-4e54-980e-fccaded2ca4e-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:39.440224 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.440221    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbqqp\" (UniqueName: \"kubernetes.io/projected/3022ab9e-3379-4e54-980e-fccaded2ca4e-kube-api-access-fbqqp\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:39.440224 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.440231    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3022ab9e-3379-4e54-980e-fccaded2ca4e-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:30:39.650343 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.650307    2569 generic.go:356] "Generic (PLEG): container finished" podID="3022ab9e-3379-4e54-980e-fccaded2ca4e" containerID="0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d" exitCode=0
Jul 02 19:30:39.650541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.650353    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"
Jul 02 19:30:39.650541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.650390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" event={"ID":"3022ab9e-3379-4e54-980e-fccaded2ca4e","Type":"ContainerDied","Data":"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"}
Jul 02 19:30:39.650541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.650446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr" event={"ID":"3022ab9e-3379-4e54-980e-fccaded2ca4e","Type":"ContainerDied","Data":"81ca579502df7d2daa0b5f98cc07ce1dfb7a759992389cda5b5829dd0eee3c0c"}
Jul 02 19:30:39.650541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.650468    2569 scope.go:117] "RemoveContainer" containerID="0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"
Jul 02 19:30:39.662807 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.662791    2569 scope.go:117] "RemoveContainer" containerID="0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"
Jul 02 19:30:39.663049 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:30:39.663031    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d\": container with ID starting with 0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d not found: ID does not exist" containerID="0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"
Jul 02 19:30:39.663092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.663057    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d"} err="failed to get container status \"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d\": rpc error: code = NotFound desc = could not find container \"0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d\": container with ID starting with 0ace5345f24dd1ec02393704f1c74c81c1a28bcd4c4a2cf82d1180401218ba2d not found: ID does not exist"
Jul 02 19:30:39.674156 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.674132    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:39.678403 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.678379    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-6782a705-7f9769d8b8-fttwr"]
Jul 02 19:30:39.730259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:30:39.730231    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3022ab9e-3379-4e54-980e-fccaded2ca4e" path="/var/lib/kubelet/pods/3022ab9e-3379-4e54-980e-fccaded2ca4e/volumes"
Jul 02 19:31:37.639344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:31:37.639311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:31:37.647609 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:31:37.647585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:32:21.050067 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050032    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:21.050522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050447    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:32:21.050522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050459    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:32:21.050522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050466    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3022ab9e-3379-4e54-980e-fccaded2ca4e" containerName="maas-api"
Jul 02 19:32:21.050522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050472    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3022ab9e-3379-4e54-980e-fccaded2ca4e" containerName="maas-api"
Jul 02 19:32:21.050669 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050542    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30b1d73-5c88-41f7-9619-bd0bc2cfa798" containerName="istio-proxy"
Jul 02 19:32:21.050669 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.050554    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3022ab9e-3379-4e54-980e-fccaded2ca4e" containerName="maas-api"
Jul 02 19:32:21.053597 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.053582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.056290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.056265    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0dc59fcf-openshift-default-dockercfg-tkvtc\""
Jul 02 19:32:21.080194 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.080164    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:21.119823 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.119823 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.119973    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.120019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120062 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.120059    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.120279 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.120090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221162 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221330 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221330 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221330 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221330 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221330 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221304    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221614 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221614 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221614 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221641    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221791 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221674    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.221900 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.221858    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.222031 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.222007    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.222296 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.222280    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.223416 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.223394    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.223638 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.223618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.231765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.231736    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.231765 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.231753    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn\") pod \"e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") " pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.364465 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.364398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:21.511494 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.511462    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:21.513005 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:32:21.512973    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee30c2a_ae56_45e4_8873_c48abd9c6492.slice/crio-2936b896cbf7f395b06c0097ed55eb1b12bd2626ccb37f14cd1fcf3d46dc1dad WatchSource:0}: Error finding container 2936b896cbf7f395b06c0097ed55eb1b12bd2626ccb37f14cd1fcf3d46dc1dad: Status 404 returned error can't find the container with id 2936b896cbf7f395b06c0097ed55eb1b12bd2626ccb37f14cd1fcf3d46dc1dad
Jul 02 19:32:21.515207 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.515167    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:21.515305 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.515258    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:21.515345 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:21.515304    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:22.157485 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:22.157448    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerStarted","Data":"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"}
Jul 02 19:32:22.157888 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:22.157513    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerStarted","Data":"2936b896cbf7f395b06c0097ed55eb1b12bd2626ccb37f14cd1fcf3d46dc1dad"}
Jul 02 19:32:22.182874 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:22.182815    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podStartSLOduration=1.1828011250000001 podStartE2EDuration="1.182801125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:32:22.180754873 +0000 UTC m=+1845.153416038" watchObservedRunningTime="2026-07-02 19:32:22.182801125 +0000 UTC m=+1845.155462279"
Jul 02 19:32:22.365087 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:22.365053    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:22.369923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:22.369896    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:23.162632 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:23.162597    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:23.163446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:23.163426    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:24.488900 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.488864    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:24.492687 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.492665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.495188 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.495167    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-0dc59fcf-serving-cert\""
Jul 02 19:32:24.507668 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.507632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:24.553226 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.553192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.553396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.553273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.553396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.553316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8dcv\" (UniqueName: \"kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.654128 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.654096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.654303 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.654147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8dcv\" (UniqueName: \"kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.654303 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.654211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.654377 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:32:24.654320    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-0dc59fcf-serving-cert: secret "maas-api-e2e-mt-0dc59fcf-serving-cert" not found
Jul 02 19:32:24.654377 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:32:24.654374    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls podName:40a80237-fc55-481a-bd6b-e3796d437d16 nodeName:}" failed. No retries permitted until 2026-07-02 19:32:25.154358712 +0000 UTC m=+1848.127019844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls") pod "maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" (UID: "40a80237-fc55-481a-bd6b-e3796d437d16") : secret "maas-api-e2e-mt-0dc59fcf-serving-cert" not found
Jul 02 19:32:24.654705 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.654686    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:24.665396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:24.665370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8dcv\" (UniqueName: \"kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:25.158620 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:25.158586    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:25.161328 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:25.161296    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") pod \"maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") " pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:25.404151 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:25.404107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:25.563269 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:25.563244    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:25.565115 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:32:25.565086    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a80237_fc55_481a_bd6b_e3796d437d16.slice/crio-62ca83b4a1e542067d24d0da3eb1643c3e182d0323130bb6c927fa71b41f1d1f WatchSource:0}: Error finding container 62ca83b4a1e542067d24d0da3eb1643c3e182d0323130bb6c927fa71b41f1d1f: Status 404 returned error can't find the container with id 62ca83b4a1e542067d24d0da3eb1643c3e182d0323130bb6c927fa71b41f1d1f
Jul 02 19:32:26.178640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:26.178608    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" event={"ID":"40a80237-fc55-481a-bd6b-e3796d437d16","Type":"ContainerStarted","Data":"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"}
Jul 02 19:32:26.178835 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:26.178659    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" event={"ID":"40a80237-fc55-481a-bd6b-e3796d437d16","Type":"ContainerStarted","Data":"62ca83b4a1e542067d24d0da3eb1643c3e182d0323130bb6c927fa71b41f1d1f"}
Jul 02 19:32:26.178835 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:26.178715    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:26.198298 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:26.198248    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" podStartSLOduration=1.7488272729999998 podStartE2EDuration="2.198232923s" totalImagesPullingTime="449.40565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:32:26.196578001 +0000 UTC m=+1849.169239156" watchObservedRunningTime="2026-07-02 19:32:26.198232923 +0000 UTC m=+1849.170894094"
Jul 02 19:32:32.189053 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:32.189019    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:36.652089 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:36.652001    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:36.652565 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:36.652236    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" podUID="40a80237-fc55-481a-bd6b-e3796d437d16" containerName="maas-api" containerID="cri-o://db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376" gracePeriod=30
Jul 02 19:32:36.916447 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:36.916404    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:37.078557 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.078524    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca\") pod \"40a80237-fc55-481a-bd6b-e3796d437d16\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") "
Jul 02 19:32:37.078741 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.078569    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8dcv\" (UniqueName: \"kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv\") pod \"40a80237-fc55-481a-bd6b-e3796d437d16\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") "
Jul 02 19:32:37.078741 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.078602    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") pod \"40a80237-fc55-481a-bd6b-e3796d437d16\" (UID: \"40a80237-fc55-481a-bd6b-e3796d437d16\") "
Jul 02 19:32:37.079038 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.079011    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40a80237-fc55-481a-bd6b-e3796d437d16" (UID: "40a80237-fc55-481a-bd6b-e3796d437d16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:32:37.080698 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.080668    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv" (OuterVolumeSpecName: "kube-api-access-d8dcv") pod "40a80237-fc55-481a-bd6b-e3796d437d16" (UID: "40a80237-fc55-481a-bd6b-e3796d437d16"). InnerVolumeSpecName "kube-api-access-d8dcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:32:37.080790 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.080740    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40a80237-fc55-481a-bd6b-e3796d437d16" (UID: "40a80237-fc55-481a-bd6b-e3796d437d16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:32:37.180261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.180232    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40a80237-fc55-481a-bd6b-e3796d437d16-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:37.180261 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.180257    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40a80237-fc55-481a-bd6b-e3796d437d16-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:37.180413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.180268    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8dcv\" (UniqueName: \"kubernetes.io/projected/40a80237-fc55-481a-bd6b-e3796d437d16-kube-api-access-d8dcv\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:37.248268 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.248231    2569 generic.go:356] "Generic (PLEG): container finished" podID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerID="ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0" exitCode=0
Jul 02 19:32:37.248404 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.248305    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerDied","Data":"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"}
Jul 02 19:32:37.248796 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.248764    2569 scope.go:117] "RemoveContainer" containerID="ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"
Jul 02 19:32:37.249598 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249580    2569 generic.go:356] "Generic (PLEG): container finished" podID="40a80237-fc55-481a-bd6b-e3796d437d16" containerID="db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376" exitCode=0
Jul 02 19:32:37.249725 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" event={"ID":"40a80237-fc55-481a-bd6b-e3796d437d16","Type":"ContainerDied","Data":"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"}
Jul 02 19:32:37.249725 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249661    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67" event={"ID":"40a80237-fc55-481a-bd6b-e3796d437d16","Type":"ContainerDied","Data":"62ca83b4a1e542067d24d0da3eb1643c3e182d0323130bb6c927fa71b41f1d1f"}
Jul 02 19:32:37.249725 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249678    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"
Jul 02 19:32:37.249725 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249691    2569 scope.go:117] "RemoveContainer" containerID="db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"
Jul 02 19:32:37.249954 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249741    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:37.249954 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249803    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:37.249954 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.249837    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:32:37.263444 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.263418    2569 scope.go:117] "RemoveContainer" containerID="db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"
Jul 02 19:32:37.263716 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:32:37.263697    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376\": container with ID starting with db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376 not found: ID does not exist" containerID="db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"
Jul 02 19:32:37.263783 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.263725    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376"} err="failed to get container status \"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376\": rpc error: code = NotFound desc = could not find container \"db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376\": container with ID starting with db9ea3cc5b21bb8d15a60ccde95e52a15031bdfe46e38a9afff05676c2f91376 not found: ID does not exist"
Jul 02 19:32:37.282440 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.282415    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:37.287003 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.286837    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-0dc59fcf-6bfb9467cd-pqq67"]
Jul 02 19:32:37.729745 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:37.729718    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40a80237-fc55-481a-bd6b-e3796d437d16" path="/var/lib/kubelet/pods/40a80237-fc55-481a-bd6b-e3796d437d16/volumes"
Jul 02 19:32:38.163489 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:38.163455    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:38.256568 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:38.256526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerStarted","Data":"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"}
Jul 02 19:32:38.365014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:38.364982    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:38.366057 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:38.366033    2569 patch_prober.go:28] interesting pod/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 02 19:32:38.366183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:38.366083    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 02 19:32:39.365225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:39.365188    2569 patch_prober.go:28] interesting pod/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 02 19:32:39.365618 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:39.365243    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 02 19:32:40.365222 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:40.365192    2569 patch_prober.go:28] interesting pod/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 02 19:32:40.365400 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:40.365246    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 02 19:32:41.365789 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:41.365744    2569 patch_prober.go:28] interesting pod/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 02 19:32:41.366242 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:41.365808    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 02 19:32:42.369082 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:42.369050    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:42.369524 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:42.369399    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:42.370046 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:42.370028    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:42.563929 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:42.563894    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:43.281637 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:43.281605    2569 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" secret="" err="secret \"e2e-mt-0dc59fcf-openshift-default-dockercfg-tkvtc\" not found"
Jul 02 19:32:44.286736 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:44.286695    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy" containerID="cri-o://e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913" gracePeriod=30
Jul 02 19:32:49.556315 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.556253    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:49.593019 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.592995    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593059    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593302 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593280    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593349 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593329    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:49.593407 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593352    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593407 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593384    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593486    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy\") pod \"dee30c2a-ae56-45e4-8873-c48abd9c6492\" (UID: \"dee30c2a-ae56-45e4-8873-c48abd9c6492\") "
Jul 02 19:32:49.593781 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:49.593781 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593745    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:49.593974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593838    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.593974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593833    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:32:49.593974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593877    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.593974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.593916    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.594188 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.594022    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data" (OuterVolumeSpecName: "istio-data") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:49.595285 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.595254    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:32:49.595715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.595682    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token" (OuterVolumeSpecName: "istio-token") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:32:49.595715 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.595695    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:49.596172 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.596155    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn" (OuterVolumeSpecName: "kube-api-access-b4lcn") pod "dee30c2a-ae56-45e4-8873-c48abd9c6492" (UID: "dee30c2a-ae56-45e4-8873-c48abd9c6492"). InnerVolumeSpecName "kube-api-access-b4lcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:32:49.694763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694730    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.694763 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694756    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee30c2a-ae56-45e4-8873-c48abd9c6492-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.694964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694769    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-kube-api-access-b4lcn\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.694964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694782    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.694964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694792    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:49.694964 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:49.694802    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee30c2a-ae56-45e4-8873-c48abd9c6492-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:32:50.318595 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.318557    2569 generic.go:356] "Generic (PLEG): container finished" podID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerID="e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913" exitCode=0
Jul 02 19:32:50.318810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.318606    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"
Jul 02 19:32:50.318810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.318644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerDied","Data":"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"}
Jul 02 19:32:50.318810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.318705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6" event={"ID":"dee30c2a-ae56-45e4-8873-c48abd9c6492","Type":"ContainerDied","Data":"2936b896cbf7f395b06c0097ed55eb1b12bd2626ccb37f14cd1fcf3d46dc1dad"}
Jul 02 19:32:50.318810 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.318735    2569 scope.go:117] "RemoveContainer" containerID="e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"
Jul 02 19:32:50.327924 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.327906    2569 scope.go:117] "RemoveContainer" containerID="ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"
Jul 02 19:32:50.336134 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.335977    2569 scope.go:117] "RemoveContainer" containerID="e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"
Jul 02 19:32:50.336701 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:32:50.336351    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913\": container with ID starting with e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913 not found: ID does not exist" containerID="e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"
Jul 02 19:32:50.336701 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.336384    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913"} err="failed to get container status \"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913\": rpc error: code = NotFound desc = could not find container \"e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913\": container with ID starting with e4138d65c9c8e9db171b7a454f08818f15d434e4c434fdb40bad4a1df6d91913 not found: ID does not exist"
Jul 02 19:32:50.336701 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.336410    2569 scope.go:117] "RemoveContainer" containerID="ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"
Jul 02 19:32:50.337148 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:32:50.337111    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0\": container with ID starting with ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0 not found: ID does not exist" containerID="ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"
Jul 02 19:32:50.337228 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.337154    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0"} err="failed to get container status \"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0\": rpc error: code = NotFound desc = could not find container \"ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0\": container with ID starting with ad5ebb14c1fafe0147b6cf668690345206b70292cda74fdaf65f0c3582c5aad0 not found: ID does not exist"
Jul 02 19:32:50.339050 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.339027    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:50.343172 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:50.343145    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0dc59fcf-openshift-default-7fd8479b9f-vq2c6"]
Jul 02 19:32:51.729795 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:32:51.729761    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" path="/var/lib/kubelet/pods/dee30c2a-ae56-45e4-8873-c48abd9c6492/volumes"
Jul 02 19:33:02.496973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.496887    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:33:02.497399 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497386    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:02.497441 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497401    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:02.497441 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497424    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a80237-fc55-481a-bd6b-e3796d437d16" containerName="maas-api"
Jul 02 19:33:02.497441 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497431    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a80237-fc55-481a-bd6b-e3796d437d16" containerName="maas-api"
Jul 02 19:33:02.497539 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497507    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:02.497539 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.497517    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a80237-fc55-481a-bd6b-e3796d437d16" containerName="maas-api"
Jul 02 19:33:02.502235 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.502210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.504732 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.504707    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dbb83b48-openshift-default-dockercfg-l6b7r\""
Jul 02 19:33:02.512885 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.512854    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:33:02.616327 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616327 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616428    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47l4\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616545 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.616774 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.616679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717467 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717484    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717536    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47l4\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.717923 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.718147 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.717933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.718147 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.718113    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.718147 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.718129    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.718427 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.718403    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.720012 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.719984    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.720264 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.720237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.725820 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.725801    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.726125 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.726107    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47l4\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4\") pod \"e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") " pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.814049 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.814018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:02.950259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.950232    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:33:02.951521 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:33:02.951493    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5247382_01e0_460c_ad35_68c2031dfc26.slice/crio-02d7baf3e916cc6c10d29baf9cab8792daf0dd78ca806834fc324790a9cdb2b2 WatchSource:0}: Error finding container 02d7baf3e916cc6c10d29baf9cab8792daf0dd78ca806834fc324790a9cdb2b2: Status 404 returned error can't find the container with id 02d7baf3e916cc6c10d29baf9cab8792daf0dd78ca806834fc324790a9cdb2b2
Jul 02 19:33:02.953718 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.953681    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:02.953818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.953762    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:02.953818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:02.953808    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:03.389317 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:03.389278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerStarted","Data":"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"}
Jul 02 19:33:03.389526 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:03.389334    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerStarted","Data":"02d7baf3e916cc6c10d29baf9cab8792daf0dd78ca806834fc324790a9cdb2b2"}
Jul 02 19:33:03.411179 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:03.411129    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podStartSLOduration=1.411112213 podStartE2EDuration="1.411112213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:03.410225991 +0000 UTC m=+1886.382887144" watchObservedRunningTime="2026-07-02 19:33:03.411112213 +0000 UTC m=+1886.383773363"
Jul 02 19:33:03.814830 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:03.814794    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:04.819241 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:04.819205    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:05.399934 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.399894    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:05.400905 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.400882    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:05.696336 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.696256    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:05.696917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.696893    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:05.696917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.696914    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:05.697074 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.697001    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee30c2a-ae56-45e4-8873-c48abd9c6492" containerName="istio-proxy"
Jul 02 19:33:05.700356 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.700338    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.703416 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.703395    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-dbb83b48-serving-cert\""
Jul 02 19:33:05.719060 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.719040    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:05.742250 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.742224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.742355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.742252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.742355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.742340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxz9h\" (UniqueName: \"kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.843583 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.843531    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxz9h\" (UniqueName: \"kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.844000 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.843658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.844000 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.843684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.844000 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:33:05.843801    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-dbb83b48-serving-cert: secret "maas-api-e2e-mt-dbb83b48-serving-cert" not found
Jul 02 19:33:05.844000 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:33:05.843890    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls podName:43626086-e9e6-46c4-a967-acb2479b1835 nodeName:}" failed. No retries permitted until 2026-07-02 19:33:06.343870929 +0000 UTC m=+1889.316532061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls") pod "maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" (UID: "43626086-e9e6-46c4-a967-acb2479b1835") : secret "maas-api-e2e-mt-dbb83b48-serving-cert" not found
Jul 02 19:33:05.844368 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.844349    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:05.854812 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:05.854788    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxz9h\" (UniqueName: \"kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:06.347745 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:06.347710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:06.347959 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:33:06.347883    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-dbb83b48-serving-cert: secret "maas-api-e2e-mt-dbb83b48-serving-cert" not found
Jul 02 19:33:06.347959 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:33:06.347956    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls podName:43626086-e9e6-46c4-a967-acb2479b1835 nodeName:}" failed. No retries permitted until 2026-07-02 19:33:07.347941503 +0000 UTC m=+1890.320602634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls") pod "maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" (UID: "43626086-e9e6-46c4-a967-acb2479b1835") : secret "maas-api-e2e-mt-dbb83b48-serving-cert" not found
Jul 02 19:33:07.358740 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:07.358704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:07.361210 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:07.361185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") " pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:07.510840 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:07.510807    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:07.655302 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:07.655272    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:07.657533 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:33:07.657501    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43626086_e9e6_46c4_a967_acb2479b1835.slice/crio-95ffc59eb31a267773343571dff47f67de64882fb49ecf2813603aa7dea81f79 WatchSource:0}: Error finding container 95ffc59eb31a267773343571dff47f67de64882fb49ecf2813603aa7dea81f79: Status 404 returned error can't find the container with id 95ffc59eb31a267773343571dff47f67de64882fb49ecf2813603aa7dea81f79
Jul 02 19:33:08.415475 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:08.415374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" event={"ID":"43626086-e9e6-46c4-a967-acb2479b1835","Type":"ContainerStarted","Data":"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"}
Jul 02 19:33:08.415475 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:08.415437    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:08.415475 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:08.415454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" event={"ID":"43626086-e9e6-46c4-a967-acb2479b1835","Type":"ContainerStarted","Data":"95ffc59eb31a267773343571dff47f67de64882fb49ecf2813603aa7dea81f79"}
Jul 02 19:33:08.435473 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:08.435422    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" podStartSLOduration=2.983767398 podStartE2EDuration="3.435405225s" totalImagesPullingTime="451.637827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:08.432631759 +0000 UTC m=+1891.405292913" watchObservedRunningTime="2026-07-02 19:33:08.435405225 +0000 UTC m=+1891.408066402"
Jul 02 19:33:14.428711 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:14.428676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:19.473738 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.473697    2569 generic.go:356] "Generic (PLEG): container finished" podID="c5247382-01e0-460c-ad35-68c2031dfc26" containerID="359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d" exitCode=0
Jul 02 19:33:19.474190 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.473750    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerDied","Data":"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"}
Jul 02 19:33:19.474190 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.474173    2569 scope.go:117] "RemoveContainer" containerID="359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"
Jul 02 19:33:19.475240 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.475207    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:19.475332 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.475313    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:19.475386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:19.475369    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:33:20.400728 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:20.400681    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:20.480729 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:20.480691    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerStarted","Data":"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"}
Jul 02 19:33:20.814723 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:20.814681    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:20.816455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:20.816418    2569 patch_prober.go:28] interesting pod/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 02 19:33:20.816604 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:20.816493    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 02 19:33:21.814722 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:21.814685    2569 patch_prober.go:28] interesting pod/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 02 19:33:21.815391 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:21.815346    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 02 19:33:22.815934 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:22.815424    2569 patch_prober.go:28] interesting pod/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 02 19:33:22.815934 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:22.815492    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 02 19:33:23.815004 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:23.814959    2569 patch_prober.go:28] interesting pod/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 02 19:33:23.815217 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:23.815028    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 02 19:33:24.818687 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:24.818656    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:24.819091 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:24.818941    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:24.819507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:24.819490    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:33:37.640807 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.640770    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:37.641418 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.641068    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" podUID="43626086-e9e6-46c4-a967-acb2479b1835" containerName="maas-api" containerID="cri-o://182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b" gracePeriod=30
Jul 02 19:33:37.897084 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.897024    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:37.956578 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.956546    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca\") pod \"43626086-e9e6-46c4-a967-acb2479b1835\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") "
Jul 02 19:33:37.956754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.956595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") pod \"43626086-e9e6-46c4-a967-acb2479b1835\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") "
Jul 02 19:33:37.956754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.956667    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxz9h\" (UniqueName: \"kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h\") pod \"43626086-e9e6-46c4-a967-acb2479b1835\" (UID: \"43626086-e9e6-46c4-a967-acb2479b1835\") "
Jul 02 19:33:37.956990 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.956961    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43626086-e9e6-46c4-a967-acb2479b1835" (UID: "43626086-e9e6-46c4-a967-acb2479b1835"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:33:37.958760 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.958726    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43626086-e9e6-46c4-a967-acb2479b1835" (UID: "43626086-e9e6-46c4-a967-acb2479b1835"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:33:37.958883 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:37.958779    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h" (OuterVolumeSpecName: "kube-api-access-xxz9h") pod "43626086-e9e6-46c4-a967-acb2479b1835" (UID: "43626086-e9e6-46c4-a967-acb2479b1835"). InnerVolumeSpecName "kube-api-access-xxz9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:33:38.057818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.057789    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43626086-e9e6-46c4-a967-acb2479b1835-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:33:38.057818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.057816    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43626086-e9e6-46c4-a967-acb2479b1835-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:33:38.057993 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.057825    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxz9h\" (UniqueName: \"kubernetes.io/projected/43626086-e9e6-46c4-a967-acb2479b1835-kube-api-access-xxz9h\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:33:38.573145 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.573112    2569 generic.go:356] "Generic (PLEG): container finished" podID="43626086-e9e6-46c4-a967-acb2479b1835" containerID="182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b" exitCode=0
Jul 02 19:33:38.573347 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.573153    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"
Jul 02 19:33:38.573347 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.573204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" event={"ID":"43626086-e9e6-46c4-a967-acb2479b1835","Type":"ContainerDied","Data":"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"}
Jul 02 19:33:38.573347 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.573263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8" event={"ID":"43626086-e9e6-46c4-a967-acb2479b1835","Type":"ContainerDied","Data":"95ffc59eb31a267773343571dff47f67de64882fb49ecf2813603aa7dea81f79"}
Jul 02 19:33:38.573347 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.573299    2569 scope.go:117] "RemoveContainer" containerID="182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"
Jul 02 19:33:38.583068 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.583049    2569 scope.go:117] "RemoveContainer" containerID="182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"
Jul 02 19:33:38.583303 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:33:38.583284    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b\": container with ID starting with 182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b not found: ID does not exist" containerID="182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"
Jul 02 19:33:38.583385 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.583314    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b"} err="failed to get container status \"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b\": rpc error: code = NotFound desc = could not find container \"182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b\": container with ID starting with 182ac61764619bc5ee4d67f124b8e858ba74b00d5ce9d0fa91a3450bdb84881b not found: ID does not exist"
Jul 02 19:33:38.595043 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.594988    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:38.597367 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:38.597347    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-dbb83b48-6b65fccd7f-dxkq8"]
Jul 02 19:33:39.729833 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:33:39.729796    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43626086-e9e6-46c4-a967-acb2479b1835" path="/var/lib/kubelet/pods/43626086-e9e6-46c4-a967-acb2479b1835/volumes"
Jul 02 19:34:31.853551 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:31.853470    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:34:31.854193 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:31.853695    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy" containerID="cri-o://aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914" gracePeriod=30
Jul 02 19:34:37.113116 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.113087    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:34:37.201980 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.201899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.201980 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.201943    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.201980 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.201980    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.201999    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202068    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202099    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202232    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:37.202259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202257    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j47l4\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4\") pod \"c5247382-01e0-460c-ad35-68c2031dfc26\" (UID: \"c5247382-01e0-460c-ad35-68c2031dfc26\") "
Jul 02 19:34:37.202595 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202561    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:37.202656 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202594    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.202656 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202618    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:34:37.202910 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202886    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:37.203003 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.202903    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:37.204413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.204389    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:34:37.204503 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.204461    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4" (OuterVolumeSpecName: "kube-api-access-j47l4") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "kube-api-access-j47l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:34:37.204758 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.204738    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:34:37.204815 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.204757    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5247382-01e0-460c-ad35-68c2031dfc26" (UID: "c5247382-01e0-460c-ad35-68c2031dfc26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:37.303295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303266    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303290    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303299    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5247382-01e0-460c-ad35-68c2031dfc26-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303307    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5247382-01e0-460c-ad35-68c2031dfc26-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303316    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303323    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303331    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5247382-01e0-460c-ad35-68c2031dfc26-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.303474 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.303339    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j47l4\" (UniqueName: \"kubernetes.io/projected/c5247382-01e0-460c-ad35-68c2031dfc26-kube-api-access-j47l4\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:34:37.879543 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.879509    2569 generic.go:356] "Generic (PLEG): container finished" podID="c5247382-01e0-460c-ad35-68c2031dfc26" containerID="aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914" exitCode=0
Jul 02 19:34:37.879700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.879558    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"
Jul 02 19:34:37.879700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.879571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerDied","Data":"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"}
Jul 02 19:34:37.879700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.879614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27" event={"ID":"c5247382-01e0-460c-ad35-68c2031dfc26","Type":"ContainerDied","Data":"02d7baf3e916cc6c10d29baf9cab8792daf0dd78ca806834fc324790a9cdb2b2"}
Jul 02 19:34:37.879700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.879635    2569 scope.go:117] "RemoveContainer" containerID="aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"
Jul 02 19:34:37.888277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.888258    2569 scope.go:117] "RemoveContainer" containerID="359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"
Jul 02 19:34:37.896154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.896133    2569 scope.go:117] "RemoveContainer" containerID="aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"
Jul 02 19:34:37.896412 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:34:37.896393    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914\": container with ID starting with aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914 not found: ID does not exist" containerID="aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"
Jul 02 19:34:37.896469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.896425    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914"} err="failed to get container status \"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914\": rpc error: code = NotFound desc = could not find container \"aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914\": container with ID starting with aed8effba83882662b2c578a1e80cae2103aa9c61c5d1572a2bcbc6dc6ec2914 not found: ID does not exist"
Jul 02 19:34:37.896469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.896442    2569 scope.go:117] "RemoveContainer" containerID="359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"
Jul 02 19:34:37.896698 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:34:37.896678    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d\": container with ID starting with 359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d not found: ID does not exist" containerID="359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"
Jul 02 19:34:37.896779 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.896704    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d"} err="failed to get container status \"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d\": rpc error: code = NotFound desc = could not find container \"359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d\": container with ID starting with 359ff7e4aed51178980099343178ccc107f59151e039f0b8c6a5caade0a8c70d not found: ID does not exist"
Jul 02 19:34:37.898372 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.898354    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:34:37.902028 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:37.902007    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dbb83b48-openshift-default-696dc79455-gfv27"]
Jul 02 19:34:39.728832 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:34:39.728796    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" path="/var/lib/kubelet/pods/c5247382-01e0-460c-ad35-68c2031dfc26/volumes"
Jul 02 19:35:31.527872 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.527809    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528217    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43626086-e9e6-46c4-a967-acb2479b1835" containerName="maas-api"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528229    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="43626086-e9e6-46c4-a967-acb2479b1835" containerName="maas-api"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528240    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528245    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528258    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528264    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528332    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528339    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5247382-01e0-460c-ad35-68c2031dfc26" containerName="istio-proxy"
Jul 02 19:35:31.528642 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.528347    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="43626086-e9e6-46c4-a967-acb2479b1835" containerName="maas-api"
Jul 02 19:35:31.531859 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.531824    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.534447 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.534422    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-6fdd24-serving-cert\""
Jul 02 19:35:31.545522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.545501    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:35:31.579758 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.579730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpshx\" (UniqueName: \"kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.579912 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.579773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.579960 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.579917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.681071 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.681038    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.681267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.681097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpshx\" (UniqueName: \"kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.681267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.681145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.681918 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.681895    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.683614 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.683594    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.689897 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.689875    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpshx\" (UniqueName: \"kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx\") pod \"maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") " pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.841785 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.841753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:31.993303 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.993277    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:35:31.995300 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:35:31.995271    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcca9b7_59ca_45ae_ac5b_4c3d6546bae4.slice/crio-71a9402c15f3da6f1f8e068ca4b09e5cff5ef14bf8325f084d264b6472d6385b WatchSource:0}: Error finding container 71a9402c15f3da6f1f8e068ca4b09e5cff5ef14bf8325f084d264b6472d6385b: Status 404 returned error can't find the container with id 71a9402c15f3da6f1f8e068ca4b09e5cff5ef14bf8325f084d264b6472d6385b
Jul 02 19:35:31.997035 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:31.997016    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:35:32.156417 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:32.156320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" event={"ID":"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4","Type":"ContainerStarted","Data":"71a9402c15f3da6f1f8e068ca4b09e5cff5ef14bf8325f084d264b6472d6385b"}
Jul 02 19:35:33.169664 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:33.169626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" event={"ID":"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4","Type":"ContainerStarted","Data":"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"}
Jul 02 19:35:33.170098 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:33.169713    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:33.187887 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:33.187821    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" podStartSLOduration=1.700736802 podStartE2EDuration="2.187803184s" totalImagesPullingTime="487.066382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:33.186999634 +0000 UTC m=+2036.159660790" watchObservedRunningTime="2026-07-02 19:35:33.187803184 +0000 UTC m=+2036.160464336"
Jul 02 19:35:39.180598 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.180568    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:35:39.664164 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.664125    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:35:39.671295 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.671270    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.675386 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.675358    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-4fd26d-serving-cert\""
Jul 02 19:35:39.675859 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.675826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:35:39.751623 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.751592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpt8\" (UniqueName: \"kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.751782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.751650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.751782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.751724    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.852919 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.852884    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpt8\" (UniqueName: \"kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.853072 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.852989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.853072 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.853046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.853146 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:35:39.853132    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-4fd26d-serving-cert: secret "maas-api-e2e-inf-b-4fd26d-serving-cert" not found
Jul 02 19:35:39.853203 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:35:39.853192    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls podName:f53ddce8-5f86-4057-9374-3776ebd0450d nodeName:}" failed. No retries permitted until 2026-07-02 19:35:40.353175386 +0000 UTC m=+2043.325836521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls") pod "maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" (UID: "f53ddce8-5f86-4057-9374-3776ebd0450d") : secret "maas-api-e2e-inf-b-4fd26d-serving-cert" not found
Jul 02 19:35:39.853670 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.853653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:39.862188 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:39.862163    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpt8\" (UniqueName: \"kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:40.358477 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:40.358441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:40.360709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:40.360679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") " pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:40.583433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:40.583393    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:40.719259 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:40.719233    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:35:40.721867 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:35:40.721813    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53ddce8_5f86_4057_9374_3776ebd0450d.slice/crio-0b3250c4b047d1c48fa5797749e6b36ec2b02b06da8884ba0177fe7cb6c8e1e9 WatchSource:0}: Error finding container 0b3250c4b047d1c48fa5797749e6b36ec2b02b06da8884ba0177fe7cb6c8e1e9: Status 404 returned error can't find the container with id 0b3250c4b047d1c48fa5797749e6b36ec2b02b06da8884ba0177fe7cb6c8e1e9
Jul 02 19:35:41.213306 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:41.213272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" event={"ID":"f53ddce8-5f86-4057-9374-3776ebd0450d","Type":"ContainerStarted","Data":"0b3250c4b047d1c48fa5797749e6b36ec2b02b06da8884ba0177fe7cb6c8e1e9"}
Jul 02 19:35:42.219669 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:42.219625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" event={"ID":"f53ddce8-5f86-4057-9374-3776ebd0450d","Type":"ContainerStarted","Data":"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"}
Jul 02 19:35:42.220081 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:42.219714    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:42.237987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:42.237940    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" podStartSLOduration=2.441026117 podStartE2EDuration="3.237924591s" totalImagesPullingTime="796.898474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:42.235560125 +0000 UTC m=+2045.208221290" watchObservedRunningTime="2026-07-02 19:35:42.237924591 +0000 UTC m=+2045.210585759"
Jul 02 19:35:48.230728 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:48.230699    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:35:52.159865 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.159790    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:35:52.163625 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.163607    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.167019 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.166990    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6fdd24\"/\"openshift-service-ca.crt\""
Jul 02 19:35:52.167141 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.167025    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6fdd24\"/\"default-dockercfg-gghw6\""
Jul 02 19:35:52.167141 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.167047    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6fdd24\"/\"kube-root-ca.crt\""
Jul 02 19:35:52.167141 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.167051    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6fdd24\"/\"test-model-6fdd24-kserve-self-signed-certs\""
Jul 02 19:35:52.172433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.172413    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:35:52.269915 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.269885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.269915 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.269920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.270137 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.269944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.270137 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.270003    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.270137 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.270065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.270268 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.270180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5x25\" (UniqueName: \"kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.370713 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.370682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.370939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.370768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.370939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.370819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5x25\" (UniqueName: \"kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.370939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.370886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.370939 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.370909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.371154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.371060    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.371267 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.371185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.371337 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.371266    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.371394 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.371373    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.373154 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.373125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.373560 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.373539    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.378961 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.378932    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5x25\" (UniqueName: \"kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25\") pod \"test-model-6fdd24-kserve-54bd85b45c-zjlxz\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") " pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.475160 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.475060    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:35:52.612001 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:52.611976    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:35:52.614021 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:35:52.613988    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cab5236_bb56_4c26_bdfa_feedc898f5c7.slice/crio-4aadbfb6ce8a1c4e7ec7b04c521973c2ca08899d0bd38f31105e4b2f7f9e4634 WatchSource:0}: Error finding container 4aadbfb6ce8a1c4e7ec7b04c521973c2ca08899d0bd38f31105e4b2f7f9e4634: Status 404 returned error can't find the container with id 4aadbfb6ce8a1c4e7ec7b04c521973c2ca08899d0bd38f31105e4b2f7f9e4634
Jul 02 19:35:53.280037 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:53.279998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" event={"ID":"3cab5236-bb56-4c26-bdfa-feedc898f5c7","Type":"ContainerStarted","Data":"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"}
Jul 02 19:35:53.280451 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:53.280055    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" event={"ID":"3cab5236-bb56-4c26-bdfa-feedc898f5c7","Type":"ContainerStarted","Data":"4aadbfb6ce8a1c4e7ec7b04c521973c2ca08899d0bd38f31105e4b2f7f9e4634"}
Jul 02 19:35:53.298507 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:35:53.298454    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" podStartSLOduration=1.298437096 podStartE2EDuration="1.298437096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:53.296696071 +0000 UTC m=+2056.269357225" watchObservedRunningTime="2026-07-02 19:35:53.298437096 +0000 UTC m=+2056.271098250"
Jul 02 19:36:02.475961 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:02.475877    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:02.475961 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:02.475942    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:02.488469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:02.488440    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:03.348134 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:03.348098    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:37.670416 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:37.670377    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:36:37.678269 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:37.678249    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:36:42.546175 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:42.546131    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:36:44.519118 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.519079    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:36:44.519554 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.519350    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" podUID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" containerName="maas-api" containerID="cri-o://72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d" gracePeriod=30
Jul 02 19:36:44.768100 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.768076    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:36:44.925557 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.925509    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca\") pod \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") "
Jul 02 19:36:44.925735 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.925624    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpshx\" (UniqueName: \"kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx\") pod \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") "
Jul 02 19:36:44.925735 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.925655    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls\") pod \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\" (UID: \"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4\") "
Jul 02 19:36:44.925975 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.925942    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" (UID: "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:36:44.927738 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.927711    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx" (OuterVolumeSpecName: "kube-api-access-cpshx") pod "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" (UID: "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4"). InnerVolumeSpecName "kube-api-access-cpshx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:44.927824 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:44.927746    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" (UID: "0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:36:45.026950 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.026920    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpshx\" (UniqueName: \"kubernetes.io/projected/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-kube-api-access-cpshx\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:45.026950 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.026946    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:45.026950 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.026956    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:45.569097 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.569065    2569 generic.go:356] "Generic (PLEG): container finished" podID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" containerID="72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d" exitCode=0
Jul 02 19:36:45.569564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.569108    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"
Jul 02 19:36:45.569564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.569152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" event={"ID":"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4","Type":"ContainerDied","Data":"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"}
Jul 02 19:36:45.569564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.569213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2" event={"ID":"0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4","Type":"ContainerDied","Data":"71a9402c15f3da6f1f8e068ca4b09e5cff5ef14bf8325f084d264b6472d6385b"}
Jul 02 19:36:45.569564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.569247    2569 scope.go:117] "RemoveContainer" containerID="72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"
Jul 02 19:36:45.578621 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.578603    2569 scope.go:117] "RemoveContainer" containerID="72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"
Jul 02 19:36:45.578896 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:36:45.578870    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d\": container with ID starting with 72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d not found: ID does not exist" containerID="72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"
Jul 02 19:36:45.578953 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.578904    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d"} err="failed to get container status \"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d\": rpc error: code = NotFound desc = could not find container \"72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d\": container with ID starting with 72de503756d68eb25fe11555588b0b0509c5a623724ad29f5d22418f0143975d not found: ID does not exist"
Jul 02 19:36:45.590645 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.590613    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:36:45.594612 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.594592    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6fdd24-64fcf4f878-mqxm2"]
Jul 02 19:36:45.729377 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:45.729346    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" path="/var/lib/kubelet/pods/0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4/volumes"
Jul 02 19:36:57.567684 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.567643    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" podUID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" containerName="main" containerID="cri-o://994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200" gracePeriod=45
Jul 02 19:36:57.826161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.826102    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:57.829662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829644    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.829744 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829670    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.829744 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829699    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.829744 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829722    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.829933 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829813    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5x25\" (UniqueName: \"kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.829933 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829888    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home\") pod \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\" (UID: \"3cab5236-bb56-4c26-bdfa-feedc898f5c7\") "
Jul 02 19:36:57.830087 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.830060    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:57.830215 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.830197    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:57.830290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.830211    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home" (OuterVolumeSpecName: "home") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:57.830290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.829994    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:57.831830 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.831805    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:36:57.832129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.832106    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm" (OuterVolumeSpecName: "dshm") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:57.832129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.832101    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25" (OuterVolumeSpecName: "kube-api-access-v5x25") pod "3cab5236-bb56-4c26-bdfa-feedc898f5c7" (UID: "3cab5236-bb56-4c26-bdfa-feedc898f5c7"). InnerVolumeSpecName "kube-api-access-v5x25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:57.931279 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.931252    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:57.931279 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.931277    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:57.931433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.931287    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:57.931433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.931314    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cab5236-bb56-4c26-bdfa-feedc898f5c7-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:57.931433 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:57.931324    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5x25\" (UniqueName: \"kubernetes.io/projected/3cab5236-bb56-4c26-bdfa-feedc898f5c7-kube-api-access-v5x25\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.637613 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.637578    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" containerID="994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200" exitCode=0
Jul 02 19:36:58.638015 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.637619    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"
Jul 02 19:36:58.638015 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.637667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" event={"ID":"3cab5236-bb56-4c26-bdfa-feedc898f5c7","Type":"ContainerDied","Data":"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"}
Jul 02 19:36:58.638015 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.637705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz" event={"ID":"3cab5236-bb56-4c26-bdfa-feedc898f5c7","Type":"ContainerDied","Data":"4aadbfb6ce8a1c4e7ec7b04c521973c2ca08899d0bd38f31105e4b2f7f9e4634"}
Jul 02 19:36:58.638015 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.637724    2569 scope.go:117] "RemoveContainer" containerID="994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"
Jul 02 19:36:58.646687 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.646672    2569 scope.go:117] "RemoveContainer" containerID="994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"
Jul 02 19:36:58.646942 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:36:58.646924    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200\": container with ID starting with 994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200 not found: ID does not exist" containerID="994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"
Jul 02 19:36:58.647010 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.646949    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200"} err="failed to get container status \"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200\": rpc error: code = NotFound desc = could not find container \"994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200\": container with ID starting with 994242448feaae1f4559f1cbf956d785ef9dfee77040a9c93a28e6c91b542200 not found: ID does not exist"
Jul 02 19:36:58.659065 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.659044    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:36:58.665051 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:58.665032    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6fdd24/test-model-6fdd24-kserve-54bd85b45c-zjlxz"]
Jul 02 19:36:59.728561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:36:59.728530    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" path="/var/lib/kubelet/pods/3cab5236-bb56-4c26-bdfa-feedc898f5c7/volumes"
Jul 02 19:37:27.868151 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:27.868110    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:37:27.868743 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:27.868377    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" podUID="f53ddce8-5f86-4057-9374-3776ebd0450d" containerName="maas-api" containerID="cri-o://9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447" gracePeriod=30
Jul 02 19:37:28.122898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.122821    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:37:28.303021 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.302974    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") pod \"f53ddce8-5f86-4057-9374-3776ebd0450d\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") "
Jul 02 19:37:28.303021 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.303032    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrpt8\" (UniqueName: \"kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8\") pod \"f53ddce8-5f86-4057-9374-3776ebd0450d\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") "
Jul 02 19:37:28.303302 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.303065    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca\") pod \"f53ddce8-5f86-4057-9374-3776ebd0450d\" (UID: \"f53ddce8-5f86-4057-9374-3776ebd0450d\") "
Jul 02 19:37:28.303534 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.303506    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f53ddce8-5f86-4057-9374-3776ebd0450d" (UID: "f53ddce8-5f86-4057-9374-3776ebd0450d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:37:28.305343 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.305310    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f53ddce8-5f86-4057-9374-3776ebd0450d" (UID: "f53ddce8-5f86-4057-9374-3776ebd0450d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:37:28.305343 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.305309    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8" (OuterVolumeSpecName: "kube-api-access-nrpt8") pod "f53ddce8-5f86-4057-9374-3776ebd0450d" (UID: "f53ddce8-5f86-4057-9374-3776ebd0450d"). InnerVolumeSpecName "kube-api-access-nrpt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:37:28.403792 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.403701    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f53ddce8-5f86-4057-9374-3776ebd0450d-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:28.403792 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.403737    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f53ddce8-5f86-4057-9374-3776ebd0450d-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:28.403792 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.403746    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrpt8\" (UniqueName: \"kubernetes.io/projected/f53ddce8-5f86-4057-9374-3776ebd0450d-kube-api-access-nrpt8\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:28.791121 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.791083    2569 generic.go:356] "Generic (PLEG): container finished" podID="f53ddce8-5f86-4057-9374-3776ebd0450d" containerID="9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447" exitCode=0
Jul 02 19:37:28.791308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.791134    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"
Jul 02 19:37:28.791308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.791150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" event={"ID":"f53ddce8-5f86-4057-9374-3776ebd0450d","Type":"ContainerDied","Data":"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"}
Jul 02 19:37:28.791308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.791197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk" event={"ID":"f53ddce8-5f86-4057-9374-3776ebd0450d","Type":"ContainerDied","Data":"0b3250c4b047d1c48fa5797749e6b36ec2b02b06da8884ba0177fe7cb6c8e1e9"}
Jul 02 19:37:28.791308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.791220    2569 scope.go:117] "RemoveContainer" containerID="9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"
Jul 02 19:37:28.801171 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.801146    2569 scope.go:117] "RemoveContainer" containerID="9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"
Jul 02 19:37:28.801559 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:28.801517    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447\": container with ID starting with 9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447 not found: ID does not exist" containerID="9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"
Jul 02 19:37:28.801640 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.801573    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447"} err="failed to get container status \"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447\": rpc error: code = NotFound desc = could not find container \"9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447\": container with ID starting with 9f27747ca318528ebf893a4a73c301c0c26a462e28035f7a9fb6408168ca4447 not found: ID does not exist"
Jul 02 19:37:28.812191 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.812163    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:37:28.816501 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:28.816468    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4fd26d-86dfbd9d99-cm8kk"]
Jul 02 19:37:29.729972 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:29.729938    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f53ddce8-5f86-4057-9374-3776ebd0450d" path="/var/lib/kubelet/pods/f53ddce8-5f86-4057-9374-3776ebd0450d/volumes"
Jul 02 19:37:34.531495 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531461    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:37:34.531891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531877    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53ddce8-5f86-4057-9374-3776ebd0450d" containerName="maas-api"
Jul 02 19:37:34.531891 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531892    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53ddce8-5f86-4057-9374-3776ebd0450d" containerName="maas-api"
Jul 02 19:37:34.531969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531904    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" containerName="main"
Jul 02 19:37:34.531969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531910    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" containerName="main"
Jul 02 19:37:34.531969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531918    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" containerName="maas-api"
Jul 02 19:37:34.531969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531924    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" containerName="maas-api"
Jul 02 19:37:34.532092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.531997    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cab5236-bb56-4c26-bdfa-feedc898f5c7" containerName="main"
Jul 02 19:37:34.532092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.532006    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53ddce8-5f86-4057-9374-3776ebd0450d" containerName="maas-api"
Jul 02 19:37:34.532092 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.532030    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcca9b7-59ca-45ae-ac5b-4c3d6546bae4" containerName="maas-api"
Jul 02 19:37:34.536517 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.536492    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.539702 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.539682    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1fa94b-openshift-default-dockercfg-8mncf\""
Jul 02 19:37:34.554940 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.554914    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:37:34.666998 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.666953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667017    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xd8m\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667197 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.667396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.667270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768596 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xd8m\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.768817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768732    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769177 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768910    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769177 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.768959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769177 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.769083    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769177 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.769108    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769615 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.769588    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769696 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.769598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.769696 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.769654    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.771333 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.771305    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.771432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.771415    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.782093 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.782024    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xd8m\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.782220 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.782093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token\") pod \"e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") " pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:34.847161 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:34.847128    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:35.023294 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.023262    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:37:35.023718 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:37:35.023690    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4edaa3_c813_476d_9bf8_eb548fc8bf2d.slice/crio-094ac33ed828d221c95de84856d2bb791185cbf20a6e083af809a84b4dc900e3 WatchSource:0}: Error finding container 094ac33ed828d221c95de84856d2bb791185cbf20a6e083af809a84b4dc900e3: Status 404 returned error can't find the container with id 094ac33ed828d221c95de84856d2bb791185cbf20a6e083af809a84b4dc900e3
Jul 02 19:37:35.025724 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.025695    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:35.025789 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.025775    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:35.025824 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.025807    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:35.829666 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.829624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerStarted","Data":"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"}
Jul 02 19:37:35.830130 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.829690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerStarted","Data":"094ac33ed828d221c95de84856d2bb791185cbf20a6e083af809a84b4dc900e3"}
Jul 02 19:37:35.847918 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.847876    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:35.921066 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:35.921006    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podStartSLOduration=1.920985749 podStartE2EDuration="1.920985749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:35.917944655 +0000 UTC m=+2158.890605809" watchObservedRunningTime="2026-07-02 19:37:35.920985749 +0000 UTC m=+2158.893646903"
Jul 02 19:37:36.853050 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:36.853013    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:37.840651 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:37.840607    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:37.841620 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:37.841597    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:38.131976 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.131885    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:37:38.137102 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.137073    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.139694 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.139664    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-1fa94b-serving-cert\""
Jul 02 19:37:38.150752 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.150722    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:37:38.199582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.199550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.199582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.199585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.199817 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.199710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphpl\" (UniqueName: \"kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.300750 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.300704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphpl\" (UniqueName: \"kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.300955 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.300796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.300955 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.300816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.301078 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:38.300945    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-1fa94b-serving-cert: secret "maas-api-e2e-api-a-1fa94b-serving-cert" not found
Jul 02 19:37:38.301078 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:38.301025    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls podName:c74eb7be-6612-4d58-a855-88c089893fbc nodeName:}" failed. No retries permitted until 2026-07-02 19:37:38.801008585 +0000 UTC m=+2161.773669733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls") pod "maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" (UID: "c74eb7be-6612-4d58-a855-88c089893fbc") : secret "maas-api-e2e-api-a-1fa94b-serving-cert" not found
Jul 02 19:37:38.301496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.301478    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.311169 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.311143    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphpl\" (UniqueName: \"kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.806018 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.805968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:38.808540 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:38.808511    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") pod \"maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") " pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:39.051155 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.051113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:39.193733 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.193693    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:37:39.195389 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:37:39.195360    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74eb7be_6612_4d58_a855_88c089893fbc.slice/crio-5aa65514465f442fb112b8cc2a6540cd9f7ea01ce22880b36aaf4512d9d73dea WatchSource:0}: Error finding container 5aa65514465f442fb112b8cc2a6540cd9f7ea01ce22880b36aaf4512d9d73dea: Status 404 returned error can't find the container with id 5aa65514465f442fb112b8cc2a6540cd9f7ea01ce22880b36aaf4512d9d73dea
Jul 02 19:37:39.852118 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.852074    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" event={"ID":"c74eb7be-6612-4d58-a855-88c089893fbc","Type":"ContainerStarted","Data":"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"}
Jul 02 19:37:39.852290 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.852143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" event={"ID":"c74eb7be-6612-4d58-a855-88c089893fbc","Type":"ContainerStarted","Data":"5aa65514465f442fb112b8cc2a6540cd9f7ea01ce22880b36aaf4512d9d73dea"}
Jul 02 19:37:39.852575 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.852318    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:39.869348 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:39.869294    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" podStartSLOduration=1.365530757 podStartE2EDuration="1.869275605s" totalImagesPullingTime="503.744848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:39.868702288 +0000 UTC m=+2162.841363454" watchObservedRunningTime="2026-07-02 19:37:39.869275605 +0000 UTC m=+2162.841936759"
Jul 02 19:37:45.863579 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:45.863550    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:46.384622 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.384584    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:37:46.389447 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.389412    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.393371 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.393339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-05e617-serving-cert\""
Jul 02 19:37:46.399909 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.399836    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:37:46.478509 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.478465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkv5\" (UniqueName: \"kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.478697 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.478532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.478697 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.478638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.579300 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.579252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkv5\" (UniqueName: \"kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.579496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.579314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.579496 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.579360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.579496 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:46.579470    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-05e617-serving-cert: secret "maas-api-e2e-api-b-05e617-serving-cert" not found
Jul 02 19:37:46.579601 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:46.579550    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls podName:4e77cde8-f448-4d23-8f9b-40f139bfc63a nodeName:}" failed. No retries permitted until 2026-07-02 19:37:47.079529853 +0000 UTC m=+2170.052190986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls") pod "maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" (UID: "4e77cde8-f448-4d23-8f9b-40f139bfc63a") : secret "maas-api-e2e-api-b-05e617-serving-cert" not found
Jul 02 19:37:46.580006 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.579987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:46.589612 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:46.589576    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkv5\" (UniqueName: \"kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:47.084755 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:47.084709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:47.087331 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:47.087300    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") pod \"maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") " pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:47.314577 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:47.314525    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:47.497991 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:47.497954    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:37:47.501529 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:37:47.501488    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e77cde8_f448_4d23_8f9b_40f139bfc63a.slice/crio-153d450060b321e1b90cf7c0612d003e8edf05d71c836b327953c7e5a7c6e84f WatchSource:0}: Error finding container 153d450060b321e1b90cf7c0612d003e8edf05d71c836b327953c7e5a7c6e84f: Status 404 returned error can't find the container with id 153d450060b321e1b90cf7c0612d003e8edf05d71c836b327953c7e5a7c6e84f
Jul 02 19:37:47.898501 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:47.898464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" event={"ID":"4e77cde8-f448-4d23-8f9b-40f139bfc63a","Type":"ContainerStarted","Data":"153d450060b321e1b90cf7c0612d003e8edf05d71c836b327953c7e5a7c6e84f"}
Jul 02 19:37:48.906431 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:48.906394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" event={"ID":"4e77cde8-f448-4d23-8f9b-40f139bfc63a","Type":"ContainerStarted","Data":"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"}
Jul 02 19:37:48.906881 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:48.906599    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:48.922982 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:48.922910    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" podStartSLOduration=2.529147472 podStartE2EDuration="2.922888816s" totalImagesPullingTime="393.741344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:48.9226139 +0000 UTC m=+2171.895275055" watchObservedRunningTime="2026-07-02 19:37:48.922888816 +0000 UTC m=+2171.895549970"
Jul 02 19:37:50.920372 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.920339    2569 generic.go:356] "Generic (PLEG): container finished" podID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerID="eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56" exitCode=0
Jul 02 19:37:50.920860 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.920418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerDied","Data":"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"}
Jul 02 19:37:50.920860 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.920835    2569 scope.go:117] "RemoveContainer" containerID="eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"
Jul 02 19:37:50.921880 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.921831    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:50.921990 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.921929    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:50.922035 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:50.921989    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 19:37:51.930258 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:51.930219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerStarted","Data":"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"}
Jul 02 19:37:52.841277 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:52.841241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:52.847498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:52.847465    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:52.848801 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:52.848772    2569 patch_prober.go:28] interesting pod/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 02 19:37:52.848934 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:52.848826    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 02 19:37:53.847599 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:53.847552    2569 patch_prober.go:28] interesting pod/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 02 19:37:53.848037 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:53.847616    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 02 19:37:54.848014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:54.847970    2569 patch_prober.go:28] interesting pod/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 02 19:37:54.848418 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:54.848040    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 02 19:37:54.920730 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:54.920685    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:37:55.848159 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:55.848119    2569 patch_prober.go:28] interesting pod/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 02 19:37:55.848563 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:55.848178    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 02 19:37:56.851859 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:56.851809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:56.852926 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:56.852899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:37:59.469441 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.469391    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:37:59.470428 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.470368    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" podUID="c74eb7be-6612-4d58-a855-88c089893fbc" containerName="maas-api" containerID="cri-o://665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704" gracePeriod=30
Jul 02 19:37:59.738505 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.738468    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:59.801415 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.801374    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca\") pod \"c74eb7be-6612-4d58-a855-88c089893fbc\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") "
Jul 02 19:37:59.801596 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.801502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") pod \"c74eb7be-6612-4d58-a855-88c089893fbc\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") "
Jul 02 19:37:59.801646 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.801615    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kphpl\" (UniqueName: \"kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl\") pod \"c74eb7be-6612-4d58-a855-88c089893fbc\" (UID: \"c74eb7be-6612-4d58-a855-88c089893fbc\") "
Jul 02 19:37:59.802234 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.801825    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c74eb7be-6612-4d58-a855-88c089893fbc" (UID: "c74eb7be-6612-4d58-a855-88c089893fbc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:37:59.802234 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.802028    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c74eb7be-6612-4d58-a855-88c089893fbc-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:59.804344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.804308    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c74eb7be-6612-4d58-a855-88c089893fbc" (UID: "c74eb7be-6612-4d58-a855-88c089893fbc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:37:59.804344 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.804325    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl" (OuterVolumeSpecName: "kube-api-access-kphpl") pod "c74eb7be-6612-4d58-a855-88c089893fbc" (UID: "c74eb7be-6612-4d58-a855-88c089893fbc"). InnerVolumeSpecName "kube-api-access-kphpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:37:59.903304 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.903265    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kphpl\" (UniqueName: \"kubernetes.io/projected/c74eb7be-6612-4d58-a855-88c089893fbc-kube-api-access-kphpl\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:59.903304 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.903298    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c74eb7be-6612-4d58-a855-88c089893fbc-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:37:59.976753 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.976655    2569 generic.go:356] "Generic (PLEG): container finished" podID="c74eb7be-6612-4d58-a855-88c089893fbc" containerID="665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704" exitCode=0
Jul 02 19:37:59.976753 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.976704    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"
Jul 02 19:37:59.976974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.976706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" event={"ID":"c74eb7be-6612-4d58-a855-88c089893fbc","Type":"ContainerDied","Data":"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"}
Jul 02 19:37:59.976974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.976858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4" event={"ID":"c74eb7be-6612-4d58-a855-88c089893fbc","Type":"ContainerDied","Data":"5aa65514465f442fb112b8cc2a6540cd9f7ea01ce22880b36aaf4512d9d73dea"}
Jul 02 19:37:59.976974 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.976889    2569 scope.go:117] "RemoveContainer" containerID="665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"
Jul 02 19:37:59.986987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.986935    2569 scope.go:117] "RemoveContainer" containerID="665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"
Jul 02 19:37:59.987362 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:37:59.987319    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704\": container with ID starting with 665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704 not found: ID does not exist" containerID="665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"
Jul 02 19:37:59.987458 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:37:59.987356    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704"} err="failed to get container status \"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704\": rpc error: code = NotFound desc = could not find container \"665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704\": container with ID starting with 665809debe9df7c16907e683d09ce7400fe3b7fb1d452a1635736f0c5128d704 not found: ID does not exist"
Jul 02 19:38:00.002254 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:00.000778    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:38:00.007655 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:00.007605    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1fa94b-77989d7d46-7rrk4"]
Jul 02 19:38:01.730020 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:01.729983    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74eb7be-6612-4d58-a855-88c089893fbc" path="/var/lib/kubelet/pods/c74eb7be-6612-4d58-a855-88c089893fbc/volumes"
Jul 02 19:38:05.721782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:05.721734    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:38:05.722406 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:05.722038    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy" containerID="cri-o://e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3" gracePeriod=30
Jul 02 19:38:06.996597 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:06.996349    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:38:06.997246 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:06.997188    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" podUID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" containerName="maas-api" containerID="cri-o://6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9" gracePeriod=30
Jul 02 19:38:07.266753 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.266723    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:38:07.371170 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.371132    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca\") pod \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") "
Jul 02 19:38:07.371382 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.371223    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") pod \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") "
Jul 02 19:38:07.371382 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.371284    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkkv5\" (UniqueName: \"kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5\") pod \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\" (UID: \"4e77cde8-f448-4d23-8f9b-40f139bfc63a\") "
Jul 02 19:38:07.371558 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.371527    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e77cde8-f448-4d23-8f9b-40f139bfc63a" (UID: "4e77cde8-f448-4d23-8f9b-40f139bfc63a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:38:07.371643 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.371625    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e77cde8-f448-4d23-8f9b-40f139bfc63a-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:07.373354 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.373329    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e77cde8-f448-4d23-8f9b-40f139bfc63a" (UID: "4e77cde8-f448-4d23-8f9b-40f139bfc63a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:38:07.373453 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.373437    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5" (OuterVolumeSpecName: "kube-api-access-dkkv5") pod "4e77cde8-f448-4d23-8f9b-40f139bfc63a" (UID: "4e77cde8-f448-4d23-8f9b-40f139bfc63a"). InnerVolumeSpecName "kube-api-access-dkkv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:07.472931 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.472881    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77cde8-f448-4d23-8f9b-40f139bfc63a-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:07.472931 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:07.472926    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkkv5\" (UniqueName: \"kubernetes.io/projected/4e77cde8-f448-4d23-8f9b-40f139bfc63a-kube-api-access-dkkv5\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:08.022317 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.022220    2569 generic.go:356] "Generic (PLEG): container finished" podID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" containerID="6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9" exitCode=0
Jul 02 19:38:08.022317 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.022273    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"
Jul 02 19:38:08.022317 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.022292    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" event={"ID":"4e77cde8-f448-4d23-8f9b-40f139bfc63a","Type":"ContainerDied","Data":"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"}
Jul 02 19:38:08.022857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.022341    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5" event={"ID":"4e77cde8-f448-4d23-8f9b-40f139bfc63a","Type":"ContainerDied","Data":"153d450060b321e1b90cf7c0612d003e8edf05d71c836b327953c7e5a7c6e84f"}
Jul 02 19:38:08.022857 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.022364    2569 scope.go:117] "RemoveContainer" containerID="6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"
Jul 02 19:38:08.032130 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.032106    2569 scope.go:117] "RemoveContainer" containerID="6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"
Jul 02 19:38:08.032452 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:08.032428    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9\": container with ID starting with 6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9 not found: ID does not exist" containerID="6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"
Jul 02 19:38:08.032521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.032460    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9"} err="failed to get container status \"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9\": rpc error: code = NotFound desc = could not find container \"6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9\": container with ID starting with 6b94894481722723e4112f2a498b9749c88b7c7d2539e9f0e9a9c77cb69d04e9 not found: ID does not exist"
Jul 02 19:38:08.042494 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.042455    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:38:08.048633 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:08.048601    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-05e617-7d49b8f5bb-bp8h5"]
Jul 02 19:38:09.729962 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:09.729924    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" path="/var/lib/kubelet/pods/4e77cde8-f448-4d23-8f9b-40f139bfc63a/volumes"
Jul 02 19:38:10.987610 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:10.987534    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:38:11.041504 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.041471    2569 generic.go:356] "Generic (PLEG): container finished" podID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerID="e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3" exitCode=0
Jul 02 19:38:11.041685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.041509    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerDied","Data":"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"}
Jul 02 19:38:11.041685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.041520    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"
Jul 02 19:38:11.041685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.041555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl" event={"ID":"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d","Type":"ContainerDied","Data":"094ac33ed828d221c95de84856d2bb791185cbf20a6e083af809a84b4dc900e3"}
Jul 02 19:38:11.041685 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.041580    2569 scope.go:117] "RemoveContainer" containerID="e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"
Jul 02 19:38:11.050967 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.050941    2569 scope.go:117] "RemoveContainer" containerID="eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"
Jul 02 19:38:11.060110 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.060077    2569 scope.go:117] "RemoveContainer" containerID="e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"
Jul 02 19:38:11.060435 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:11.060416    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3\": container with ID starting with e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3 not found: ID does not exist" containerID="e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"
Jul 02 19:38:11.060508 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.060444    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3"} err="failed to get container status \"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3\": rpc error: code = NotFound desc = could not find container \"e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3\": container with ID starting with e693342d74fb030e7d53afc2c0f771d08e60a2048b7ae15a1f916a9a37c163e3 not found: ID does not exist"
Jul 02 19:38:11.060508 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.060463    2569 scope.go:117] "RemoveContainer" containerID="eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"
Jul 02 19:38:11.060758 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:11.060736    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56\": container with ID starting with eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56 not found: ID does not exist" containerID="eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"
Jul 02 19:38:11.060821 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.060771    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56"} err="failed to get container status \"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56\": rpc error: code = NotFound desc = could not find container \"eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56\": container with ID starting with eb4d0ae0e225fdbd92dfa9988c279cd3a34796f8eff606dd6e039df1b310ba56 not found: ID does not exist"
Jul 02 19:38:11.109434 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109394    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109456    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109477    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109527    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109579    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109794 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109604    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109794 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109649    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xd8m\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109794 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109693    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs\") pod \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\" (UID: \"bc4edaa3-c813-476d-9bf8-eb548fc8bf2d\") "
Jul 02 19:38:11.109794 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:11.110048 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109836    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:11.110048 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.109966    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:38:11.110166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.110108    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:11.110166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.110125    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.110166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.110150    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.110166 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.110165    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.110682 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.110658    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:11.112634 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.112595    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:38:11.112634 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.112625    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m" (OuterVolumeSpecName: "kube-api-access-8xd8m") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "kube-api-access-8xd8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:11.112782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.112624    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:11.112782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.112642    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" (UID: "bc4edaa3-c813-476d-9bf8-eb548fc8bf2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:11.210678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210634    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.210678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210670    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.210678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210679    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.210678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210687    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.210678 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210694    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.211055 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.210702    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xd8m\" (UniqueName: \"kubernetes.io/projected/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d-kube-api-access-8xd8m\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.383753 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.383712    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:38:11.389555 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.389519    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1fa94b-openshift-default-6dc9fc9597-htsnl"]
Jul 02 19:38:11.729596 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:11.729503    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" path="/var/lib/kubelet/pods/bc4edaa3-c813-476d-9bf8-eb548fc8bf2d/volumes"
Jul 02 19:38:17.489811 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.489768    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:38:17.490225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490180    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74eb7be-6612-4d58-a855-88c089893fbc" containerName="maas-api"
Jul 02 19:38:17.490225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490192    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74eb7be-6612-4d58-a855-88c089893fbc" containerName="maas-api"
Jul 02 19:38:17.490225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490210    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:17.490225 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490216    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490232    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" containerName="maas-api"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490238    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" containerName="maas-api"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490302    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490309    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490316    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e77cde8-f448-4d23-8f9b-40f139bfc63a" containerName="maas-api"
Jul 02 19:38:17.490413 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.490322    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74eb7be-6612-4d58-a855-88c089893fbc" containerName="maas-api"
Jul 02 19:38:17.492525 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.492502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.495398 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.495376    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-50666c-serving-cert\""
Jul 02 19:38:17.510045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.510012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:38:17.571611 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.571568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bvwt\" (UniqueName: \"kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.571797 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.571671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.571797 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.571705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.672606 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.672563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.672831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.672621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.672831 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.672708    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bvwt\" (UniqueName: \"kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.672831 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:17.672720    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-50666c-serving-cert: secret "maas-api-e2e-shared-a-50666c-serving-cert" not found
Jul 02 19:38:17.672831 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:17.672807    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls podName:4823f193-6a83-4832-9c37-b40c71b25777 nodeName:}" failed. No retries permitted until 2026-07-02 19:38:18.172784379 +0000 UTC m=+2201.145445513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls") pod "maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" (UID: "4823f193-6a83-4832-9c37-b40c71b25777") : secret "maas-api-e2e-shared-a-50666c-serving-cert" not found
Jul 02 19:38:17.673398 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.673373    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:17.684335 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:17.684297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bvwt\" (UniqueName: \"kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:18.178946 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:18.178907    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:18.179192 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:18.179036    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-50666c-serving-cert: secret "maas-api-e2e-shared-a-50666c-serving-cert" not found
Jul 02 19:38:18.179192 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:18.179091    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls podName:4823f193-6a83-4832-9c37-b40c71b25777 nodeName:}" failed. No retries permitted until 2026-07-02 19:38:19.179077799 +0000 UTC m=+2202.151738932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls") pod "maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" (UID: "4823f193-6a83-4832-9c37-b40c71b25777") : secret "maas-api-e2e-shared-a-50666c-serving-cert" not found
Jul 02 19:38:19.188146 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:19.188107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:19.190662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:19.190622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") " pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:19.304367 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:19.304309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:19.451236 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:19.451208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:38:19.453835 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:38:19.453801    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4823f193_6a83_4832_9c37_b40c71b25777.slice/crio-0edf9ab424593d1f95d720b722152194e881e717b1d01bca59473d902ceab515 WatchSource:0}: Error finding container 0edf9ab424593d1f95d720b722152194e881e717b1d01bca59473d902ceab515: Status 404 returned error can't find the container with id 0edf9ab424593d1f95d720b722152194e881e717b1d01bca59473d902ceab515
Jul 02 19:38:20.095637 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:20.095584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" event={"ID":"4823f193-6a83-4832-9c37-b40c71b25777","Type":"ContainerStarted","Data":"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"}
Jul 02 19:38:20.095822 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:20.095654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" event={"ID":"4823f193-6a83-4832-9c37-b40c71b25777","Type":"ContainerStarted","Data":"0edf9ab424593d1f95d720b722152194e881e717b1d01bca59473d902ceab515"}
Jul 02 19:38:20.095822 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:20.095772    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:20.115142 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:20.115084    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" podStartSLOduration=2.823151353 podStartE2EDuration="3.115068492s" totalImagesPullingTime="291.917139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:20.113437632 +0000 UTC m=+2203.086098814" watchObservedRunningTime="2026-07-02 19:38:20.115068492 +0000 UTC m=+2203.087729683"
Jul 02 19:38:25.474920 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.474879    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:38:25.475502 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.475481    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:25.475582 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.475506    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4edaa3-c813-476d-9bf8-eb548fc8bf2d" containerName="istio-proxy"
Jul 02 19:38:25.478304 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.478276    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.480969 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.480943    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-6e39fb-serving-cert\""
Jul 02 19:38:25.489221 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.489183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:38:25.646649 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.646605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7cn\" (UniqueName: \"kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.646913 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.646665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.646913 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.646776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.748768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.748958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.749096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7cn\" (UniqueName: \"kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.749582    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:25.749624    2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-6e39fb-serving-cert: secret "maas-api-e2e-shared-b-6e39fb-serving-cert" not found
Jul 02 19:38:25.755185 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:38:25.749707    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls podName:15d94293-f9a1-48bb-ab54-b8aca358e754 nodeName:}" failed. No retries permitted until 2026-07-02 19:38:26.249679971 +0000 UTC m=+2209.222341108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls") pod "maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" (UID: "15d94293-f9a1-48bb-ab54-b8aca358e754") : secret "maas-api-e2e-shared-b-6e39fb-serving-cert" not found
Jul 02 19:38:25.762758 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:25.762717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7cn\" (UniqueName: \"kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:26.109367 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:26.109334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:38:26.255165 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:26.255117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:26.257776 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:26.257752    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") pod \"maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") " pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:26.393109 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:26.393009    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:26.560051 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:26.560020    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:38:26.561904 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:38:26.561874    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d94293_f9a1_48bb_ab54_b8aca358e754.slice/crio-f61cd67cec1b3ee81fb9e7fa86265beec274047b8e9f5544a5642d53a0ff1ec7 WatchSource:0}: Error finding container f61cd67cec1b3ee81fb9e7fa86265beec274047b8e9f5544a5642d53a0ff1ec7: Status 404 returned error can't find the container with id f61cd67cec1b3ee81fb9e7fa86265beec274047b8e9f5544a5642d53a0ff1ec7
Jul 02 19:38:27.135058 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:27.135015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" event={"ID":"15d94293-f9a1-48bb-ab54-b8aca358e754","Type":"ContainerStarted","Data":"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"}
Jul 02 19:38:27.135237 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:27.135179    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:27.135237 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:27.135208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" event={"ID":"15d94293-f9a1-48bb-ab54-b8aca358e754","Type":"ContainerStarted","Data":"f61cd67cec1b3ee81fb9e7fa86265beec274047b8e9f5544a5642d53a0ff1ec7"}
Jul 02 19:38:27.154680 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:27.154624    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" podStartSLOduration=1.768755343 podStartE2EDuration="2.15460501s" totalImagesPullingTime="385.849667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:27.153100113 +0000 UTC m=+2210.125761270" watchObservedRunningTime="2026-07-02 19:38:27.15460501 +0000 UTC m=+2210.127266211"
Jul 02 19:38:33.146803 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:33.146770    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:38:39.470691 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.470652    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:38:39.476039 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.476005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.479712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.479676    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"kube-root-ca.crt\""
Jul 02 19:38:39.479712 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.479680    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"openshift-service-ca.crt\""
Jul 02 19:38:39.480075 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.479675    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"default-dockercfg-7cjrg\""
Jul 02 19:38:39.480075 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.479679    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"auth-test-model-50666c-kserve-self-signed-certs\""
Jul 02 19:38:39.492464 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.492433    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:38:39.564060 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.564060 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564064    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.564291 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.564291 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpsx\" (UniqueName: \"kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.564291 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.564396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.564317    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.664798 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpsx\" (UniqueName: \"kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665033 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.664995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665355 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.665326    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.665385    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.665446 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.665405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.667426 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.667392    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.667754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.667580    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.672936 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.672906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpsx\" (UniqueName: \"kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx\") pod \"auth-test-model-50666c-kserve-cdc8cd675-c58sz\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") " pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.786058 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.786022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:39.935034 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:39.935001    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:38:39.937212 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:38:39.937176    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f2271bc_365b_452a_803a_5f48cab4df57.slice/crio-d230e9ff23cdc8d6d7459b5c52d360dac48eed91f4955efac1cef092b2d5a992 WatchSource:0}: Error finding container d230e9ff23cdc8d6d7459b5c52d360dac48eed91f4955efac1cef092b2d5a992: Status 404 returned error can't find the container with id d230e9ff23cdc8d6d7459b5c52d360dac48eed91f4955efac1cef092b2d5a992
Jul 02 19:38:40.207875 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:40.207761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" event={"ID":"2f2271bc-365b-452a-803a-5f48cab4df57","Type":"ContainerStarted","Data":"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"}
Jul 02 19:38:40.207875 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:40.207819    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" event={"ID":"2f2271bc-365b-452a-803a-5f48cab4df57","Type":"ContainerStarted","Data":"d230e9ff23cdc8d6d7459b5c52d360dac48eed91f4955efac1cef092b2d5a992"}
Jul 02 19:38:40.225163 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:40.225097    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" podStartSLOduration=1.225078037 podStartE2EDuration="1.225078037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:40.224133981 +0000 UTC m=+2223.196795145" watchObservedRunningTime="2026-07-02 19:38:40.225078037 +0000 UTC m=+2223.197739194"
Jul 02 19:38:49.786825 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:49.786775    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:49.787276 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:49.786877    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:49.799396 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:49.799367    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:38:50.278408 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:38:50.278383    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:41:07.145910 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:07.145808    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:41:22.167468 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.167418    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" podUID="2f2271bc-365b-452a-803a-5f48cab4df57" containerName="main" containerID="cri-o://0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296" gracePeriod=45
Jul 02 19:41:22.434514 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.434428    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:41:22.528898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.528822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.528930    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.528958    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.528975    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529006    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529095 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529032    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmpsx\" (UniqueName: \"kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx\") pod \"2f2271bc-365b-452a-803a-5f48cab4df57\" (UID: \"2f2271bc-365b-452a-803a-5f48cab4df57\") "
Jul 02 19:41:22.529388 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529127    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home" (OuterVolumeSpecName: "home") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:22.529388 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529261    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:22.529388 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529278    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:22.529523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529420    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:22.529523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529434    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:22.529523 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.529445    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:22.531341 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.531301    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm" (OuterVolumeSpecName: "dshm") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:22.531463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.531380    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:41:22.531463 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.531411    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx" (OuterVolumeSpecName: "kube-api-access-tmpsx") pod "2f2271bc-365b-452a-803a-5f48cab4df57" (UID: "2f2271bc-365b-452a-803a-5f48cab4df57"). InnerVolumeSpecName "kube-api-access-tmpsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:41:22.630045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.629993    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2271bc-365b-452a-803a-5f48cab4df57-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:22.630045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.630032    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2271bc-365b-452a-803a-5f48cab4df57-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:22.630045 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:22.630047    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmpsx\" (UniqueName: \"kubernetes.io/projected/2f2271bc-365b-452a-803a-5f48cab4df57-kube-api-access-tmpsx\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.068815 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.068778    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f2271bc-365b-452a-803a-5f48cab4df57" containerID="0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296" exitCode=0
Jul 02 19:41:23.069099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.068827    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"
Jul 02 19:41:23.069099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.068875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" event={"ID":"2f2271bc-365b-452a-803a-5f48cab4df57","Type":"ContainerDied","Data":"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"}
Jul 02 19:41:23.069099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.068925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz" event={"ID":"2f2271bc-365b-452a-803a-5f48cab4df57","Type":"ContainerDied","Data":"d230e9ff23cdc8d6d7459b5c52d360dac48eed91f4955efac1cef092b2d5a992"}
Jul 02 19:41:23.069099 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.068943    2569 scope.go:117] "RemoveContainer" containerID="0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"
Jul 02 19:41:23.080623 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.080599    2569 scope.go:117] "RemoveContainer" containerID="0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"
Jul 02 19:41:23.080966 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:41:23.080942    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296\": container with ID starting with 0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296 not found: ID does not exist" containerID="0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"
Jul 02 19:41:23.081035 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.080976    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296"} err="failed to get container status \"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296\": rpc error: code = NotFound desc = could not find container \"0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296\": container with ID starting with 0e7962977537e2435d4d53954380aabb3f40677fa38bf38519ff17006d4b3296 not found: ID does not exist"
Jul 02 19:41:23.091555 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.091522    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:41:23.095824 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.095791    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/auth-test-model-50666c-kserve-cdc8cd675-c58sz"]
Jul 02 19:41:23.729461 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:23.729412    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2271bc-365b-452a-803a-5f48cab4df57" path="/var/lib/kubelet/pods/2f2271bc-365b-452a-803a-5f48cab4df57/volumes"
Jul 02 19:41:37.700613 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:37.700578    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:41:37.710365 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:41:37.710337    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r5pzm_738ebfaf-caba-4bd6-aa56-80d60490f4b9/ovn-acl-logging/0.log"
Jul 02 19:42:41.559965 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.559924    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:42:41.560393 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.560336    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2271bc-365b-452a-803a-5f48cab4df57" containerName="main"
Jul 02 19:42:41.560393 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.560347    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2271bc-365b-452a-803a-5f48cab4df57" containerName="main"
Jul 02 19:42:41.560469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.560424    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2271bc-365b-452a-803a-5f48cab4df57" containerName="main"
Jul 02 19:42:41.563564 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.563544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.566199 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.566163    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"kube-root-ca.crt\""
Jul 02 19:42:41.566363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.566263    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"default-dockercfg-7cjrg\""
Jul 02 19:42:41.566363 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.566264    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"openshift-service-ca.crt\""
Jul 02 19:42:41.567056 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.567042    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"rate-test-model-50666c-kserve-self-signed-certs\""
Jul 02 19:42:41.572699 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.572666    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:42:41.673612 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.673612 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673615    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.673903 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdm8p\" (UniqueName: \"kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.673903 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673738    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.673903 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.674024 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.673899    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775024 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.774986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775024 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdm8p\" (UniqueName: \"kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775281 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775190    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775573 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775498    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775573 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775512    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.775700 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.775596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.777478 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.777458    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.777910 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.777882    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.783742 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.783705    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdm8p\" (UniqueName: \"kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p\") pod \"rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") " pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:41.875098 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:41.874992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:42.021768 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:42.021735    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:42:42.024027 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:42:42.023996    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ab4070f_aae5_480e_9a3f_e8972f1631af.slice/crio-73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f WatchSource:0}: Error finding container 73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f: Status 404 returned error can't find the container with id 73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f
Jul 02 19:42:42.493105 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:42.493060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" event={"ID":"1ab4070f-aae5-480e-9a3f-e8972f1631af","Type":"ContainerStarted","Data":"d848187a58c87b19df7c30c38a40bf317dc406728a17228940ada19768ac7c68"}
Jul 02 19:42:42.493264 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:42.493115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" event={"ID":"1ab4070f-aae5-480e-9a3f-e8972f1631af","Type":"ContainerStarted","Data":"73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f"}
Jul 02 19:42:42.511047 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:42.510993    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" podStartSLOduration=1.5109770569999998 podStartE2EDuration="1.510977057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:42:42.508282322 +0000 UTC m=+2465.480943475" watchObservedRunningTime="2026-07-02 19:42:42.510977057 +0000 UTC m=+2465.483638211"
Jul 02 19:42:51.875147 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:51.875106    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:51.877539 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:51.875166    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:51.888533 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:51.888487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:42:52.558526 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:42:52.558491    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:44:07.765366 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:07.765276    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:44:10.360594 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.360541    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:44:10.361183 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.360917    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" podUID="4823f193-6a83-4832-9c37-b40c71b25777" containerName="maas-api" containerID="cri-o://51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db" gracePeriod=30
Jul 02 19:44:10.628634 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.628602    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:44:10.728739 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.728694    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") pod \"4823f193-6a83-4832-9c37-b40c71b25777\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") "
Jul 02 19:44:10.728987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.728757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca\") pod \"4823f193-6a83-4832-9c37-b40c71b25777\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") "
Jul 02 19:44:10.728987 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.728832    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bvwt\" (UniqueName: \"kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt\") pod \"4823f193-6a83-4832-9c37-b40c71b25777\" (UID: \"4823f193-6a83-4832-9c37-b40c71b25777\") "
Jul 02 19:44:10.729205 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.729169    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4823f193-6a83-4832-9c37-b40c71b25777" (UID: "4823f193-6a83-4832-9c37-b40c71b25777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:44:10.730940 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.730898    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4823f193-6a83-4832-9c37-b40c71b25777" (UID: "4823f193-6a83-4832-9c37-b40c71b25777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:44:10.730940 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.730917    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt" (OuterVolumeSpecName: "kube-api-access-8bvwt") pod "4823f193-6a83-4832-9c37-b40c71b25777" (UID: "4823f193-6a83-4832-9c37-b40c71b25777"). InnerVolumeSpecName "kube-api-access-8bvwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:44:10.830301 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.830260    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4823f193-6a83-4832-9c37-b40c71b25777-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:10.830301 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.830291    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4823f193-6a83-4832-9c37-b40c71b25777-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:10.830301 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.830306    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bvwt\" (UniqueName: \"kubernetes.io/projected/4823f193-6a83-4832-9c37-b40c71b25777-kube-api-access-8bvwt\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:10.983553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.983453    2569 generic.go:356] "Generic (PLEG): container finished" podID="4823f193-6a83-4832-9c37-b40c71b25777" containerID="51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db" exitCode=0
Jul 02 19:44:10.983553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.983503    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"
Jul 02 19:44:10.983553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.983523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" event={"ID":"4823f193-6a83-4832-9c37-b40c71b25777","Type":"ContainerDied","Data":"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"}
Jul 02 19:44:10.983782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.983570    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq" event={"ID":"4823f193-6a83-4832-9c37-b40c71b25777","Type":"ContainerDied","Data":"0edf9ab424593d1f95d720b722152194e881e717b1d01bca59473d902ceab515"}
Jul 02 19:44:10.983782 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.983592    2569 scope.go:117] "RemoveContainer" containerID="51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"
Jul 02 19:44:10.993521 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.993496    2569 scope.go:117] "RemoveContainer" containerID="51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"
Jul 02 19:44:10.993912 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:44:10.993887    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db\": container with ID starting with 51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db not found: ID does not exist" containerID="51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"
Jul 02 19:44:10.993980 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:10.993923    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db"} err="failed to get container status \"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db\": rpc error: code = NotFound desc = could not find container \"51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db\": container with ID starting with 51024214a4e545d30fc7fd9aed23a038eee677e4c81868370d24029ed1e884db not found: ID does not exist"
Jul 02 19:44:11.017875 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:11.017807    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:44:11.023424 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:11.023388    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-50666c-67ff7b4c6d-7sjrq"]
Jul 02 19:44:11.729620 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:11.729582    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4823f193-6a83-4832-9c37-b40c71b25777" path="/var/lib/kubelet/pods/4823f193-6a83-4832-9c37-b40c71b25777/volumes"
Jul 02 19:44:22.786362 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:22.786302    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" podUID="1ab4070f-aae5-480e-9a3f-e8972f1631af" containerName="main" containerID="cri-o://d848187a58c87b19df7c30c38a40bf317dc406728a17228940ada19768ac7c68" gracePeriod=45
Jul 02 19:44:23.049481 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.049395    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ab4070f-aae5-480e-9a3f-e8972f1631af" containerID="d848187a58c87b19df7c30c38a40bf317dc406728a17228940ada19768ac7c68" exitCode=0
Jul 02 19:44:23.049481 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.049463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" event={"ID":"1ab4070f-aae5-480e-9a3f-e8972f1631af","Type":"ContainerDied","Data":"d848187a58c87b19df7c30c38a40bf317dc406728a17228940ada19768ac7c68"}
Jul 02 19:44:23.049646 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.049491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k" event={"ID":"1ab4070f-aae5-480e-9a3f-e8972f1631af","Type":"ContainerDied","Data":"73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f"}
Jul 02 19:44:23.049646 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.049502    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73450e277043fa116bcb86e988d0b56f2bdff410ec1ff0d38d184b0cd4cbe07f"
Jul 02 19:44:23.053490 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.053463    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:44:23.148385 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148351    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148589 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148420    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148589 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148437    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148589 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148478    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdm8p\" (UniqueName: \"kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148589 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148499    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148822 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148591    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home\") pod \"1ab4070f-aae5-480e-9a3f-e8972f1631af\" (UID: \"1ab4070f-aae5-480e-9a3f-e8972f1631af\") "
Jul 02 19:44:23.148822 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148692    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:23.148993 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148875    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:23.148993 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148910    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home" (OuterVolumeSpecName: "home") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:23.149167 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.148991    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:23.149167 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.149008    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:23.149167 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.149019    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:23.150662 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.150629    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm" (OuterVolumeSpecName: "dshm") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:23.150779 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.150674    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:44:23.150779 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.150726    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p" (OuterVolumeSpecName: "kube-api-access-rdm8p") pod "1ab4070f-aae5-480e-9a3f-e8972f1631af" (UID: "1ab4070f-aae5-480e-9a3f-e8972f1631af"). InnerVolumeSpecName "kube-api-access-rdm8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:44:23.250212 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.250161    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab4070f-aae5-480e-9a3f-e8972f1631af-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:23.250212 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.250201    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdm8p\" (UniqueName: \"kubernetes.io/projected/1ab4070f-aae5-480e-9a3f-e8972f1631af-kube-api-access-rdm8p\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:23.250212 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:23.250216    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab4070f-aae5-480e-9a3f-e8972f1631af-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.055091 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:24.055054    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"
Jul 02 19:44:24.071910 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:24.071871    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:44:24.076368 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:24.076328    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/rate-test-model-50666c-kserve-5fc7bf66c5-mpx4k"]
Jul 02 19:44:25.730211 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:25.730171    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab4070f-aae5-480e-9a3f-e8972f1631af" path="/var/lib/kubelet/pods/1ab4070f-aae5-480e-9a3f-e8972f1631af/volumes"
Jul 02 19:44:53.895990 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:53.895952    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:44:53.897006 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:53.896967    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" podUID="15d94293-f9a1-48bb-ab54-b8aca358e754" containerName="maas-api" containerID="cri-o://1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15" gracePeriod=30
Jul 02 19:44:54.157551 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.157477    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:44:54.231047 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.231007    2569 generic.go:356] "Generic (PLEG): container finished" podID="15d94293-f9a1-48bb-ab54-b8aca358e754" containerID="1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15" exitCode=0
Jul 02 19:44:54.231219 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.231053    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"
Jul 02 19:44:54.231219 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.231088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" event={"ID":"15d94293-f9a1-48bb-ab54-b8aca358e754","Type":"ContainerDied","Data":"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"}
Jul 02 19:44:54.231219 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.231145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm" event={"ID":"15d94293-f9a1-48bb-ab54-b8aca358e754","Type":"ContainerDied","Data":"f61cd67cec1b3ee81fb9e7fa86265beec274047b8e9f5544a5642d53a0ff1ec7"}
Jul 02 19:44:54.231219 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.231170    2569 scope.go:117] "RemoveContainer" containerID="1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"
Jul 02 19:44:54.236216 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.236191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls7cn\" (UniqueName: \"kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn\") pod \"15d94293-f9a1-48bb-ab54-b8aca358e754\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") "
Jul 02 19:44:54.236336 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.236251    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca\") pod \"15d94293-f9a1-48bb-ab54-b8aca358e754\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") "
Jul 02 19:44:54.236412 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.236396    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") pod \"15d94293-f9a1-48bb-ab54-b8aca358e754\" (UID: \"15d94293-f9a1-48bb-ab54-b8aca358e754\") "
Jul 02 19:44:54.236643 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.236620    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15d94293-f9a1-48bb-ab54-b8aca358e754" (UID: "15d94293-f9a1-48bb-ab54-b8aca358e754"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:44:54.236709 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.236689    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d94293-f9a1-48bb-ab54-b8aca358e754-openshift-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:54.238383 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.238359    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn" (OuterVolumeSpecName: "kube-api-access-ls7cn") pod "15d94293-f9a1-48bb-ab54-b8aca358e754" (UID: "15d94293-f9a1-48bb-ab54-b8aca358e754"). InnerVolumeSpecName "kube-api-access-ls7cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:44:54.238506 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.238467    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15d94293-f9a1-48bb-ab54-b8aca358e754" (UID: "15d94293-f9a1-48bb-ab54-b8aca358e754"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:44:54.241561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.241541    2569 scope.go:117] "RemoveContainer" containerID="1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"
Jul 02 19:44:54.241901 ip-10-0-134-80 kubenswrapper[2569]: E0702 19:44:54.241884    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15\": container with ID starting with 1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15 not found: ID does not exist" containerID="1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"
Jul 02 19:44:54.241962 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.241912    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15"} err="failed to get container status \"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15\": rpc error: code = NotFound desc = could not find container \"1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15\": container with ID starting with 1d02f65f1a691385c1eb950c022fdec614def5ef4354085399ea008cfcf63b15 not found: ID does not exist"
Jul 02 19:44:54.337705 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.337657    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls7cn\" (UniqueName: \"kubernetes.io/projected/15d94293-f9a1-48bb-ab54-b8aca358e754-kube-api-access-ls7cn\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:54.337705 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.337696    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15d94293-f9a1-48bb-ab54-b8aca358e754-maas-api-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:44:54.553278 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.553237    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:44:54.558055 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:54.558025    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6e39fb-6575879d64-gprsm"]
Jul 02 19:44:55.729741 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:44:55.729704    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d94293-f9a1-48bb-ab54-b8aca358e754" path="/var/lib/kubelet/pods/15d94293-f9a1-48bb-ab54-b8aca358e754/volumes"
Jul 02 19:45:00.148934 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.148818    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dpmdj"]
Jul 02 19:45:00.149471 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149450    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab4070f-aae5-480e-9a3f-e8972f1631af" containerName="main"
Jul 02 19:45:00.149553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149475    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab4070f-aae5-480e-9a3f-e8972f1631af" containerName="main"
Jul 02 19:45:00.149553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149490    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4823f193-6a83-4832-9c37-b40c71b25777" containerName="maas-api"
Jul 02 19:45:00.149553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149498    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4823f193-6a83-4832-9c37-b40c71b25777" containerName="maas-api"
Jul 02 19:45:00.149553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149510    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d94293-f9a1-48bb-ab54-b8aca358e754" containerName="maas-api"
Jul 02 19:45:00.149553 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149520    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d94293-f9a1-48bb-ab54-b8aca358e754" containerName="maas-api"
Jul 02 19:45:00.149799 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149614    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d94293-f9a1-48bb-ab54-b8aca358e754" containerName="maas-api"
Jul 02 19:45:00.149799 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149632    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab4070f-aae5-480e-9a3f-e8972f1631af" containerName="main"
Jul 02 19:45:00.149799 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.149644    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4823f193-6a83-4832-9c37-b40c71b25777" containerName="maas-api"
Jul 02 19:45:00.154119 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.154090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:00.160762 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.160718    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dpmdj"]
Jul 02 19:45:00.292232 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.292193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mvs\" (UniqueName: \"kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs\") pod \"maas-api-key-cleanup-29717025-dpmdj\" (UID: \"0705a494-7184-4c21-a662-305d5187ebf8\") " pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:00.393917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.393825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mvs\" (UniqueName: \"kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs\") pod \"maas-api-key-cleanup-29717025-dpmdj\" (UID: \"0705a494-7184-4c21-a662-305d5187ebf8\") " pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:00.403156 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.403075    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mvs\" (UniqueName: \"kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs\") pod \"maas-api-key-cleanup-29717025-dpmdj\" (UID: \"0705a494-7184-4c21-a662-305d5187ebf8\") " pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:00.467129 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.467082    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:00.643457 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:00.643421    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dpmdj"]
Jul 02 19:45:00.647153 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:45:00.647123    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0705a494_7184_4c21_a662_305d5187ebf8.slice/crio-7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3 WatchSource:0}: Error finding container 7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3: Status 404 returned error can't find the container with id 7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3
Jul 02 19:45:01.286944 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:01.286889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj" event={"ID":"0705a494-7184-4c21-a662-305d5187ebf8","Type":"ContainerStarted","Data":"40a1623594fa20743a2404a0c2c2fdd4be6745eb26de414a928b1d076c55bfc5"}
Jul 02 19:45:01.287464 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:01.286996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj" event={"ID":"0705a494-7184-4c21-a662-305d5187ebf8","Type":"ContainerStarted","Data":"7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3"}
Jul 02 19:45:01.307770 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:01.307710    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj" podStartSLOduration=1.307692225 podStartE2EDuration="1.307692225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:01.306188731 +0000 UTC m=+2604.278849879" watchObservedRunningTime="2026-07-02 19:45:01.307692225 +0000 UTC m=+2604.280353379"
Jul 02 19:45:02.293961 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:02.293920    2569 generic.go:356] "Generic (PLEG): container finished" podID="0705a494-7184-4c21-a662-305d5187ebf8" containerID="40a1623594fa20743a2404a0c2c2fdd4be6745eb26de414a928b1d076c55bfc5" exitCode=0
Jul 02 19:45:02.294389 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:02.293968    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj" event={"ID":"0705a494-7184-4c21-a662-305d5187ebf8","Type":"ContainerDied","Data":"40a1623594fa20743a2404a0c2c2fdd4be6745eb26de414a928b1d076c55bfc5"}
Jul 02 19:45:03.438949 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:03.438914    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:03.523649 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:03.523614    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6mvs\" (UniqueName: \"kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs\") pod \"0705a494-7184-4c21-a662-305d5187ebf8\" (UID: \"0705a494-7184-4c21-a662-305d5187ebf8\") "
Jul 02 19:45:03.525756 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:03.525727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs" (OuterVolumeSpecName: "kube-api-access-z6mvs") pod "0705a494-7184-4c21-a662-305d5187ebf8" (UID: "0705a494-7184-4c21-a662-305d5187ebf8"). InnerVolumeSpecName "kube-api-access-z6mvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:03.625081 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:03.624982    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6mvs\" (UniqueName: \"kubernetes.io/projected/0705a494-7184-4c21-a662-305d5187ebf8-kube-api-access-z6mvs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Jul 02 19:45:04.305619 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:04.305583    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj" event={"ID":"0705a494-7184-4c21-a662-305d5187ebf8","Type":"ContainerDied","Data":"7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3"}
Jul 02 19:45:04.305619 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:04.305605    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dpmdj"
Jul 02 19:45:04.305839 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:04.305634    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7584597c2d69c5d4e1a4c65e02de6136d96b1dbac6a31f89d875b0e17d0ad2d3"
Jul 02 19:45:05.259892 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.259830    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffslw_7d7da5c5-de5a-4017-bfab-aee8f8b425d7/manager/0.log"
Jul 02 19:45:05.375226 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.375194    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n29pk_0913da59-b9f3-46a8-bd04-b161f631390e/manager/0.log"
Jul 02 19:45:05.492961 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.492924    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74ddc86c7d-cc2lz_1702e2c8-0fa8-4a79-9952-709e2ba8d7e9/maas-api/0.log"
Jul 02 19:45:05.711586 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.711561    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-ndlbb_3b5c5300-57d1-4d22-b701-1e82dc289588/cleanup/0.log"
Jul 02 19:45:05.835009 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.834973    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717025-dpmdj_0705a494-7184-4c21-a662-305d5187ebf8/cleanup/0.log"
Jul 02 19:45:05.950223 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:05.950190    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77955f86f7-dpg2n_bc126a82-7fb4-45bb-acd7-1198046655d3/manager/0.log"
Jul 02 19:45:06.071348 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:06.071320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l4cm6_e9489e82-4aaa-44da-b490-9d344842e6e3/server/0.log"
Jul 02 19:45:06.420867 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:06.420752    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-bcrkx_057c8efc-3fb4-4c80-b991-d34e34813b3d/copy-manifests/0.log"
Jul 02 19:45:06.428310 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:06.428281    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-bcrkx_057c8efc-3fb4-4c80-b991-d34e34813b3d/manager/0.log"
Jul 02 19:45:06.679140 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:06.679060    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-l2lrl_6ee673dd-64fb-418f-b71d-3b9d6afaee66/postgres/0.log"
Jul 02 19:45:08.137084 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:08.137042    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7tsrc_190fdf57-0b4e-45fe-9478-9804afa33f16/manager/0.log"
Jul 02 19:45:08.256000 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:08.255966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sx28d_ce0d276d-c87b-4923-8e52-b9f1db7842e5/manager/0.log"
Jul 02 19:45:08.365006 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:08.364971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rstkr_eeabaef5-c002-4ee1-b686-e0cee7812f5d/kuadrant-console-plugin/0.log"
Jul 02 19:45:08.494271 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:08.494180    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9cnfm_039ee53a-b293-4987-9cbf-728f00d681b1/registry-server/0.log"
Jul 02 19:45:08.885515 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:08.885483    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-glf8k_dbe61f0c-83a0-41f8-a546-a5d5ca927562/manager/0.log"
Jul 02 19:45:09.494686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:09.494658    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-5n4f7_25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0/kube-auth-proxy/0.log"
Jul 02 19:45:09.743148 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:09.743109    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/1.log"
Jul 02 19:45:09.859306 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:09.859266    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wfxrh_714f7a99-7290-4748-8059-639331219a5c/payload-pre-processing/0.log"
Jul 02 19:45:09.971820 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:09.971782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kzjh5_01f12fc7-d607-431b-945d-3bc799f388dd/payload-processing/0.log"
Jul 02 19:45:10.094889 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:10.094860    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56d5887d7-jftrq_269aad8f-01fb-42b1-be96-2df57f87f5d8/router/0.log"
Jul 02 19:45:10.430854 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:10.430810    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5kdsm_6a33df26-413c-4890-b1cf-fbfed952b95c/main/0.log"
Jul 02 19:45:10.547486 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:10.547453    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7g4zs_a6bbbd5b-ca11-4f96-87bb-9255e2934250/main/0.log"
Jul 02 19:45:10.797486 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:10.797452    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnbmhz_512d53ae-f6ed-43a5-8783-d7b9e861980a/main/0.log"
Jul 02 19:45:17.859686 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:17.859647    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zsqcz_c7762fcf-f3b4-44e9-aec8-465f82fd2411/global-pull-secret-syncer/0.log"
Jul 02 19:45:17.982629 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:17.982587    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zhbg2_e24d3a27-2a3b-4e6e-84f2-f092ab0a72c8/konnectivity-agent/0.log"
Jul 02 19:45:18.031769 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:18.031730    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-80.ec2.internal_5749cf2dfac2578b4bca0b2a2d6d9f8a/haproxy/0.log"
Jul 02 19:45:22.920503 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:22.920471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7tsrc_190fdf57-0b4e-45fe-9478-9804afa33f16/manager/0.log"
Jul 02 19:45:22.956432 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:22.956400    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sx28d_ce0d276d-c87b-4923-8e52-b9f1db7842e5/manager/0.log"
Jul 02 19:45:22.989898 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:22.989839    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rstkr_eeabaef5-c002-4ee1-b686-e0cee7812f5d/kuadrant-console-plugin/0.log"
Jul 02 19:45:23.038832 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:23.038794    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9cnfm_039ee53a-b293-4987-9cbf-728f00d681b1/registry-server/0.log"
Jul 02 19:45:23.404541 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:23.404498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-glf8k_dbe61f0c-83a0-41f8-a546-a5d5ca927562/manager/0.log"
Jul 02 19:45:25.348766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:25.348732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-9wwgx_7970efff-bdc2-4183-bd90-dd7eabe39179/cluster-monitoring-operator/0.log"
Jul 02 19:45:25.495459 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:25.495424    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-fgc4g_0db938df-9c7e-4729-8830-4da205dfafb0/monitoring-plugin/0.log"
Jul 02 19:45:25.612581 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:25.612499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js5xz_d5ae7453-b602-48f5-9f4d-6b7d29a0e327/node-exporter/0.log"
Jul 02 19:45:25.647981 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:25.647953    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js5xz_d5ae7453-b602-48f5-9f4d-6b7d29a0e327/kube-rbac-proxy/0.log"
Jul 02 19:45:25.671943 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:25.671907    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js5xz_d5ae7453-b602-48f5-9f4d-6b7d29a0e327/init-textfile/0.log"
Jul 02 19:45:27.870302 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.870266    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"]
Jul 02 19:45:27.870698 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.870687    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0705a494-7184-4c21-a662-305d5187ebf8" containerName="cleanup"
Jul 02 19:45:27.870698 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.870699    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0705a494-7184-4c21-a662-305d5187ebf8" containerName="cleanup"
Jul 02 19:45:27.870796 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.870781    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0705a494-7184-4c21-a662-305d5187ebf8" containerName="cleanup"
Jul 02 19:45:27.874469 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.874439    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:27.876766 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.876738    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"openshift-service-ca.crt\""
Jul 02 19:45:27.877569 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.877545    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srs74\"/\"default-dockercfg-5b97m\""
Jul 02 19:45:27.877771 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.877588    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"kube-root-ca.crt\""
Jul 02 19:45:27.880561 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.880525    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"]
Jul 02 19:45:27.955218 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.955175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-lib-modules\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:27.955218 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.955221    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-sys\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:27.955466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.955256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsp6t\" (UniqueName: \"kubernetes.io/projected/d167059a-5382-423e-aa8b-3f38626c4884-kube-api-access-hsp6t\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:27.955466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.955297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-podres\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:27.955466 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:27.955326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-proc\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056522 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-podres\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-proc\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-lib-modules\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-sys\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056681    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-podres\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056695    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-proc\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.056746 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsp6t\" (UniqueName: \"kubernetes.io/projected/d167059a-5382-423e-aa8b-3f38626c4884-kube-api-access-hsp6t\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.057059 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056763    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-sys\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.057059 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.056831    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d167059a-5382-423e-aa8b-3f38626c4884-lib-modules\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.066420 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.066391    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsp6t\" (UniqueName: \"kubernetes.io/projected/d167059a-5382-423e-aa8b-3f38626c4884-kube-api-access-hsp6t\") pod \"perf-node-gather-daemonset-hrd8l\" (UID: \"d167059a-5382-423e-aa8b-3f38626c4884\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.187398 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.187292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.338400 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.338371    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"]
Jul 02 19:45:28.340370 ip-10-0-134-80 kubenswrapper[2569]: W0702 19:45:28.340339    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd167059a_5382_423e_aa8b_3f38626c4884.slice/crio-e475e319573714a53ee122eb7cc6ce389bae395edff38d7193a50039d3ba2461 WatchSource:0}: Error finding container e475e319573714a53ee122eb7cc6ce389bae395edff38d7193a50039d3ba2461: Status 404 returned error can't find the container with id e475e319573714a53ee122eb7cc6ce389bae395edff38d7193a50039d3ba2461
Jul 02 19:45:28.433103 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.433067    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l" event={"ID":"d167059a-5382-423e-aa8b-3f38626c4884","Type":"ContainerStarted","Data":"a8db01110b2f66efa6b34dbbad49a5c6080ce9a52aa7e6a90abb649976a0a48f"}
Jul 02 19:45:28.433309 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.433129    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l" event={"ID":"d167059a-5382-423e-aa8b-3f38626c4884","Type":"ContainerStarted","Data":"e475e319573714a53ee122eb7cc6ce389bae395edff38d7193a50039d3ba2461"}
Jul 02 19:45:28.433309 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.433156    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:28.448237 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.448127    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l" podStartSLOduration=1.448109588 podStartE2EDuration="1.448109588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:28.447189815 +0000 UTC m=+2631.419850969" watchObservedRunningTime="2026-07-02 19:45:28.448109588 +0000 UTC m=+2631.420770742"
Jul 02 19:45:28.788078 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:28.788049    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66979b5dbd-m7h6s_0247f7af-d1ac-4aaa-bf73-bd839ea74612/console/0.log"
Jul 02 19:45:29.384777 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:29.384745    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-78fgh_ba0ed475-4c8d-49ad-8237-d6c62bd22d34/volume-data-source-validator/0.log"
Jul 02 19:45:30.400444 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:30.400414    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drll2_4e78731a-8f8b-4527-9824-ead1338326c4/dns/0.log"
Jul 02 19:45:30.421781 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:30.421748    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drll2_4e78731a-8f8b-4527-9824-ead1338326c4/kube-rbac-proxy/0.log"
Jul 02 19:45:30.556926 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:30.556886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2dmw_9c915941-fd74-4541-91c4-7bd76399139d/dns-node-resolver/0.log"
Jul 02 19:45:31.158378 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:31.158353    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tcmtj_6fb7daf6-ad09-4dfe-bfd6-36d7bd632d8d/node-ca/0.log"
Jul 02 19:45:32.261098 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.261057    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-5n4f7_25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0/kube-auth-proxy/0.log"
Jul 02 19:45:32.320557 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.320518    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/0.log"
Jul 02 19:45:32.348498 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.348462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/1.log"
Jul 02 19:45:32.379008 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.378976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wfxrh_714f7a99-7290-4748-8059-639331219a5c/payload-pre-processing/0.log"
Jul 02 19:45:32.427057 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.427019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kzjh5_01f12fc7-d607-431b-945d-3bc799f388dd/payload-processing/0.log"
Jul 02 19:45:32.449754 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:32.449726    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56d5887d7-jftrq_269aad8f-01fb-42b1-be96-2df57f87f5d8/router/0.log"
Jul 02 19:45:33.186729 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:33.186699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zs5vr_1785f430-a4c3-4270-bbc2-4c93ac00ebb7/serve-healthcheck-canary/0.log"
Jul 02 19:45:33.751801 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:33.751773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvkv_d60656bf-98f0-4af5-a3a7-c98ef13327ab/kube-rbac-proxy/0.log"
Jul 02 19:45:33.778973 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:33.778941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvkv_d60656bf-98f0-4af5-a3a7-c98ef13327ab/exporter/0.log"
Jul 02 19:45:33.801638 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:33.801611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvkv_d60656bf-98f0-4af5-a3a7-c98ef13327ab/extractor/0.log"
Jul 02 19:45:34.449196 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:34.449163    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-hrd8l"
Jul 02 19:45:36.252995 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.252947    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ffslw_7d7da5c5-de5a-4017-bfab-aee8f8b425d7/manager/0.log"
Jul 02 19:45:36.390917 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.390815    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n29pk_0913da59-b9f3-46a8-bd04-b161f631390e/manager/0.log"
Jul 02 19:45:36.428402 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.428366    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74ddc86c7d-cc2lz_1702e2c8-0fa8-4a79-9952-709e2ba8d7e9/maas-api/0.log"
Jul 02 19:45:36.475796 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.475764    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-ndlbb_3b5c5300-57d1-4d22-b701-1e82dc289588/cleanup/0.log"
Jul 02 19:45:36.501377 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.501340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717025-dpmdj_0705a494-7184-4c21-a662-305d5187ebf8/cleanup/0.log"
Jul 02 19:45:36.603966 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.603936    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77955f86f7-dpg2n_bc126a82-7fb4-45bb-acd7-1198046655d3/manager/0.log"
Jul 02 19:45:36.625885 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.625831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l4cm6_e9489e82-4aaa-44da-b490-9d344842e6e3/server/0.log"
Jul 02 19:45:36.792772 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.792736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-bcrkx_057c8efc-3fb4-4c80-b991-d34e34813b3d/manager/0.log"
Jul 02 19:45:36.815249 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.815214    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-bcrkx_057c8efc-3fb4-4c80-b991-d34e34813b3d/copy-manifests/0.log"
Jul 02 19:45:36.962308 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:36.962271    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-l2lrl_6ee673dd-64fb-418f-b71d-3b9d6afaee66/postgres/0.log"
Jul 02 19:45:38.445347 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.445314    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-5n4f7_25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0/kube-auth-proxy/0.log"
Jul 02 19:45:38.483691 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.483633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/0.log"
Jul 02 19:45:38.512789 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.512746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/1.log"
Jul 02 19:45:38.533455 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.533420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wfxrh_714f7a99-7290-4748-8059-639331219a5c/payload-pre-processing/0.log"
Jul 02 19:45:38.571818 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.571787    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kzjh5_01f12fc7-d607-431b-945d-3bc799f388dd/payload-processing/0.log"
Jul 02 19:45:38.587786 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:38.587760    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56d5887d7-jftrq_269aad8f-01fb-42b1-be96-2df57f87f5d8/router/0.log"
Jul 02 19:45:39.791467 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.791432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-5n4f7_25ef06bb-1319-4e7d-8c8f-d1a2567ce1c0/kube-auth-proxy/0.log"
Jul 02 19:45:39.828029 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.827988    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/0.log"
Jul 02 19:45:39.858014 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.857982    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ldpfl_cf0eb511-558a-4c30-81fa-88cfd3912b70/istio-proxy/1.log"
Jul 02 19:45:39.879194 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.879163    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wfxrh_714f7a99-7290-4748-8059-639331219a5c/payload-pre-processing/0.log"
Jul 02 19:45:39.925814 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.925774    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kzjh5_01f12fc7-d607-431b-945d-3bc799f388dd/payload-processing/0.log"
Jul 02 19:45:39.943208 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:39.943169    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56d5887d7-jftrq_269aad8f-01fb-42b1-be96-2df57f87f5d8/router/0.log"
Jul 02 19:45:43.178074 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:43.177987    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8qhqj_2778f033-0eac-4313-8437-43e2a1822003/migrator/0.log"
Jul 02 19:45:43.200358 ip-10-0-134-80 kubenswrapper[2569]: I0702 19:45:43.200327    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8qhqj_2778f033-0eac-4313-8437-43e2a1822003/graceful-termination/0.log"