Jul 02 19:53:46.645370 ip-10-0-142-141 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.962693    2546 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969103    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969119    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969122    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969125    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969128    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969131    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969133    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.060873 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969137    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.039121 ip-10-0-142-141 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969140    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969143    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969145    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969148    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969151    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969153    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969156    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969158    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969163    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969167    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969170    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969172    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969175    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969177    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969180    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969182    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969185    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969187    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.061942 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969189    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969192    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969195    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969197    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969200    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969203    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969206    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969208    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969211    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969214    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969216    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969219    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969223    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969225    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969227    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969230    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969232    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969235    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969237    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.063418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969241    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969243    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969245    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969248    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969250    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969254    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969256    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969258    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969261    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969264    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969268    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969271    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969274    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969276    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969280    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969283    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969285    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969289    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969293    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.064053 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969295    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969298    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969300    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969303    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969305    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969308    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969311    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969317    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969319    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969322    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969324    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969327    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969329    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969332    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969334    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969337    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969339    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969341    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969344    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969346    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.065330 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969348    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969351    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969354    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969356    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969358    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969362    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969364    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969368    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969370    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969373    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969376    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969379    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969381    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969384    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.969386    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970130    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970138    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970141    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970144    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970147    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970151    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.068857 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970153    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970158    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970162    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970165    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970168    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970171    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970173    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970177    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970180    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970182    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970185    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970187    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970190    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970193    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970195    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970198    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970200    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970203    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970206    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.069762 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970208    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970210    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970213    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970216    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970219    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970221    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970224    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970226    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970229    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970231    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970233    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970236    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970238    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970242    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970244    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970246    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970250    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970252    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970255    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970258    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.070669 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970260    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970262    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970265    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970267    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970270    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970272    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970275    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970277    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970280    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970282    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970284    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970287    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970289    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970292    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970294    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970297    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970299    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970301    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970304    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.071752 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970307    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970310    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970313    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970316    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970319    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970321    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970323    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970326    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970328    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970332    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970335    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970338    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970340    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970343    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970346    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970348    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970352    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970356    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970359    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.072688 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970361    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970364    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970367    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970370    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970372    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970374    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970377    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970380    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970382    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970385    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970388    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970391    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970393    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970396    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970398    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970400    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970844    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970850    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970852    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970856    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.073638 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970860    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970864    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970866    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970869    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970872    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970874    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970877    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970879    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970882    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970884    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970887    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970890    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970893    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970895    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970898    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970901    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970903    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970906    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970910    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970912    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.074747 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970915    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970917    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970923    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970925    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970928    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970931    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970933    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970936    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970940    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970944    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970946    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970949    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970952    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970955    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970958    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970962    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970964    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970967    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970969    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.076018 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970972    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970975    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970977    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970980    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970982    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970985    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970988    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970990    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970992    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970995    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.970997    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971000    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971002    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971005    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971008    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971012    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971014    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971017    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971020    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971022    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.183759 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971025    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971027    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971030    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971034    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971037    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971040    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971043    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971046    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971048    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971052    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971054    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971071    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971076    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971079    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971081    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971084    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971086    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971089    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971092    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.203874 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971095    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971098    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971101    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971103    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971107    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971112    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971115    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971119    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971126    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971129    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971132    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971135    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971137    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971140    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971143    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971145    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971148    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971223    2546 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971230    2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971238    2546 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971243    2546 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:53:47.205801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971248    2546 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971254    2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971260    2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971264    2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971269    2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971272    2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971276    2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971281    2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971286    2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971289    2546 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971292    2546 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971295    2546 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971297    2546 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971301    2546 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971305    2546 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971307    2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971312    2546 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971315    2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971318    2546 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971323    2546 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971327    2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971330    2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971333    2546 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971337    2546 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:53:47.206952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971340    2546 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971342    2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971345    2546 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971348    2546 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971353    2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971356    2546 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971359    2546 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971362    2546 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971365    2546 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971369    2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971374    2546 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971377    2546 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971380    2546 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971383    2546 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971386    2546 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971390    2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971392    2546 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971396    2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971399    2546 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971402    2546 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971405    2546 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971407    2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971411    2546 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971414    2546 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971418    2546 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:53:47.208091 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971420    2546 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971424    2546 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971430    2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971433    2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971437    2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971440    2546 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971443    2546 flags.go:64] FLAG: --help="false"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971446    2546 flags.go:64] FLAG: --hostname-override="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971449    2546 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971451    2546 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971454    2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971458    2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971461    2546 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971464    2546 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971467    2546 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971470    2546 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971473    2546 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971476    2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971479    2546 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971482    2546 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971485    2546 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971487    2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971491    2546 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971493    2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:53:47.209412 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971496    2546 flags.go:64] FLAG: --lock-file=""
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971499    2546 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971501    2546 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971505    2546 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971510    2546 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971513    2546 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971516    2546 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971520    2546 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971523    2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971526    2546 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971531    2546 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971534    2546 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971539    2546 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971542    2546 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971546    2546 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971549    2546 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971552    2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971555    2546 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971558    2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971562    2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971564    2546 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971568    2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971575    2546 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971578    2546 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971581    2546 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:53:47.210486 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971584    2546 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971587    2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971593    2546 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971596    2546 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971599    2546 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971602    2546 flags.go:64] FLAG: --port="10250"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971605    2546 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971608    2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ff63305524a3b89"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971611    2546 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971614    2546 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971617    2546 flags.go:64] FLAG: --register-node="true"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971620    2546 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971623    2546 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971626    2546 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971629    2546 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971634    2546 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971637    2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971642    2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971645    2546 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971648    2546 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971650    2546 flags.go:64] FLAG: --runonce="false"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971653    2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971656    2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971659    2546 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971662    2546 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:53:47.211591 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971664    2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971667    2546 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971670    2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971673    2546 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971676    2546 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971679    2546 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971682    2546 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971685    2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971688    2546 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971691    2546 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971694    2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971700    2546 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971703    2546 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971706    2546 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971710    2546 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971713    2546 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971715    2546 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971718    2546 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971721    2546 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971724    2546 flags.go:64] FLAG: --v="2"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971728    2546 flags.go:64] FLAG: --version="false"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971732    2546 flags.go:64] FLAG: --vmodule=""
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971737    2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.971741    2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971867    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.212709 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971871    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971874    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971877    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971881    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971883    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971886    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971889    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971892    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971895    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971897    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971900    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971903    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971906    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971908    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971911    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971914    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971916    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971920    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971922    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971925    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971927    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.213798 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971930    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971933    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971935    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971940    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971943    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971946    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971949    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971952    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971957    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971959    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971965    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971969    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971972    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971975    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971978    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971981    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971983    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971986    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971989    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.214681 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971991    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971994    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971996    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.971999    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972001    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972004    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972007    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972009    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972012    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972014    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972017    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972020    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972022    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972025    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972027    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972030    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972032    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972035    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972037    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972040    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.215565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972042    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972046    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972049    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972053    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972071    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972075    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972078    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972081    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972084    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972086    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972089    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972092    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972094    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972097    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972099    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972102    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972104    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972107    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972109    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972112    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.216468 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972114    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972117    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972120    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972124    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972126    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972129    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972132    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972135    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972137    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972140    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972143    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972145    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972149    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972155    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972157    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972162    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972164    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.217325 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.972167    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.972651    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.979778    2546 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.979799    2546 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.979820    2546 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.979826    2546 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979917    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979935    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979939    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979942    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979945    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979948    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979950    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979953    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.219072 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979956    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979959    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979961    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979964    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979966    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979969    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979972    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979976    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979980    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979983    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979986    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979989    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979992    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979995    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.979997    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980000    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980003    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980006    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980008    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.219730 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980011    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980013    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980022    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980025    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980029    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980032    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980035    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980037    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980040    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980043    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980045    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980048    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980050    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980055    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980094    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980101    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980104    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980107    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980110    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.221684 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980112    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980115    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980119    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980121    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980124    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980126    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980129    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980131    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980134    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980136    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980139    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980141    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980144    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980146    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980149    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980151    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980163    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980166    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980168    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980171    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.222565 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980173    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980176    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980179    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980182    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980185    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980188    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980190    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980193    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980195    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980198    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980200    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980203    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980205    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980208    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980210    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980213    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980215    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980218    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980220    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980223    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.223913 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980225    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980228    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980230    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980233    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980235    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980239    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980243    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980245    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980248    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980256    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980259    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980261    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980264    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.980269    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:53:47.224788 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980437    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980444    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980447    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980450    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980453    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980456    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980459    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980462    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980464    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980467    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980470    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980473    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980475    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980478    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980482    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980486    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980488    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980491    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980494    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:53:47.225642 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980497    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980499    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980501    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980504    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980506    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980509    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980511    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980513    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980516    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980524    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980527    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980531    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980533    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980536    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980539    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980542    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980544    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980547    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980549    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980552    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:53:47.226521 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980554    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980557    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980559    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980562    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980564    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980567    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980569    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980572    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980574    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980577    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980579    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980582    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980585    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980587    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980589    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980592    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980594    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980597    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980599    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980602    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:53:47.227453 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980604    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980606    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980614    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980617    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980619    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980624    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980626    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980628    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980631    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980633    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980636    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980638    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980641    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980643    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980647    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980650    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980653    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980657    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980660    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:53:47.228902 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980663    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980666    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980668    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980671    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980684    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980686    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980689    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980692    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980695    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980697    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980700    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980702    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980705    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980708    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980711    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980713    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980721    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980724    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980728    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980730    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:53:47.229753 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:46.980733    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.980737    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.980883    2546 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.982927    2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.984134    2546 server.go:1019] "Starting client certificate rotation"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.984241    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.984283    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.986263    2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.990158    2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:46.996877    2546 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.003409    2546 log.go:25] "Validated CRI v1 image API"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.004299    2546 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:53:47.230615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.008663    2546 fs.go:135] Filesystem UUIDs: map[5a401c9e-d602-4d6c-adf8-a6ce587da482:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7d35c7b-9141-4c3a-bbfe-997286e21421:/dev/nvme0n1p4]
Jul 02 19:53:47.231297 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.008679    2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.012992    2546 manager.go:216] Machine: {Timestamp:2026-07-02 19:53:47.012518357 +0000 UTC m=+0.268595725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3116461 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27447c47b2c47106a645612d747003 SystemUUID:ec27447c-47b2-c471-06a6-45612d747003 BootID:fee50433-a8a9-42a1-bd36-a5e051a9c68f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:3b:c2:30:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:3b:c2:30:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:3e:26:93:6f:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.013118    2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.013205    2546 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015235    2546 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015263    2546 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015877    2546 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015886    2546 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:53:47.231941 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015894    2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.015909    2546 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.016992    2546 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.018958    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020701    2546 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020835    2546 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020865    2546 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020880    2546 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020891    2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020900    2546 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.020909    2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.021360    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.021376    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.023207    2546 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.025987    2546 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.026035    2546 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027033    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027051    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027114    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027121    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027130    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027136    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027144    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027150    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027158    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027164    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027172    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.027179    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.028138    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.028148    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.035100    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.035109    2546 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.035106    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.038228    2546 server.go:1268] "Started kubelet"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.038321    2546 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.038364    2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.038421    2546 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.040351    2546 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.040394    2546 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:53:47.232593 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.043079    2546 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.042583    2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-141.ec2.internal.18be9116344f1104  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-141.ec2.internal,UID:ip-10-0-142-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-141.ec2.internal,},FirstTimestamp:2026-07-02 19:53:47.038200068 +0000 UTC m=+0.294277437,LastTimestamp:2026-07-02 19:53:47.038200068 +0000 UTC m=+0.294277437,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-141.ec2.internal,}"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.044911    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v6r2k"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.045075    2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.045355    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.047011    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.047497    2546 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.047510    2546 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.047774    2546 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.047851    2546 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.047857    2546 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049632    2546 factory.go:55] Registering systemd factory
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049649    2546 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049900    2546 factory.go:153] Registering CRI-O factory
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049916    2546 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049974    2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.049999    2546 factory.go:103] Registering Raw factory
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.050017    2546 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.050156    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v6r2k"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.050646    2546 manager.go:349] Starting recovery of all containers
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.073449    2546 manager.go:354] Recovery completed
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.074278    2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.085094    2546 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-141.ec2.internal\" not found" node="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.086740    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.088944    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.088974    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.088984    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.089560    2546 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.089565    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.089571    2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.089590    2546 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.090317    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.090345    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.090356    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.091736    2546 policy_none.go:49] "None policy: Start"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.091753    2546 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:53:47.234728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.091766    2546 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.093843    2546 policy_none.go:47] "Start"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.131842    2546 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.131883    2546 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.131895    2546 server.go:87] "Starting device plugin registration server"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.132241    2546 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.132255    2546 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.132513    2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.132597    2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.132605    2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.140172    2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.140237    2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.194539    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.195907    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.195941    2546 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.195967    2546 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.196002    2546 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.198204    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:47.236314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.232998    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.246249    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.246286    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.246301    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.246324    2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.256195    2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.256219    2546 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-141.ec2.internal\": node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.273335    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.296542    2546 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"]
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.296629    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.297684    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.297720    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.297734    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.300160    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.300334    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.300372    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.301241    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.301264    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.301288    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.303629    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.303657    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.303816    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.303834    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.303846    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.304889    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.304914    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.304927    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.334732    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-141.ec2.internal\" not found" node="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.341085    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-141.ec2.internal\" not found" node="ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.349616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.349401    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.351325 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.349423    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.351325 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.349440    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b28c92d26379581a95c2a602acb94d2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"1b28c92d26379581a95c2a602acb94d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.374101    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449582    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449617    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449729    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449756    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b28c92d26379581a95c2a602acb94d2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"1b28c92d26379581a95c2a602acb94d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449791    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b28c92d26379581a95c2a602acb94d2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-141.ec2.internal\" (UID: \"1b28c92d26379581a95c2a602acb94d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.449819    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f5e70db13afd27a322b9c7900c9095-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal\" (UID: \"63f5e70db13afd27a322b9c7900c9095\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.495855 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.474547    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.655930 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.576129    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.655930 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.642325    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.655930 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.644676    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:47.770955 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.676830    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.778070 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.777520    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.913819 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.878702    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.979333 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:47.979304    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:47.983813 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.983795    2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:53:47.983998 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.983975    2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:53:47.983998 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:47.983960    2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:53:48.054505 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.054459    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:48:47 +0000 UTC" deadline="2028-03-26 07:42:17.652577112 +0000 UTC"
Jul 02 19:53:48.054505 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.054491    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15179h48m29.598088858s"
Jul 02 19:53:48.080578 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:48.080547    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:48.181552 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:48.181470    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:48.282350 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:48.282303    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-141.ec2.internal\" not found"
Jul 02 19:53:48.363815 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.363787    2546 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:48.369029 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.369003    2546 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:48.449495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.449403    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:48.460251 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.460208    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:53:48.461559 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.461163    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal"
Jul 02 19:53:48.471291 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.471251    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:53:48.574504 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:48.574470    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b28c92d26379581a95c2a602acb94d2.slice/crio-6e4512a0e182f3e714ba299e978cdfdc1800bc1754feb6d078dfe9f1e1f4b051 WatchSource:0}: Error finding container 6e4512a0e182f3e714ba299e978cdfdc1800bc1754feb6d078dfe9f1e1f4b051: Status 404 returned error can't find the container with id 6e4512a0e182f3e714ba299e978cdfdc1800bc1754feb6d078dfe9f1e1f4b051
Jul 02 19:53:48.583997 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.583978    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:53:48.590664 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:48.590642    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f5e70db13afd27a322b9c7900c9095.slice/crio-a2ded95c30aab3942c793c3677e747177c74e31ffd8124c979a47471acb092be WatchSource:0}: Error finding container a2ded95c30aab3942c793c3677e747177c74e31ffd8124c979a47471acb092be: Status 404 returned error can't find the container with id a2ded95c30aab3942c793c3677e747177c74e31ffd8124c979a47471acb092be
Jul 02 19:53:48.998869 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:48.998833    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:49.023398 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.023363    2546 apiserver.go:52] "Watching apiserver"
Jul 02 19:53:49.030578 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.030546    2546 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:53:49.030940 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.030917    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5d4s7","openshift-multus/multus-additional-cni-plugins-whqqx","openshift-network-diagnostics/network-check-target-v6d6v","openshift-network-operator/iptables-alerter-bw26p","openshift-ovn-kubernetes/ovnkube-node-2bz5w","kube-system/global-pull-secret-syncer-zv8fd","kube-system/konnectivity-agent-rr9zf","kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl","openshift-cluster-node-tuning-operator/tuned-x8smn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal","openshift-multus/multus-klt7c","openshift-multus/network-metrics-daemon-4nwff","openshift-dns/node-resolver-cv99p"]
Jul 02 19:53:49.034149 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.034112    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.036649 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.036612    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.036779 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.036691    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:49.036779 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.036728    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:53:49.037047 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.037028    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-shvgj\""
Jul 02 19:53:49.037174 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.037055    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:53:49.039303 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.039192    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:49.039303 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.039266    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:53:49.041520 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.041498    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.044184 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.043939    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:53:49.044184 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.043954    2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:53:49.044330 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.044234    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.044801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.044782    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7ffnv\""
Jul 02 19:53:49.044892 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.044802    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.044892 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.044828    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.046864 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.046842    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.046948 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.046931    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:49.047199 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047176    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.047303 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047176    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smsxd\""
Jul 02 19:53:49.047507 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047439    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:53:49.047507 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047467    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:53:49.047703 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047559    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:53:49.047763 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047717    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.047889 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047870    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:53:49.047953 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.047933    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:53:49.049575 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.049537    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.052310 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.052058    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.054570 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.054544    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.054812 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.054798    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.055095 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.055081    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4glzx\""
Jul 02 19:53:49.055819 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.055398    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:53:49.055819 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.055768    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.056998 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.056974    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:53:49.057116 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.057069    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.057116 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.057109    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lv62z\""
Jul 02 19:53:49.057824 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.057745    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.058372 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058351    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.058578 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058557    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-netns\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058667 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058595    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-systemd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058667 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058622    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-ovn\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058667 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058649    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058673    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-systemd-units\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058700    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-var-lib-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058568    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058746    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-netd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058773    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovn-node-metrics-cert\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.058832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058797    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058858    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-iptables-alerter-script\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058883    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-kubelet\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058908    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-log-socket\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058935    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.058977    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-config\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059016    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-env-overrides\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059047    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7xnz\" (UniqueName: \"kubernetes.io/projected/6ca1b845-151c-48d2-9ee4-724d4ef0d624-kube-api-access-l7xnz\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059061    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059097    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059152    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059216    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-kubelet-config\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059288    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-dbus\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059320    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-device-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059364    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-sys-fs\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059405    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbsg\" (UniqueName: \"kubernetes.io/projected/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-kube-api-access-fpbsg\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059433    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-slash\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059456    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-etc-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059478    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059493    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059502    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-socket-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059530    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flprr\" (UniqueName: \"kubernetes.io/projected/2f6a692c-977e-476a-98be-cdea7e3681a8-kube-api-access-flprr\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059550    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059555    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f82ca6-1efd-475a-a5b0-b727d779a082-konnectivity-ca\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059581    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-node-log\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.059682 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059599    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8zwb2\""
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-script-lib\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059648    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-registration-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059681    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059692    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfrq\" (UniqueName: \"kubernetes.io/projected/78131271-709c-4e4b-b0ac-4393b30d5e9b-kube-api-access-ckfrq\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059724    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-bin\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059749    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059773    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059816    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f82ca6-1efd-475a-a5b0-b727d779a082-agent-certs\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.060552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.059840    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-host-slash\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.061615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.061596    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.062229 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.062209    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.062229 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.062220    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.062395 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.062219    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwzh8\""
Jul 02 19:53:49.063193 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.062939    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:53:49.063890 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.063829    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:53:49.064181 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.064158    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:53:49.064271 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.064169    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sgns2\""
Jul 02 19:53:49.065021 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.065001    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.067298 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.067276    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:53:49.067402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.067388    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cvnt7\""
Jul 02 19:53:49.091004 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.090976    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbvlv"
Jul 02 19:53:49.102735 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.102686    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbvlv"
Jul 02 19:53:49.149155 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.149103    2546 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:53:49.160137 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160095    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfrq\" (UniqueName: \"kubernetes.io/projected/78131271-709c-4e4b-b0ac-4393b30d5e9b-kube-api-access-ckfrq\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160156    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-system-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160185    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-k8s-cni-cncf-io\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160220    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-etc-kubernetes\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160245    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-var-lib-kubelet\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160270    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cnibin\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160298    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:49.160336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160329    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-bin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160356    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160402    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-conf\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160425    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-tmp\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160452    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-netns\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160488    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-systemd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160519    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160574    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-socket-dir-parent\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160598    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysconfig\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160623    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-systemd-units\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160649    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-var-lib-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160676    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-netd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.160716 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160702    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-hostroot\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160733    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-iptables-alerter-script\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160792    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-kubelet\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160820    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160847    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-env-overrides\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160881    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-system-cni-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160910    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160936    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-kubelet-config\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160961    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-device-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.160994    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-sys-fs\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161030    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-netns\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161087    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-sys\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.161344 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbsg\" (UniqueName: \"kubernetes.io/projected/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-kube-api-access-fpbsg\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161348    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-cnibin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161399    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-kubelet\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161422    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-conf-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161475    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz97h\" (UniqueName: \"kubernetes.io/projected/683dfacc-98dc-4022-b784-10fbf6a5e052-kube-api-access-nz97h\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161505    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flprr\" (UniqueName: \"kubernetes.io/projected/2f6a692c-977e-476a-98be-cdea7e3681a8-kube-api-access-flprr\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161528    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-kubernetes\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161558    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-lib-modules\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161583    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161612    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f82ca6-1efd-475a-a5b0-b727d779a082-konnectivity-ca\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161637    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-node-log\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161699    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-node-log\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161752    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-systemd-units\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.161854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161795    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-var-lib-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161866    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-netd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.161972    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-netns\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162040    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-systemd\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.162171    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.162272    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:49.662247313 +0000 UTC m=+2.918324684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:49.162510 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162482    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-script-lib\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162516    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-registration-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162561    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-tmp-dir\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162587    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-os-release\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162615    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-multus\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162651    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-env-overrides\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162697    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hf9s\" (UniqueName: \"kubernetes.io/projected/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-kube-api-access-4hf9s\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162729    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-bin\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162771    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162787    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.162817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162796    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-hosts-file\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162845    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-run\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162868    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-host\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162875    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-kubelet-config\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.162919    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-os-release\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163058    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-device-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163236    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-binary-copy\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163266    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.163314 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163296    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f82ca6-1efd-475a-a5b0-b727d779a082-agent-certs\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163325    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-host-slash\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163362    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-ovn\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163393    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163434    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovn-node-metrics-cert\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163473    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163502    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vbg\" (UniqueName: \"kubernetes.io/projected/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-kube-api-access-b4vbg\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163536    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9wq\" (UniqueName: \"kubernetes.io/projected/d3ab84f9-a1ed-442b-81df-18c198cecb2a-kube-api-access-sw9wq\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163576    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-log-socket\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163612    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-config\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.163772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163639    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7xnz\" (UniqueName: \"kubernetes.io/projected/6ca1b845-151c-48d2-9ee4-724d4ef0d624-kube-api-access-l7xnz\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163802    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-daemon-config\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163831    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-multus-certs\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163857    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-serviceca\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163883    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163928    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-dbus\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.163954    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-systemd\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164010    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-slash\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164065    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-modprobe-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164090    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w257\" (UniqueName: \"kubernetes.io/projected/968cb5c5-81e4-41d6-96c2-c87a051709b6-kube-api-access-6w257\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-etc-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164159    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164188    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-socket-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.164265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164235    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.164942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164268    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-cni-binary-copy\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.164942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164310    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-host\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.164942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164354    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-tuned\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.164942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164366    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-config\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.164942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.164806    2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:53:49.165230 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165179    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165287 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165273    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-iptables-alerter-script\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.165343 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165290    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.165396 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165349    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-host-slash\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.165396 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165353    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-sys-fs\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.165493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165412    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-etc-openvswitch\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165418    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-run-ovn\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165447    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-log-socket\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165643 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165515    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-slash\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165643 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165586    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-cni-bin\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165643 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.165613    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:49.165791 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165651    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-registration-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.165791 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165095    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-kubelet\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.165791 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.165742    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:53:49.665723577 +0000 UTC m=+2.921800950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:49.165791 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165763    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.166067 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.165878    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6a692c-977e-476a-98be-cdea7e3681a8-socket-dir\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.167579 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.167546    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f82ca6-1efd-475a-a5b0-b727d779a082-konnectivity-ca\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.167778 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.167745    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca1b845-151c-48d2-9ee4-724d4ef0d624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.170406 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.168449    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovnkube-script-lib\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.170406 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.168847    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79350bbc-d62e-48f2-bd97-3cca633879c7-dbus\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.170611 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.170482    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:53:49.170611 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.170506    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:53:49.170611 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.170521    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:49.170611 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.170605    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:49.670576038 +0000 UTC m=+2.926653405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:49.176576 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.176544    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ca1b845-151c-48d2-9ee4-724d4ef0d624-ovn-node-metrics-cert\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.181993 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.181456    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfrq\" (UniqueName: \"kubernetes.io/projected/78131271-709c-4e4b-b0ac-4393b30d5e9b-kube-api-access-ckfrq\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.182603 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.182365    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f82ca6-1efd-475a-a5b0-b727d779a082-agent-certs\") pod \"konnectivity-agent-rr9zf\" (UID: \"98f82ca6-1efd-475a-a5b0-b727d779a082\") " pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.183060 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.183009    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbsg\" (UniqueName: \"kubernetes.io/projected/da8b78ac-a079-4a5c-b8b4-028a6e0b815b-kube-api-access-fpbsg\") pod \"iptables-alerter-bw26p\" (UID: \"da8b78ac-a079-4a5c-b8b4-028a6e0b815b\") " pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.184480 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.184433    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flprr\" (UniqueName: \"kubernetes.io/projected/2f6a692c-977e-476a-98be-cdea7e3681a8-kube-api-access-flprr\") pod \"aws-ebs-csi-driver-node-fpwrl\" (UID: \"2f6a692c-977e-476a-98be-cdea7e3681a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.184902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.184857    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7xnz\" (UniqueName: \"kubernetes.io/projected/6ca1b845-151c-48d2-9ee4-724d4ef0d624-kube-api-access-l7xnz\") pod \"ovnkube-node-2bz5w\" (UID: \"6ca1b845-151c-48d2-9ee4-724d4ef0d624\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.204223 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.204121    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"63f5e70db13afd27a322b9c7900c9095","Type":"ContainerStarted","Data":"a2ded95c30aab3942c793c3677e747177c74e31ffd8124c979a47471acb092be"}
Jul 02 19:53:49.206605 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.206562    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" event={"ID":"1b28c92d26379581a95c2a602acb94d2","Type":"ContainerStarted","Data":"6e4512a0e182f3e714ba299e978cdfdc1800bc1754feb6d078dfe9f1e1f4b051"}
Jul 02 19:53:49.265749 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265622    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-tmp-dir\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.265749 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265669    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-os-release\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.265749 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265697    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-multus\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.265749 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265728    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hf9s\" (UniqueName: \"kubernetes.io/projected/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-kube-api-access-4hf9s\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265781    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-hosts-file\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265805    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-run\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265827    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-host\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265852    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-os-release\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265877    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-binary-copy\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265901    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265932    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.265962    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vbg\" (UniqueName: \"kubernetes.io/projected/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-kube-api-access-b4vbg\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266015    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9wq\" (UniqueName: \"kubernetes.io/projected/d3ab84f9-a1ed-442b-81df-18c198cecb2a-kube-api-access-sw9wq\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266043    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-daemon-config\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266066    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-multus-certs\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266090    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-serviceca\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.266126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266115    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-systemd\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266160    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-modprobe-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266253    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w257\" (UniqueName: \"kubernetes.io/projected/968cb5c5-81e4-41d6-96c2-c87a051709b6-kube-api-access-6w257\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266293    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266320    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-cni-binary-copy\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266346    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-host\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266379    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-tuned\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266406    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-system-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266432    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-k8s-cni-cncf-io\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266464    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-etc-kubernetes\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266491    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-var-lib-kubelet\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266529    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cnibin\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266572    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-bin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266596    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266619    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-conf\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.266765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266645    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-tmp\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266691    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-socket-dir-parent\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266724    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysconfig\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266758    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-hostroot\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266791    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-system-cni-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266829    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-netns\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266852    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-sys\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266892    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-cnibin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266929    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-kubelet\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266954    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-conf-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.266979    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz97h\" (UniqueName: \"kubernetes.io/projected/683dfacc-98dc-4022-b784-10fbf6a5e052-kube-api-access-nz97h\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267007    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-kubernetes\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267031    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-lib-modules\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267055    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267118    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-host\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.267501 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267222    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-systemd\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267344    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-modprobe-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267653    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267805    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267877    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.267983    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-daemon-config\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268061    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-multus-certs\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268114    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysconfig\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268193    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/683dfacc-98dc-4022-b784-10fbf6a5e052-cni-binary-copy\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268226    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-system-cni-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268265 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268235    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-serviceca\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268270    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-hostroot\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268311    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-var-lib-kubelet\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268310    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-etc-kubernetes\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268370    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cnibin\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268388    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-os-release\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268405    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-kubelet\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268428    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-host\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268427    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-hosts-file\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268442    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-sys\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268454    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-multus\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268488    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-system-cni-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268497    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-netns\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268489    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-cnibin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268519    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-d\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.268773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268538    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-run\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268542    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-conf-dir\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268564    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-var-lib-cni-bin\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268588    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-kubernetes\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268622    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-multus-socket-dir-parent\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268666    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/683dfacc-98dc-4022-b784-10fbf6a5e052-host-run-k8s-cni-cncf-io\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268663    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-os-release\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268736    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-sysctl-conf\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268808    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/968cb5c5-81e4-41d6-96c2-c87a051709b6-lib-modules\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268920    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ab84f9-a1ed-442b-81df-18c198cecb2a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.268952    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-tmp-dir\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.269541 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.269239    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ab84f9-a1ed-442b-81df-18c198cecb2a-cni-binary-copy\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.271431 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.271405    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-etc-tuned\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.271559 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.271414    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/968cb5c5-81e4-41d6-96c2-c87a051709b6-tmp\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.284521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.284412    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9wq\" (UniqueName: \"kubernetes.io/projected/d3ab84f9-a1ed-442b-81df-18c198cecb2a-kube-api-access-sw9wq\") pod \"multus-additional-cni-plugins-whqqx\" (UID: \"d3ab84f9-a1ed-442b-81df-18c198cecb2a\") " pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.284521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.284414    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w257\" (UniqueName: \"kubernetes.io/projected/968cb5c5-81e4-41d6-96c2-c87a051709b6-kube-api-access-6w257\") pod \"tuned-x8smn\" (UID: \"968cb5c5-81e4-41d6-96c2-c87a051709b6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.291008 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.290976    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hf9s\" (UniqueName: \"kubernetes.io/projected/87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5-kube-api-access-4hf9s\") pod \"node-ca-5d4s7\" (UID: \"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5\") " pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.291321 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.291284    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vbg\" (UniqueName: \"kubernetes.io/projected/1dfeb318-8903-4cdf-b1d3-13e3c0876c78-kube-api-access-b4vbg\") pod \"node-resolver-cv99p\" (UID: \"1dfeb318-8903-4cdf-b1d3-13e3c0876c78\") " pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.291464 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.291438    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz97h\" (UniqueName: \"kubernetes.io/projected/683dfacc-98dc-4022-b784-10fbf6a5e052-kube-api-access-nz97h\") pod \"multus-klt7c\" (UID: \"683dfacc-98dc-4022-b784-10fbf6a5e052\") " pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.347006 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.346970    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:53:49.357665 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.357438    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bw26p"
Jul 02 19:53:49.361400 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.361367    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f82ca6_1efd_475a_a5b0_b727d779a082.slice/crio-37ad43e416c9977292ccfb8418a5696abb5c45c5e03f52a3b904869106c0343e WatchSource:0}: Error finding container 37ad43e416c9977292ccfb8418a5696abb5c45c5e03f52a3b904869106c0343e: Status 404 returned error can't find the container with id 37ad43e416c9977292ccfb8418a5696abb5c45c5e03f52a3b904869106c0343e
Jul 02 19:53:49.367511 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.367470    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:53:49.369866 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.369836    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b78ac_a079_4a5c_b8b4_028a6e0b815b.slice/crio-422bf6629c7f7807a147431fc7cc3a05b4f465808154e38a7d6ffd15d3a679d7 WatchSource:0}: Error finding container 422bf6629c7f7807a147431fc7cc3a05b4f465808154e38a7d6ffd15d3a679d7: Status 404 returned error can't find the container with id 422bf6629c7f7807a147431fc7cc3a05b4f465808154e38a7d6ffd15d3a679d7
Jul 02 19:53:49.374499 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.374299    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl"
Jul 02 19:53:49.383382 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.382988    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5d4s7"
Jul 02 19:53:49.384886 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.384862    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca1b845_151c_48d2_9ee4_724d4ef0d624.slice/crio-cc6b29d36c67ca5e51ed3da19c09601a512f4a3a1fe9433fb17c9acff3200089 WatchSource:0}: Error finding container cc6b29d36c67ca5e51ed3da19c09601a512f4a3a1fe9433fb17c9acff3200089: Status 404 returned error can't find the container with id cc6b29d36c67ca5e51ed3da19c09601a512f4a3a1fe9433fb17c9acff3200089
Jul 02 19:53:49.392386 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.392359    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whqqx"
Jul 02 19:53:49.396987 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.396949    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6a692c_977e_476a_98be_cdea7e3681a8.slice/crio-3f16b53076dd5f0d17a225d82e5ac3395ebc109c1858c87c17b4899da7533bc7 WatchSource:0}: Error finding container 3f16b53076dd5f0d17a225d82e5ac3395ebc109c1858c87c17b4899da7533bc7: Status 404 returned error can't find the container with id 3f16b53076dd5f0d17a225d82e5ac3395ebc109c1858c87c17b4899da7533bc7
Jul 02 19:53:49.400559 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.400535    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8smn"
Jul 02 19:53:49.404260 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.404236    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87df8ef4_bcbd_43c9_9b21_5eb3ce5999d5.slice/crio-d469800e77c225a2d6a3dfe160919b5ccaee9328c85446c58d5ac04ab64649c7 WatchSource:0}: Error finding container d469800e77c225a2d6a3dfe160919b5ccaee9328c85446c58d5ac04ab64649c7: Status 404 returned error can't find the container with id d469800e77c225a2d6a3dfe160919b5ccaee9328c85446c58d5ac04ab64649c7
Jul 02 19:53:49.408184 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.408109    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cv99p"
Jul 02 19:53:49.416621 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.415957    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klt7c"
Jul 02 19:53:49.424569 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.424525    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfeb318_8903_4cdf_b1d3_13e3c0876c78.slice/crio-99ec09fd29935a6f524fbd5d1d1d49f1ff38cfa302b9733b97de86b51c0a4ec1 WatchSource:0}: Error finding container 99ec09fd29935a6f524fbd5d1d1d49f1ff38cfa302b9733b97de86b51c0a4ec1: Status 404 returned error can't find the container with id 99ec09fd29935a6f524fbd5d1d1d49f1ff38cfa302b9733b97de86b51c0a4ec1
Jul 02 19:53:49.436426 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:53:49.436395    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683dfacc_98dc_4022_b784_10fbf6a5e052.slice/crio-9ef998368d504470a966dffdc617158e8dfef14f085d562927216762e0491753 WatchSource:0}: Error finding container 9ef998368d504470a966dffdc617158e8dfef14f085d562927216762e0491753: Status 404 returned error can't find the container with id 9ef998368d504470a966dffdc617158e8dfef14f085d562927216762e0491753
Jul 02 19:53:49.669903 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.669857    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:49.670125 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.669934    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:49.670125 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.670053    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:49.670125 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.670053    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:49.670294 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.670147    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:53:50.670125344 +0000 UTC m=+3.926202709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:49.670294 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.670169    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:50.670158519 +0000 UTC m=+3.926235881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:49.770444 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:49.770390    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:49.770633 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.770597    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:53:49.770633 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.770628    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:53:49.770735 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.770642    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:49.770735 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:49.770701    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:50.770685733 +0000 UTC m=+4.026763093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:50.107325 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.107242    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:48:49 +0000 UTC" deadline="2028-02-19 08:19:06.399485188 +0000 UTC"
Jul 02 19:53:50.107325 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.107319    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14316h25m16.292171388s"
Jul 02 19:53:50.210825 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.210758    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5d4s7" event={"ID":"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5","Type":"ContainerStarted","Data":"d469800e77c225a2d6a3dfe160919b5ccaee9328c85446c58d5ac04ab64649c7"}
Jul 02 19:53:50.212019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.211985    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klt7c" event={"ID":"683dfacc-98dc-4022-b784-10fbf6a5e052","Type":"ContainerStarted","Data":"9ef998368d504470a966dffdc617158e8dfef14f085d562927216762e0491753"}
Jul 02 19:53:50.213331 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.213300    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl" event={"ID":"2f6a692c-977e-476a-98be-cdea7e3681a8","Type":"ContainerStarted","Data":"3f16b53076dd5f0d17a225d82e5ac3395ebc109c1858c87c17b4899da7533bc7"}
Jul 02 19:53:50.214575 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.214547    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"cc6b29d36c67ca5e51ed3da19c09601a512f4a3a1fe9433fb17c9acff3200089"}
Jul 02 19:53:50.215835 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.215807    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bw26p" event={"ID":"da8b78ac-a079-4a5c-b8b4-028a6e0b815b","Type":"ContainerStarted","Data":"422bf6629c7f7807a147431fc7cc3a05b4f465808154e38a7d6ffd15d3a679d7"}
Jul 02 19:53:50.217179 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.217149    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rr9zf" event={"ID":"98f82ca6-1efd-475a-a5b0-b727d779a082","Type":"ContainerStarted","Data":"37ad43e416c9977292ccfb8418a5696abb5c45c5e03f52a3b904869106c0343e"}
Jul 02 19:53:50.219048 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.219017    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cv99p" event={"ID":"1dfeb318-8903-4cdf-b1d3-13e3c0876c78","Type":"ContainerStarted","Data":"99ec09fd29935a6f524fbd5d1d1d49f1ff38cfa302b9733b97de86b51c0a4ec1"}
Jul 02 19:53:50.220115 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.220086    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8smn" event={"ID":"968cb5c5-81e4-41d6-96c2-c87a051709b6","Type":"ContainerStarted","Data":"ef32ccf53b40b16677955d6084216545e70897ed1a2a7e4ad380fef6fd66c7cc"}
Jul 02 19:53:50.221262 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.221242    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerStarted","Data":"0e160acaa508cf8c36d48fa3b8d004111b2341ffde8476872542d7f1a66a25ff"}
Jul 02 19:53:50.677996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.677952    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:50.678288 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.678035    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:50.678288 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.678200    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:50.678288 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.678267    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.678246785 +0000 UTC m=+5.934324146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:50.678288 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.678281    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:50.678529 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.678341    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.678326116 +0000 UTC m=+5.934403474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:50.779747 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:50.778993    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:50.779747 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.779240    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:53:50.779747 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.779270    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:53:50.779747 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.779284    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:50.779747 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:50.779351    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.779331497 +0000 UTC m=+6.035408861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:51.107495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:51.107425    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:48:49 +0000 UTC" deadline="2028-01-05 09:33:35.467669738 +0000 UTC"
Jul 02 19:53:51.107495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:51.107461    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13237h39m44.360214276s"
Jul 02 19:53:51.197754 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:51.197723    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:51.197951 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:51.197888    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:51.198731 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:51.198321    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:51.198731 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:51.198425    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:53:51.198731 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:51.198712    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:51.198945 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:51.198805    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:52.251258 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:52.250620    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"63f5e70db13afd27a322b9c7900c9095","Type":"ContainerStarted","Data":"1a96239664c1d71ebbc769ccdaf2c39ac5baf10bed439aa3a4d9c6f259803bec"}
Jul 02 19:53:52.263456 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:52.262906    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" event={"ID":"1b28c92d26379581a95c2a602acb94d2","Type":"ContainerStarted","Data":"3252a035b65a9281c15cf09499f719f1d7811e465ae35b7165c64de3f92b4d55"}
Jul 02 19:53:52.705843 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:52.705566    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:52.705843 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:52.705650    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:52.705843 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.705766    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:52.705843 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.705789    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:52.706282 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.705862    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:56.705837671 +0000 UTC m=+9.961915037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:52.706282 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.705885    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:53:56.705873953 +0000 UTC m=+9.961951318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:52.806879 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:52.806838    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:52.807087 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.807033    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:53:52.807087 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.807059    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:53:52.807087 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.807074    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:52.807276 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:52.807155    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:56.807136443 +0000 UTC m=+10.063213822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:53.197021 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:53.196959    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:53.197260 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:53.197121    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:53:53.197578 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:53.197556    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:53.197697 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:53.197663    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:53.197810 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:53.197791    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:53.197937 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:53.197894    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:55.196214 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:55.196176    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:55.196754 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:55.196198    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:55.196754 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:55.196325    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:55.196754 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:55.196336    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:55.196754 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:55.196418    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:53:55.196754 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:55.196527    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:56.739738 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:56.739702    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:56.740178 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:56.739768    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:56.740178 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.739865    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:56.740178 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.739866    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:56.740178 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.739931    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:54:04.739911987 +0000 UTC m=+17.995989358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:53:56.740178 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.739949    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:04.739940254 +0000 UTC m=+17.996017616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:53:56.840513 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:56.840482    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:56.841039 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.840694    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:53:56.841039 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.840718    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:53:56.841039 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.840732    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:56.841039 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:56.840793    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:04.840774324 +0000 UTC m=+18.096851700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:53:57.197230 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:57.197193    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:57.197416 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:57.197284    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:57.197416 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:57.197328    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:57.197524 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:57.197411    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:53:57.197727 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:57.197691    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:57.197822 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:57.197743    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:58.280187 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:58.280150    2546 generic.go:356] "Generic (PLEG): container finished" podID="63f5e70db13afd27a322b9c7900c9095" containerID="1a96239664c1d71ebbc769ccdaf2c39ac5baf10bed439aa3a4d9c6f259803bec" exitCode=0
Jul 02 19:53:58.280648 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:58.280201    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"63f5e70db13afd27a322b9c7900c9095","Type":"ContainerDied","Data":"1a96239664c1d71ebbc769ccdaf2c39ac5baf10bed439aa3a4d9c6f259803bec"}
Jul 02 19:53:58.297289 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:58.297185    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-141.ec2.internal" podStartSLOduration=10.297164475 podStartE2EDuration="10.297164475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:52.293433431 +0000 UTC m=+5.549510845" watchObservedRunningTime="2026-07-02 19:53:58.297164475 +0000 UTC m=+11.553241855"
Jul 02 19:53:59.196520 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:59.196159    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:53:59.196520 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:59.196298    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:53:59.196520 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:59.196432    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:53:59.196520 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:59.196298    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:53:59.196520 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:53:59.196485    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:53:59.196962 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:53:59.196549    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:01.199521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:01.199452    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:01.199521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:01.199491    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:01.199521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:01.199491    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:01.200090 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:01.199594    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:01.200090 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:01.200032    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:01.200200 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:01.200141    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:03.197100 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:03.197047    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:03.197558 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:03.197050    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:03.197558 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:03.197197    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:03.197558 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:03.197054    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:03.197558 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:03.197264    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:03.197558 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:03.197373    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:04.804551 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:04.804512    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:04.804966 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:04.804575    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:04.804966 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.804654    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:54:04.804966 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.804655    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:54:04.804966 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.804706    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:20.804693538 +0000 UTC m=+34.060770895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:54:04.804966 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.804720    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:54:20.804713619 +0000 UTC m=+34.060790975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:54:04.905666 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:04.905634    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:04.905848 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.905825    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:54:04.905888 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.905855    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:54:04.905888 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.905869    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:54:04.905944 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:04.905932    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:20.905913748 +0000 UTC m=+34.161991122 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:54:05.200078 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:05.200040    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:05.200271 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:05.200176    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:05.200271 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:05.200214    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:05.200397 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:05.200215    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:05.200397 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:05.200345    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:05.200397 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:05.200382    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:07.197190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:07.197154    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:07.197640 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:07.197269    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:07.197640 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:07.197281    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:07.197640 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:07.197411    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:07.197640 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:07.197445    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:07.197640 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:07.197534    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.200206    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:09.200355    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.200783    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:09.200878    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.200941    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:09.201043 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:09.201010    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:09.302699 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.302662    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cv99p" event={"ID":"1dfeb318-8903-4cdf-b1d3-13e3c0876c78","Type":"ContainerStarted","Data":"38a48ae8089df100d05c1f640ac2e44dbf27becc9cd52f9a2cbb66bee6b3102c"}
Jul 02 19:54:09.304706 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.304672    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8smn" event={"ID":"968cb5c5-81e4-41d6-96c2-c87a051709b6","Type":"ContainerStarted","Data":"4400808dbc11088ae0f3e8a10d25efffd00f21756f4c6a30d992bc9de7a011ce"}
Jul 02 19:54:09.310128 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.308521    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerStarted","Data":"f92aa09de055f41a7b6bdd7876c26862f123b9c1b2940ed414567af2d52f5832"}
Jul 02 19:54:09.314283 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.314256    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5d4s7" event={"ID":"87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5","Type":"ContainerStarted","Data":"bfaf5461ec63f1d9202bd8fe35ee8833c0c9600a4f78fad43013e88d4c1e9c28"}
Jul 02 19:54:09.316122 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.316087    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" event={"ID":"63f5e70db13afd27a322b9c7900c9095","Type":"ContainerStarted","Data":"63d105122b01c6a801b28a674c081280fa2175759d04f2b6a603e1178b4ac33d"}
Jul 02 19:54:09.317997 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.317970    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"beb82615b47ce9b8deefb000ad0f301360024db124743f7da2a6e659973627a6"}
Jul 02 19:54:09.319446 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.319423    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rr9zf" event={"ID":"98f82ca6-1efd-475a-a5b0-b727d779a082","Type":"ContainerStarted","Data":"524ee1aa132f17538c577c78331c76dcb2bb471984b0b484655f59cfc67afd4b"}
Jul 02 19:54:09.320258 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.320213    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cv99p" podStartSLOduration=11.093008851 podStartE2EDuration="22.320197723s" totalImagesPullingTime="11.227188872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:09.31973817 +0000 UTC m=+22.575815572" watchObservedRunningTime="2026-07-02 19:54:09.320197723 +0000 UTC m=+22.576275103"
Jul 02 19:54:09.358193 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.358146    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x8smn" podStartSLOduration=2.772682089 podStartE2EDuration="22.358131267s" totalImagesPullingTime="19.585449178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:09.357818141 +0000 UTC m=+22.613895519" watchObservedRunningTime="2026-07-02 19:54:09.358131267 +0000 UTC m=+22.614208645"
Jul 02 19:54:09.372215 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.372174    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-141.ec2.internal" podStartSLOduration=21.372157704 podStartE2EDuration="21.372157704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:09.371716338 +0000 UTC m=+22.627793718" watchObservedRunningTime="2026-07-02 19:54:09.372157704 +0000 UTC m=+22.628235082"
Jul 02 19:54:09.386573 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.386515    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rr9zf" podStartSLOduration=6.928413402 podStartE2EDuration="22.38649264s" totalImagesPullingTime="15.458079238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:09.385698712 +0000 UTC m=+22.641776089" watchObservedRunningTime="2026-07-02 19:54:09.38649264 +0000 UTC m=+22.642570019"
Jul 02 19:54:09.732453 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.732417    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:54:09.733001 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:09.732987    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:54:10.324220 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.324180    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="f92aa09de055f41a7b6bdd7876c26862f123b9c1b2940ed414567af2d52f5832" exitCode=0
Jul 02 19:54:10.325121 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.324535    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"f92aa09de055f41a7b6bdd7876c26862f123b9c1b2940ed414567af2d52f5832"}
Jul 02 19:54:10.326430 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.326407    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klt7c" event={"ID":"683dfacc-98dc-4022-b784-10fbf6a5e052","Type":"ContainerStarted","Data":"68b1cadb52af924395850822d61def1056d074125bf7809752535458d9cf9933"}
Jul 02 19:54:10.328667 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.328445    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl" event={"ID":"2f6a692c-977e-476a-98be-cdea7e3681a8","Type":"ContainerStarted","Data":"4b03a7c8034dc554ea38a8fc4b6bf083017e642fbe82120aa5a56c2ff775d1d7"}
Jul 02 19:54:10.334495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.334462    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:54:10.334889 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.334861    2546 generic.go:356] "Generic (PLEG): container finished" podID="6ca1b845-151c-48d2-9ee4-724d4ef0d624" containerID="13a725df28c124e24871e1f0d9de112e81c48a211048c271812381e2379b8cb8" exitCode=1
Jul 02 19:54:10.335002 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.334974    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"875f91f41b74e21c586a04cb1f5fd7f25f992ca70019482824c6c886c1c74cef"}
Jul 02 19:54:10.335422 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335395    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:54:10.335518 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335441    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"7e4914247467789fed843c5b22c420b916088f298d54ad5c90059470e5e4fdba"}
Jul 02 19:54:10.335518 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335498    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"21741462c822a63121bdc7e7e52ef800abe5d903db4152a0a502ffee6e785dda"}
Jul 02 19:54:10.335621 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335572    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rr9zf"
Jul 02 19:54:10.335621 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335588    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"b1a84f54c3345b569adcffe69ccc136a3eda9abd2324becf0b1a9709d457fc2e"}
Jul 02 19:54:10.335687 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.335625    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerDied","Data":"13a725df28c124e24871e1f0d9de112e81c48a211048c271812381e2379b8cb8"}
Jul 02 19:54:10.361404 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.361352    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-klt7c" podStartSLOduration=3.395753232 podStartE2EDuration="23.361338227s" totalImagesPullingTime="19.965584995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:10.361046783 +0000 UTC m=+23.617124161" watchObservedRunningTime="2026-07-02 19:54:10.361338227 +0000 UTC m=+23.617415604"
Jul 02 19:54:10.394650 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.394600    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5d4s7" podStartSLOduration=3.799389945 podStartE2EDuration="23.394583828s" totalImagesPullingTime="19.595193883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:10.394149028 +0000 UTC m=+23.650226440" watchObservedRunningTime="2026-07-02 19:54:10.394583828 +0000 UTC m=+23.650661206"
Jul 02 19:54:10.862492 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:10.862470    2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:54:11.148260 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.148135    2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:54:10.862487599Z","UUID":"f82fef61-4be5-422a-ae60-5e54ec666b4f","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:54:11.149977 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.149956    2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:54:11.150197 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.149999    2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:54:11.200744 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.200717    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:11.200929 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.200807    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:11.200929 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.200913    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:11.201124 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:11.200929    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:11.201124 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:11.201016    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:11.201232 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:11.201144    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:11.339008 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.338974    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl" event={"ID":"2f6a692c-977e-476a-98be-cdea7e3681a8","Type":"ContainerStarted","Data":"30fb132faa878f92a0d0a3ec0194eb9661c966d60bf88fcdca2e1dbe0d052c8d"}
Jul 02 19:54:11.340418 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.340395    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bw26p" event={"ID":"da8b78ac-a079-4a5c-b8b4-028a6e0b815b","Type":"ContainerStarted","Data":"6eda2953420beaa1372ef6f6167fb7251e14662216b1f1ca6df443c1b54c3164"}
Jul 02 19:54:11.353945 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:11.353896    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bw26p" podStartSLOduration=4.724490719 podStartE2EDuration="24.353879776s" totalImagesPullingTime="19.629389057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:11.353688886 +0000 UTC m=+24.609766279" watchObservedRunningTime="2026-07-02 19:54:11.353879776 +0000 UTC m=+24.609957152"
Jul 02 19:54:12.344824 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:12.344600    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl" event={"ID":"2f6a692c-977e-476a-98be-cdea7e3681a8","Type":"ContainerStarted","Data":"076869afcd1705ace7aabbf520b8fb0168a8918f822bb8d2011bcd06bed67f23"}
Jul 02 19:54:12.347446 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:12.347422    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:54:12.347820 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:12.347785    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"b314402748dd05bb147fcc3e60a43771735dbd360c632f5383dfcc0b805c0b23"}
Jul 02 19:54:12.361778 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:12.361727    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpwrl" podStartSLOduration=3.197741282 podStartE2EDuration="25.361712349s" totalImagesPullingTime="22.163971067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:12.361427787 +0000 UTC m=+25.617505168" watchObservedRunningTime="2026-07-02 19:54:12.361712349 +0000 UTC m=+25.617789726"
Jul 02 19:54:13.196545 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:13.196505    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:13.196755 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:13.196508    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:13.196755 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:13.196640    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:13.196755 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:13.196508    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:13.196755 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:13.196703    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:13.196911 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:13.196767    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:14.356504 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.356317    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:54:14.357229 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.356851    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"1887c749f0b6649827082dbd8ccb79d07c13327b7e4fa6386ecaad3957ba8565"}
Jul 02 19:54:14.357229 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.357137    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:14.357229 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.357207    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:14.357393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.357378    2546 scope.go:117] "RemoveContainer" containerID="13a725df28c124e24871e1f0d9de112e81c48a211048c271812381e2379b8cb8"
Jul 02 19:54:14.373577 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:14.373557    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:15.196524 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.196482    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:15.196717 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.196482    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:15.196717 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:15.196631    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:15.196717 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.196662    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:15.196864 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:15.196769    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:15.196916 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:15.196865    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:15.363872 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.363795    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:54:15.364300 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.364262    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" event={"ID":"6ca1b845-151c-48d2-9ee4-724d4ef0d624","Type":"ContainerStarted","Data":"5509eb301526d620e76055b52c41aec07d2842fb24b3b0f7c0ecf859451bbe51"}
Jul 02 19:54:15.364580 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.364547    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:15.402224 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.402163    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w" podStartSLOduration=8.758815094 podStartE2EDuration="28.402141259s" totalImagesPullingTime="19.643326165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:15.401795688 +0000 UTC m=+28.657873078" watchObservedRunningTime="2026-07-02 19:54:15.402141259 +0000 UTC m=+28.658218638"
Jul 02 19:54:15.436753 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:15.436141    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:16.241402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.241353    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zv8fd"]
Jul 02 19:54:16.241722 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.241494    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:16.241722 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:16.241602    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:16.242199 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.242175    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v6d6v"]
Jul 02 19:54:16.242278 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.242265    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:16.242376 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:16.242356    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:16.243793 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.243769    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4nwff"]
Jul 02 19:54:16.243904 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:16.243858    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:16.243980 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:16.243958    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:17.370041 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:17.369859    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="21f40e48aeae3b2ad74ac7a2800825a1872d66d62c1654ac78d8106c5f53d93a" exitCode=0
Jul 02 19:54:17.370508 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:17.369937    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"21f40e48aeae3b2ad74ac7a2800825a1872d66d62c1654ac78d8106c5f53d93a"}
Jul 02 19:54:18.196968 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:18.196936    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:18.196968 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:18.196951    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:18.197165 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:18.196956    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:18.197165 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:18.197096    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:18.197280 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:18.197229    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:18.197349 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:18.197327    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:18.375328 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:18.375290    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="a10d5a3714ee89b7abefe9a4092bf5bb277f6827ca42e6548626e89dafbf7b4c" exitCode=0
Jul 02 19:54:18.375990 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:18.375331    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"a10d5a3714ee89b7abefe9a4092bf5bb277f6827ca42e6548626e89dafbf7b4c"}
Jul 02 19:54:19.380520 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:19.380483    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="22f95268230eea8bb4b68b035355ccd3bbcae50443099771018d558ad0c1a2d9" exitCode=0
Jul 02 19:54:19.380985 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:19.380527    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"22f95268230eea8bb4b68b035355ccd3bbcae50443099771018d558ad0c1a2d9"}
Jul 02 19:54:20.196787 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.196748    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:20.196985 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.196792    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:20.196985 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.196888    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6d6v" podUID="9b51f215-3cd9-43d9-a4c3-7162f9e0afe1"
Jul 02 19:54:20.196985 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.196935    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zv8fd" podUID="79350bbc-d62e-48f2-bd97-3cca633879c7"
Jul 02 19:54:20.196985 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.196951    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:20.197191 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.197091    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nwff" podUID="78131271-709c-4e4b-b0ac-4393b30d5e9b"
Jul 02 19:54:20.822758 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.822724    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:20.823242 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.822787    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:20.823242 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.822911    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:54:20.823242 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.822911    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:54:20.823242 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.822982    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs podName:78131271-709c-4e4b-b0ac-4393b30d5e9b nodeName:}" failed. No retries permitted until 2026-07-02 19:54:52.822960711 +0000 UTC m=+66.079038081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs") pod "network-metrics-daemon-4nwff" (UID: "78131271-709c-4e4b-b0ac-4393b30d5e9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:54:20.823242 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.823003    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret podName:79350bbc-d62e-48f2-bd97-3cca633879c7 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:52.822991713 +0000 UTC m=+66.079069074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret") pod "global-pull-secret-syncer-zv8fd" (UID: "79350bbc-d62e-48f2-bd97-3cca633879c7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:54:20.923558 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:20.923519    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:20.923826 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.923675    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:54:20.923826 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.923695    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:54:20.923826 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.923706    2546 projected.go:196] Error preparing data for projected volume kube-api-access-mvzp5 for pod openshift-network-diagnostics/network-check-target-v6d6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:54:20.923826 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:20.923764    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5 podName:9b51f215-3cd9-43d9-a4c3-7162f9e0afe1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:52.923747365 +0000 UTC m=+66.179824735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvzp5" (UniqueName: "kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5") pod "network-check-target-v6d6v" (UID: "9b51f215-3cd9-43d9-a4c3-7162f9e0afe1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:54:22.064000 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.063915    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-141.ec2.internal" event="NodeReady"
Jul 02 19:54:22.064463 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.064096    2546 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:54:22.125160 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.125126    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vgtkb"]
Jul 02 19:54:22.129293 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.129265    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flkbp"]
Jul 02 19:54:22.129449 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.129402    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.132331 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.132309    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.132892 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.132868    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:54:22.133007 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.132868    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:54:22.133007 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.132926    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzdvh\""
Jul 02 19:54:22.134707 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.134690    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:54:22.134882 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.134864    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:54:22.135009 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.134979    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:54:22.135123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.135048    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:54:22.135398 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.135383    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hs5xt\""
Jul 02 19:54:22.146223 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.146201    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgtkb"]
Jul 02 19:54:22.147009 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.146988    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2nct7"]
Jul 02 19:54:22.150963 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.150940    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.151549 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.151484    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flkbp"]
Jul 02 19:54:22.153375 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.153348    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:54:22.153478 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.153434    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:54:22.153542 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.153495    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:54:22.153722 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.153709    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tjpqs\""
Jul 02 19:54:22.166278 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.166208    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2nct7"]
Jul 02 19:54:22.183621 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.183591    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"]
Jul 02 19:54:22.186833 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.186814    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"
Jul 02 19:54:22.189883 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.189859    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 19:54:22.190181 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.190139    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 19:54:22.190181 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.190165    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rqfk5\""
Jul 02 19:54:22.196444 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.196425    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:22.196554 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.196459    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:22.196554 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.196463    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:22.198777 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.198753    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:54:22.198889 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.198851    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdnmq\""
Jul 02 19:54:22.198953 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.198909    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:54:22.199007 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.198994    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k665n\""
Jul 02 19:54:22.199286 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.199269    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:54:22.199375 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.199336    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:54:22.203172 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.203153    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"]
Jul 02 19:54:22.231752 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231723    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.231897 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231767    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d3436d9-66ba-49a0-b23d-5001109859f5-crio-socket\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.231897 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231795    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27n2f\" (UniqueName: \"kubernetes.io/projected/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-api-access-27n2f\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.231897 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231823    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-cert\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.231897 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231864    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231907    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0dafc2-29df-461d-b75d-ffd9520da4a3-tmp-dir\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231945    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5f5\" (UniqueName: \"kubernetes.io/projected/aa0dafc2-29df-461d-b75d-ffd9520da4a3-kube-api-access-hs5f5\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231971    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9nds\" (UniqueName: \"kubernetes.io/projected/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-kube-api-access-n9nds\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.231998    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa0dafc2-29df-461d-b75d-ffd9520da4a3-config-volume\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.232037    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3436d9-66ba-49a0-b23d-5001109859f5-data-volume\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.232081 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.232074    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.332875 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.332831    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3436d9-66ba-49a0-b23d-5001109859f5-data-volume\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.332875 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.332877    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.332966    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.333029    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls podName:aa0dafc2-29df-461d-b75d-ffd9520da4a3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:22.833012593 +0000 UTC m=+36.089089950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls") pod "dns-default-vgtkb" (UID: "aa0dafc2-29df-461d-b75d-ffd9520da4a3") : secret "dns-default-metrics-tls" not found
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333042    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333074    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d3436d9-66ba-49a0-b23d-5001109859f5-crio-socket\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333097    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27n2f\" (UniqueName: \"kubernetes.io/projected/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-api-access-27n2f\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333120    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-cert\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.333140    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333184    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.333202    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:22.833187902 +0000 UTC m=+36.089265272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : configmap "kube-rbac-proxy" not found
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333234    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3436d9-66ba-49a0-b23d-5001109859f5-data-volume\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333290    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d3436d9-66ba-49a0-b23d-5001109859f5-crio-socket\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333318    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0dafc2-29df-461d-b75d-ffd9520da4a3-tmp-dir\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.333345    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:22.333402 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333348    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxmx\" (UniqueName: \"kubernetes.io/projected/10e1b9c6-9d49-4ff1-990c-5672ed99f5a2-kube-api-access-lhxmx\") pod \"migrator-d57d58cc9-w5z6c\" (UID: \"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"
Jul 02 19:54:22.333771 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.333390    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:22.833378133 +0000 UTC m=+36.089455489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:22.333771 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333663    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5f5\" (UniqueName: \"kubernetes.io/projected/aa0dafc2-29df-461d-b75d-ffd9520da4a3-kube-api-access-hs5f5\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.333771 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333676    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0dafc2-29df-461d-b75d-ffd9520da4a3-tmp-dir\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.333771 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333687    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9nds\" (UniqueName: \"kubernetes.io/projected/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-kube-api-access-n9nds\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.333771 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.333711    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa0dafc2-29df-461d-b75d-ffd9520da4a3-config-volume\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.334255 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.334234    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa0dafc2-29df-461d-b75d-ffd9520da4a3-config-volume\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.338484 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.338440    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-cert\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.342201 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.342175    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5f5\" (UniqueName: \"kubernetes.io/projected/aa0dafc2-29df-461d-b75d-ffd9520da4a3-kube-api-access-hs5f5\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.342318 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.342264    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27n2f\" (UniqueName: \"kubernetes.io/projected/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-api-access-27n2f\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.342763 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.342740    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9nds\" (UniqueName: \"kubernetes.io/projected/fc808a6e-33dc-4f4f-8bfd-8557f83e9b58-kube-api-access-n9nds\") pod \"ingress-canary-2nct7\" (UID: \"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58\") " pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.435025 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.434984    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxmx\" (UniqueName: \"kubernetes.io/projected/10e1b9c6-9d49-4ff1-990c-5672ed99f5a2-kube-api-access-lhxmx\") pod \"migrator-d57d58cc9-w5z6c\" (UID: \"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"
Jul 02 19:54:22.443965 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.443931    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxmx\" (UniqueName: \"kubernetes.io/projected/10e1b9c6-9d49-4ff1-990c-5672ed99f5a2-kube-api-access-lhxmx\") pod \"migrator-d57d58cc9-w5z6c\" (UID: \"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"
Jul 02 19:54:22.462654 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.462629    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2nct7"
Jul 02 19:54:22.495948 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.495913    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"
Jul 02 19:54:22.839290 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.839227    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.839462 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.839348    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:22.839462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839397    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:22.839462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839460    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:54:22.839781 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839477    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:23.839452351 +0000 UTC m=+37.095529728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:22.839781 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839477    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:54:22.839781 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:22.839400    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:22.839781 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839509    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:23.839494829 +0000 UTC m=+37.095572186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : configmap "kube-rbac-proxy" not found
Jul 02 19:54:22.839781 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:22.839555    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls podName:aa0dafc2-29df-461d-b75d-ffd9520da4a3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:23.839533841 +0000 UTC m=+37.095611211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls") pod "dns-default-vgtkb" (UID: "aa0dafc2-29df-461d-b75d-ffd9520da4a3") : secret "dns-default-metrics-tls" not found
Jul 02 19:54:23.177272 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.177194    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cv99p_1dfeb318-8903-4cdf-b1d3-13e3c0876c78/dns-node-resolver/0.log"
Jul 02 19:54:23.512189 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.511966    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c"]
Jul 02 19:54:23.516508 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.516481    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2nct7"]
Jul 02 19:54:23.537635 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:23.537598    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e1b9c6_9d49_4ff1_990c_5672ed99f5a2.slice/crio-738264912b6b7f136df2209518a329e4471ed5816768b8433511464ac1cc1404 WatchSource:0}: Error finding container 738264912b6b7f136df2209518a329e4471ed5816768b8433511464ac1cc1404: Status 404 returned error can't find the container with id 738264912b6b7f136df2209518a329e4471ed5816768b8433511464ac1cc1404
Jul 02 19:54:23.538033 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:23.538008    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc808a6e_33dc_4f4f_8bfd_8557f83e9b58.slice/crio-0f59e5ea9afcbf5612380ce4b52cc14b5966990bdf0822ee1ef5d4091de80d4e WatchSource:0}: Error finding container 0f59e5ea9afcbf5612380ce4b52cc14b5966990bdf0822ee1ef5d4091de80d4e: Status 404 returned error can't find the container with id 0f59e5ea9afcbf5612380ce4b52cc14b5966990bdf0822ee1ef5d4091de80d4e
Jul 02 19:54:23.849762 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.849725    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:23.849927 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.849776    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:23.849927 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:23.849815    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:23.849927 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849872    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:54:23.849927 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849911    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:54:23.849927 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849928    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:23.850118 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849933    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls podName:aa0dafc2-29df-461d-b75d-ffd9520da4a3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.849917111 +0000 UTC m=+39.105994467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls") pod "dns-default-vgtkb" (UID: "aa0dafc2-29df-461d-b75d-ffd9520da4a3") : secret "dns-default-metrics-tls" not found
Jul 02 19:54:23.850118 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849964    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.849950254 +0000 UTC m=+39.106027628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:23.850118 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:23.849978    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.849972379 +0000 UTC m=+39.106049735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : configmap "kube-rbac-proxy" not found
Jul 02 19:54:24.346296 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:24.346248    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5d4s7_87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5/node-ca/0.log"
Jul 02 19:54:24.394095 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:24.394041    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2nct7" event={"ID":"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58","Type":"ContainerStarted","Data":"0f59e5ea9afcbf5612380ce4b52cc14b5966990bdf0822ee1ef5d4091de80d4e"}
Jul 02 19:54:24.397388 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:24.397358    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="e180dfe747b6a63ffc335142232b542aae5c311422f8b0b5a6d8eb8575b74a50" exitCode=0
Jul 02 19:54:24.397531 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:24.397438    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"e180dfe747b6a63ffc335142232b542aae5c311422f8b0b5a6d8eb8575b74a50"}
Jul 02 19:54:24.398878 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:24.398854    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c" event={"ID":"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2","Type":"ContainerStarted","Data":"738264912b6b7f136df2209518a329e4471ed5816768b8433511464ac1cc1404"}
Jul 02 19:54:25.405750 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:25.405545    2546 generic.go:356] "Generic (PLEG): container finished" podID="d3ab84f9-a1ed-442b-81df-18c198cecb2a" containerID="0838bcfe87062cd3aa3bc920ac2a40a8fe056157de8f7a9667f7fbe062128ecd" exitCode=0
Jul 02 19:54:25.406221 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:25.405617    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerDied","Data":"0838bcfe87062cd3aa3bc920ac2a40a8fe056157de8f7a9667f7fbe062128ecd"}
Jul 02 19:54:25.866552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:25.866513    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:25.866745 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:25.866580    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:25.866745 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:25.866649    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:25.866745 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866685    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:54:25.866898 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866755    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:25.866898 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866689    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:54:25.866898 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866759    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:29.866740853 +0000 UTC m=+43.122818222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : configmap "kube-rbac-proxy" not found
Jul 02 19:54:25.866898 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866821    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:29.866804191 +0000 UTC m=+43.122881550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:25.866898 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:25.866839    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls podName:aa0dafc2-29df-461d-b75d-ffd9520da4a3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:29.86682846 +0000 UTC m=+43.122905816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls") pod "dns-default-vgtkb" (UID: "aa0dafc2-29df-461d-b75d-ffd9520da4a3") : secret "dns-default-metrics-tls" not found
Jul 02 19:54:26.409567 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.409526    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2nct7" event={"ID":"fc808a6e-33dc-4f4f-8bfd-8557f83e9b58","Type":"ContainerStarted","Data":"9652ab02af9106e86738cbbe6dd1b6d6ba50abac47bfeb4e104947eae9bbbbeb"}
Jul 02 19:54:26.413249 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.413217    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whqqx" event={"ID":"d3ab84f9-a1ed-442b-81df-18c198cecb2a","Type":"ContainerStarted","Data":"4e9546ee736567e43e5a3a5a8832c1ccf50f8e72cb87d962f470b320529c71b0"}
Jul 02 19:54:26.414852 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.414830    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c" event={"ID":"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2","Type":"ContainerStarted","Data":"fce79badc48ab56339a9be289566196e20089322e5be10737ef5ce212b36132f"}
Jul 02 19:54:26.414954 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.414873    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c" event={"ID":"10e1b9c6-9d49-4ff1-990c-5672ed99f5a2","Type":"ContainerStarted","Data":"445a239f3026a552124ea642185c74f0f6008d10a7a73b06bb9c5c36317c9769"}
Jul 02 19:54:26.426464 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.426377    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2nct7" podStartSLOduration=1.720928716 podStartE2EDuration="4.426358646s" totalImagesPullingTime="2.70542993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:26.425040062 +0000 UTC m=+39.681117478" watchObservedRunningTime="2026-07-02 19:54:26.426358646 +0000 UTC m=+39.682436024"
Jul 02 19:54:26.441168 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.441122    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w5z6c" podStartSLOduration=2.025461947 podStartE2EDuration="4.441106247s" totalImagesPullingTime="2.4156443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:26.440618115 +0000 UTC m=+39.696695507" watchObservedRunningTime="2026-07-02 19:54:26.441106247 +0000 UTC m=+39.697183627"
Jul 02 19:54:26.462617 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:26.462571    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-whqqx" podStartSLOduration=7.7914181 podStartE2EDuration="39.462538616s" totalImagesPullingTime="31.671120516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:26.461617455 +0000 UTC m=+39.717694848" watchObservedRunningTime="2026-07-02 19:54:26.462538616 +0000 UTC m=+39.718615993"
Jul 02 19:54:29.900008 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:29.899969    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:29.900035    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:29.900081    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:29.900150    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:29.900184    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:29.900217    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls podName:9d3436d9-66ba-49a0-b23d-5001109859f5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:37.900199669 +0000 UTC m=+51.156277042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flkbp" (UID: "9d3436d9-66ba-49a0-b23d-5001109859f5") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:54:29.900462 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:29.900232    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls podName:aa0dafc2-29df-461d-b75d-ffd9520da4a3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:37.900225461 +0000 UTC m=+51.156302817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls") pod "dns-default-vgtkb" (UID: "aa0dafc2-29df-461d-b75d-ffd9520da4a3") : secret "dns-default-metrics-tls" not found
Jul 02 19:54:29.900642 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:29.900629    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d3436d9-66ba-49a0-b23d-5001109859f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:37.959494 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:37.959455    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:37.959950 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:37.959522    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:37.963157 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:37.963134    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d3436d9-66ba-49a0-b23d-5001109859f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flkbp\" (UID: \"9d3436d9-66ba-49a0-b23d-5001109859f5\") " pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:37.963294 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:37.963133    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0dafc2-29df-461d-b75d-ffd9520da4a3-metrics-tls\") pod \"dns-default-vgtkb\" (UID: \"aa0dafc2-29df-461d-b75d-ffd9520da4a3\") " pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:38.041444 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.041399    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:38.047553 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.047530    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flkbp"
Jul 02 19:54:38.182243 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.182208    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgtkb"]
Jul 02 19:54:38.185038 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:38.185010    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0dafc2_29df_461d_b75d_ffd9520da4a3.slice/crio-0c3f8e453eaf7b96f56d443b2dd9ce3f52650a3a109e85babd9387e58bbc2abc WatchSource:0}: Error finding container 0c3f8e453eaf7b96f56d443b2dd9ce3f52650a3a109e85babd9387e58bbc2abc: Status 404 returned error can't find the container with id 0c3f8e453eaf7b96f56d443b2dd9ce3f52650a3a109e85babd9387e58bbc2abc
Jul 02 19:54:38.199215 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.199175    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flkbp"]
Jul 02 19:54:38.202590 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:38.202566    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3436d9_66ba_49a0_b23d_5001109859f5.slice/crio-d54623d88db3cbb313a69e2e6c1b905e7da08c657a0f9586bfb7fe0473505b43 WatchSource:0}: Error finding container d54623d88db3cbb313a69e2e6c1b905e7da08c657a0f9586bfb7fe0473505b43: Status 404 returned error can't find the container with id d54623d88db3cbb313a69e2e6c1b905e7da08c657a0f9586bfb7fe0473505b43
Jul 02 19:54:38.446087 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.446023    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgtkb" event={"ID":"aa0dafc2-29df-461d-b75d-ffd9520da4a3","Type":"ContainerStarted","Data":"0c3f8e453eaf7b96f56d443b2dd9ce3f52650a3a109e85babd9387e58bbc2abc"}
Jul 02 19:54:38.447086 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:38.447047    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flkbp" event={"ID":"9d3436d9-66ba-49a0-b23d-5001109859f5","Type":"ContainerStarted","Data":"d54623d88db3cbb313a69e2e6c1b905e7da08c657a0f9586bfb7fe0473505b43"}
Jul 02 19:54:43.463192 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:43.463153    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flkbp" event={"ID":"9d3436d9-66ba-49a0-b23d-5001109859f5","Type":"ContainerStarted","Data":"05f3631af3c0e0b8ae270050a99c4589172f413cb65e7e117b6a6d88465276d9"}
Jul 02 19:54:43.463659 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:43.463223    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flkbp" event={"ID":"9d3436d9-66ba-49a0-b23d-5001109859f5","Type":"ContainerStarted","Data":"538e8222b568179e42712aea7efa8b98705d15e9959777af293a9225e18ec47d"}
Jul 02 19:54:43.464842 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:43.464819    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgtkb" event={"ID":"aa0dafc2-29df-461d-b75d-ffd9520da4a3","Type":"ContainerStarted","Data":"0c43bf977e2f9cf5d094a0e2e20356411126b733bdaa52c66bbb69351e7615d1"}
Jul 02 19:54:43.464908 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:43.464861    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgtkb" event={"ID":"aa0dafc2-29df-461d-b75d-ffd9520da4a3","Type":"ContainerStarted","Data":"1ce8b7baff83ee6d2bc004600fdd806f5c71bb47de8360cc45d0545ef8af4287"}
Jul 02 19:54:43.465086 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:43.465054    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:45.028670 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.028610    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vgtkb" podStartSLOduration=18.661417937 podStartE2EDuration="23.02858627s" totalImagesPullingTime="4.367168333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:43.481336682 +0000 UTC m=+56.737414087" watchObservedRunningTime="2026-07-02 19:54:45.02858627 +0000 UTC m=+58.284663666"
Jul 02 19:54:45.029154 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.029051    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"]
Jul 02 19:54:45.032169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.032149    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.035587 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.035562    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 19:54:45.035865 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.035818    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:54:45.036512 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.036493    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 19:54:45.037018 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.036773    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:54:45.037018 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.036798    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:54:45.037018 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.036816    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 19:54:45.037018 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.036960    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 19:54:45.045902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.045875    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"]
Jul 02 19:54:45.114949 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.114876    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.114949 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.114924    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.115209 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.114982    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.115209 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.115019    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvfv\" (UniqueName: \"kubernetes.io/projected/408a4e65-5d54-4ac0-8f92-b50afb425935-kube-api-access-trvfv\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.115209 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.115161    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408a4e65-5d54-4ac0-8f92-b50afb425935-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.115209 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.115196    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215490    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215521 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215525    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215766 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215564    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215766 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215598    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvfv\" (UniqueName: \"kubernetes.io/projected/408a4e65-5d54-4ac0-8f92-b50afb425935-kube-api-access-trvfv\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215766 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215655    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408a4e65-5d54-4ac0-8f92-b50afb425935-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.215766 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.215679    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.216545 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.216494    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408a4e65-5d54-4ac0-8f92-b50afb425935-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.218630 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.218604    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-ca\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.218751 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.218696    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.218812 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.218770    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.219130 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.219111    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408a4e65-5d54-4ac0-8f92-b50afb425935-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.227893 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.227867    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvfv\" (UniqueName: \"kubernetes.io/projected/408a4e65-5d54-4ac0-8f92-b50afb425935-kube-api-access-trvfv\") pod \"cluster-proxy-proxy-agent-769df94d4f-d6674\" (UID: \"408a4e65-5d54-4ac0-8f92-b50afb425935\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.353996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.353956    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"
Jul 02 19:54:45.514271 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:45.514212    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674"]
Jul 02 19:54:45.518418 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:45.518387    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod408a4e65_5d54_4ac0_8f92_b50afb425935.slice/crio-c1afdcaf546cce2bd92169eeabd4b7a39d559b24d1886dc07c87d80d7df821f5 WatchSource:0}: Error finding container c1afdcaf546cce2bd92169eeabd4b7a39d559b24d1886dc07c87d80d7df821f5: Status 404 returned error can't find the container with id c1afdcaf546cce2bd92169eeabd4b7a39d559b24d1886dc07c87d80d7df821f5
Jul 02 19:54:46.476991 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:46.476953    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674" event={"ID":"408a4e65-5d54-4ac0-8f92-b50afb425935","Type":"ContainerStarted","Data":"c1afdcaf546cce2bd92169eeabd4b7a39d559b24d1886dc07c87d80d7df821f5"}
Jul 02 19:54:47.390134 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:47.390105    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bz5w"
Jul 02 19:54:47.483000 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:47.482955    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flkbp" event={"ID":"9d3436d9-66ba-49a0-b23d-5001109859f5","Type":"ContainerStarted","Data":"46ca238425a536fc3ed8b3c4846f3157197c213bcbb838c35b4a5d75b6a70ba3"}
Jul 02 19:54:47.504106 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:47.504035    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flkbp" podStartSLOduration=17.12791581 podStartE2EDuration="25.504011963s" totalImagesPullingTime="8.376096153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:47.50289832 +0000 UTC m=+60.758975700" watchObservedRunningTime="2026-07-02 19:54:47.504011963 +0000 UTC m=+60.760089339"
Jul 02 19:54:49.064770 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.064736    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"]
Jul 02 19:54:49.069047 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.069024    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:49.071315 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.071293    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 19:54:49.071448 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.071325    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rfdrz\""
Jul 02 19:54:49.076785 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.076361    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"]
Jul 02 19:54:49.150738 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.150699    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lbtsz\" (UID: \"8702ca10-5544-462b-96a2-325cc1ce99cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:49.252035 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.251988    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lbtsz\" (UID: \"8702ca10-5544-462b-96a2-325cc1ce99cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:49.252249 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:49.252227    2546 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:54:49.252314 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:49.252307    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates podName:8702ca10-5544-462b-96a2-325cc1ce99cd nodeName:}" failed. No retries permitted until 2026-07-02 19:54:49.752287034 +0000 UTC m=+63.008364408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-lbtsz" (UID: "8702ca10-5544-462b-96a2-325cc1ce99cd") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:54:49.756000 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.755959    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lbtsz\" (UID: \"8702ca10-5544-462b-96a2-325cc1ce99cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:49.758626 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.758598    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8702ca10-5544-462b-96a2-325cc1ce99cd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lbtsz\" (UID: \"8702ca10-5544-462b-96a2-325cc1ce99cd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:49.979201 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:49.979155    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:51.097924 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.097894    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"]
Jul 02 19:54:51.101740 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:51.101714    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8702ca10_5544_462b_96a2_325cc1ce99cd.slice/crio-6063d036bf560f726fe2c5605f227c3ae7a8fc6e2e8498a7bd9a1d1216030a72 WatchSource:0}: Error finding container 6063d036bf560f726fe2c5605f227c3ae7a8fc6e2e8498a7bd9a1d1216030a72: Status 404 returned error can't find the container with id 6063d036bf560f726fe2c5605f227c3ae7a8fc6e2e8498a7bd9a1d1216030a72
Jul 02 19:54:51.497471 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.497374    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674" event={"ID":"408a4e65-5d54-4ac0-8f92-b50afb425935","Type":"ContainerStarted","Data":"2d9036a8318c402bb247d455079cfb58852e91540fa452cdd6362bb951352157"}
Jul 02 19:54:51.497471 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.497422    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674" event={"ID":"408a4e65-5d54-4ac0-8f92-b50afb425935","Type":"ContainerStarted","Data":"2a7f45aa794f16665b3aade98d8201844b5e8db791bde95414cb1d391c0d6b09"}
Jul 02 19:54:51.497471 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.497441    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674" event={"ID":"408a4e65-5d54-4ac0-8f92-b50afb425935","Type":"ContainerStarted","Data":"11059bcf229055956b45f52bc113bdfd77e5e3d83028b75f4472300ba0d41026"}
Jul 02 19:54:51.498578 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.498558    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz" event={"ID":"8702ca10-5544-462b-96a2-325cc1ce99cd","Type":"ContainerStarted","Data":"6063d036bf560f726fe2c5605f227c3ae7a8fc6e2e8498a7bd9a1d1216030a72"}
Jul 02 19:54:51.516278 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:51.516227    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769df94d4f-d6674" podStartSLOduration=0.993022687 podStartE2EDuration="6.516212553s" totalImagesPullingTime="5.523189866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:51.515731239 +0000 UTC m=+64.771808642" watchObservedRunningTime="2026-07-02 19:54:51.516212553 +0000 UTC m=+64.772289932"
Jul 02 19:54:52.503828 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.503785    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz" event={"ID":"8702ca10-5544-462b-96a2-325cc1ce99cd","Type":"ContainerStarted","Data":"be28bae095ca194cf32ebc8e0648e4fac23375660b95e0bf40a5c117a416b302"}
Jul 02 19:54:52.504234 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.503886    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:52.508592 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.508569    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz"
Jul 02 19:54:52.522362 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.522318    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lbtsz" podStartSLOduration=2.29981893 podStartE2EDuration="3.522305005s" totalImagesPullingTime="1.222486075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:52.520824422 +0000 UTC m=+65.776901823" watchObservedRunningTime="2026-07-02 19:54:52.522305005 +0000 UTC m=+65.778382384"
Jul 02 19:54:52.881855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.881814    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:52.882127 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.881879    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:52.884255 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.884232    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:54:52.884371 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.884262    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:54:52.895145 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.895115    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78131271-709c-4e4b-b0ac-4393b30d5e9b-metrics-certs\") pod \"network-metrics-daemon-4nwff\" (UID: \"78131271-709c-4e4b-b0ac-4393b30d5e9b\") " pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:52.895232 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.895148    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79350bbc-d62e-48f2-bd97-3cca633879c7-original-pull-secret\") pod \"global-pull-secret-syncer-zv8fd\" (UID: \"79350bbc-d62e-48f2-bd97-3cca633879c7\") " pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:52.982750 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.982713    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:52.985269 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.985249    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:54:52.995293 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:52.995275    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:54:53.006292 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.006271    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzp5\" (UniqueName: \"kubernetes.io/projected/9b51f215-3cd9-43d9-a4c3-7162f9e0afe1-kube-api-access-mvzp5\") pod \"network-check-target-v6d6v\" (UID: \"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1\") " pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:53.111082 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.111034    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k665n\""
Jul 02 19:54:53.115770 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.115754    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdnmq\""
Jul 02 19:54:53.119480 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.119467    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:53.120657 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.120635    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zv8fd"
Jul 02 19:54:53.124162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.124144    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nwff"
Jul 02 19:54:53.260365 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.260320    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zv8fd"]
Jul 02 19:54:53.264522 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:53.264100    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79350bbc_d62e_48f2_bd97_3cca633879c7.slice/crio-03edc436db927d101590ca47f94209afee225bdf8c5d7ee73e0ab84183a147e7 WatchSource:0}: Error finding container 03edc436db927d101590ca47f94209afee225bdf8c5d7ee73e0ab84183a147e7: Status 404 returned error can't find the container with id 03edc436db927d101590ca47f94209afee225bdf8c5d7ee73e0ab84183a147e7
Jul 02 19:54:53.276377 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.276353    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v6d6v"]
Jul 02 19:54:53.279602 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:53.279574    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b51f215_3cd9_43d9_a4c3_7162f9e0afe1.slice/crio-53b8b89e8f60e78ccdfbe5d1a4cde5489be0d47b6de5d0064fe146c74bad2ad9 WatchSource:0}: Error finding container 53b8b89e8f60e78ccdfbe5d1a4cde5489be0d47b6de5d0064fe146c74bad2ad9: Status 404 returned error can't find the container with id 53b8b89e8f60e78ccdfbe5d1a4cde5489be0d47b6de5d0064fe146c74bad2ad9
Jul 02 19:54:53.294377 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.294350    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4nwff"]
Jul 02 19:54:53.297190 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:53.297169    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78131271_709c_4e4b_b0ac_4393b30d5e9b.slice/crio-53db02b325a30bb3c75588b34f6dd46edaed452a6a985717fa44220b8361bc2b WatchSource:0}: Error finding container 53db02b325a30bb3c75588b34f6dd46edaed452a6a985717fa44220b8361bc2b: Status 404 returned error can't find the container with id 53db02b325a30bb3c75588b34f6dd46edaed452a6a985717fa44220b8361bc2b
Jul 02 19:54:53.469606 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.469525    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vgtkb"
Jul 02 19:54:53.509318 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.509287    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nwff" event={"ID":"78131271-709c-4e4b-b0ac-4393b30d5e9b","Type":"ContainerStarted","Data":"53db02b325a30bb3c75588b34f6dd46edaed452a6a985717fa44220b8361bc2b"}
Jul 02 19:54:53.510723 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.510689    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zv8fd" event={"ID":"79350bbc-d62e-48f2-bd97-3cca633879c7","Type":"ContainerStarted","Data":"03edc436db927d101590ca47f94209afee225bdf8c5d7ee73e0ab84183a147e7"}
Jul 02 19:54:53.512035 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:53.512007    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v6d6v" event={"ID":"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1","Type":"ContainerStarted","Data":"53b8b89e8f60e78ccdfbe5d1a4cde5489be0d47b6de5d0064fe146c74bad2ad9"}
Jul 02 19:54:55.522447 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:55.522362    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nwff" event={"ID":"78131271-709c-4e4b-b0ac-4393b30d5e9b","Type":"ContainerStarted","Data":"05cfb00b96dd64488cc8a1ea74eb7064a4326d20a900c7b724fff56e9f581607"}
Jul 02 19:54:55.522447 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:55.522426    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nwff" event={"ID":"78131271-709c-4e4b-b0ac-4393b30d5e9b","Type":"ContainerStarted","Data":"a53fba0fdbd7b4d5e5e112815347cf2c46af00d4d927428ac07e5b4675e1efb9"}
Jul 02 19:54:55.540604 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:55.540543    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4nwff" podStartSLOduration=66.964141848 podStartE2EDuration="1m8.540523535s" totalImagesPullingTime="1.576381687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:55.53890155 +0000 UTC m=+68.794978932" watchObservedRunningTime="2026-07-02 19:54:55.540523535 +0000 UTC m=+68.796600912"
Jul 02 19:54:58.527835 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.527796    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llnv7"]
Jul 02 19:54:58.531336 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.531302    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.533495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.533474    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:54:58.533652 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.533627    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:54:58.533968 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.533950    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:54:58.533968 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.533962    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:54:58.534161 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.534040    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:54:58.534906 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.534852    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zv8fd" event={"ID":"79350bbc-d62e-48f2-bd97-3cca633879c7","Type":"ContainerStarted","Data":"67d204747c878cc8eb3e0f8ffb2bb952aa7c13c68a463ca5fb8575bd1e2d5b4b"}
Jul 02 19:54:58.534906 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.534888    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56bzk\""
Jul 02 19:54:58.535093 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.534951    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:54:58.540100 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.540074    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v6d6v" event={"ID":"9b51f215-3cd9-43d9-a4c3-7162f9e0afe1","Type":"ContainerStarted","Data":"725dbd218c5177c474fdd56fc8b5d587e4a9ad53a9bcbfe64bd3134b2e0339fd"}
Jul 02 19:54:58.540181 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.540143    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:54:58.574324 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.574246    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zv8fd" podStartSLOduration=66.918042594 podStartE2EDuration="1m11.574230179s" totalImagesPullingTime="4.656187585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:58.573310432 +0000 UTC m=+71.829387810" watchObservedRunningTime="2026-07-02 19:54:58.574230179 +0000 UTC m=+71.830307561"
Jul 02 19:54:58.589379 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.589333    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v6d6v" podStartSLOduration=66.954081967 podStartE2EDuration="1m11.589305659s" totalImagesPullingTime="4.635223692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:58.588101862 +0000 UTC m=+71.844179264" watchObservedRunningTime="2026-07-02 19:54:58.589305659 +0000 UTC m=+71.845383029"
Jul 02 19:54:58.626817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.626780    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.626817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.626824    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-sys\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627051 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.626852    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-textfile\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627051 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.626939    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-metrics-client-ca\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627051 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.626972    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627051 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.627008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627051 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.627035    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-wtmp\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627303 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.627085    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-root\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.627303 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.627139    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkczs\" (UniqueName: \"kubernetes.io/projected/4c701304-f392-4e83-b025-981ade3584d5-kube-api-access-vkczs\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728201 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728169    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-sys\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728208    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-textfile\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728275    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-sys\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728319    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-metrics-client-ca\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728454 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728349    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728454 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728386    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728454 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728406    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-wtmp\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728454 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728430    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-root\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728638 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728464    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkczs\" (UniqueName: \"kubernetes.io/projected/4c701304-f392-4e83-b025-981ade3584d5-kube-api-access-vkczs\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728638 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728511    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728638 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728546    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-textfile\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728638 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728605    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-wtmp\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.728638 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:58.728628    2546 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:54:58.728819 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:54:58.728691    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls podName:4c701304-f392-4e83-b025-981ade3584d5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:59.2286699 +0000 UTC m=+72.484747273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls") pod "node-exporter-llnv7" (UID: "4c701304-f392-4e83-b025-981ade3584d5") : secret "node-exporter-tls" not found
Jul 02 19:54:58.728935 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.728901    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-metrics-client-ca\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.729131 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.729111    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c701304-f392-4e83-b025-981ade3584d5-root\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.729176 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.729114    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.730708 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.730687    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:58.737128 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:58.737104    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkczs\" (UniqueName: \"kubernetes.io/projected/4c701304-f392-4e83-b025-981ade3584d5-kube-api-access-vkczs\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:59.232339 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:59.232302    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:59.234529 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:59.234498    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c701304-f392-4e83-b025-981ade3584d5-node-exporter-tls\") pod \"node-exporter-llnv7\" (UID: \"4c701304-f392-4e83-b025-981ade3584d5\") " pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:59.443951 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:59.443891    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llnv7"
Jul 02 19:54:59.456939 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:54:59.456911    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c701304_f392_4e83_b025_981ade3584d5.slice/crio-eb275fc2ad31d1305257c35055bbeab8f5dd2f06b38eeff727333eab34c7b7c1 WatchSource:0}: Error finding container eb275fc2ad31d1305257c35055bbeab8f5dd2f06b38eeff727333eab34c7b7c1: Status 404 returned error can't find the container with id eb275fc2ad31d1305257c35055bbeab8f5dd2f06b38eeff727333eab34c7b7c1
Jul 02 19:54:59.544251 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:54:59.544154    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llnv7" event={"ID":"4c701304-f392-4e83-b025-981ade3584d5","Type":"ContainerStarted","Data":"eb275fc2ad31d1305257c35055bbeab8f5dd2f06b38eeff727333eab34c7b7c1"}
Jul 02 19:55:00.430921 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.430887    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:00.435592 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.435566    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.440160 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.440132    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:55:00.440160 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.440156    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rzpxd\""
Jul 02 19:55:00.440416 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.440131    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:55:00.440947 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.440923    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:55:00.440947 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.440940    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:55:00.441308 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.441195    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:55:00.441308 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.441267    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:55:00.441467 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.441222    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:55:00.446902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.446861    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.540850    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.540915    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.540955    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.540994    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.541019    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.541190 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.541053    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnd7b\" (UniqueName: \"kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.549257 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.549236    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"]
Jul 02 19:55:00.552413 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.552396    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.555043 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555020    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 19:55:00.555169 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555090    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 19:55:00.555371 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555356    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 19:55:00.555371 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555368    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8j257\""
Jul 02 19:55:00.555495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555358    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 19:55:00.555495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555357    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-feut0gsjergsv\""
Jul 02 19:55:00.555626 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.555611    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 19:55:00.565154 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.565132    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"]
Jul 02 19:55:00.642214 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642181    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.642214 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642222    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642461 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642249    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-grpc-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642461 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642266    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.642461 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642337    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642461 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642412    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnd7b\" (UniqueName: \"kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.642639 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642458    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.642639 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642495    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642639 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642538    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqcg\" (UniqueName: \"kubernetes.io/projected/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-kube-api-access-xfqcg\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642639 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642573    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642639 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642599    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.642855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642640    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-metrics-client-ca\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642692    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.642855 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642763    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.643004 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.642985    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.643352 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.643331    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.643428 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.643410    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.644879 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.644850    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.644970 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.644905    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.650860 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.650837    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnd7b\" (UniqueName: \"kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b\") pod \"console-65d6c54959-cz5pj\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") " pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.743922 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.743876    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqcg\" (UniqueName: \"kubernetes.io/projected/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-kube-api-access-xfqcg\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.743922 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.743926    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744173 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.743951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-metrics-client-ca\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744173 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744073    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744173 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744135    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744173 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744166    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-grpc-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744403 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744199    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744403 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744357    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.744744 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.744706    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-metrics-client-ca\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.746690 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.746648    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.746797 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.746758    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.746958 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.746935    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.747077 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.747038    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.747136 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.747038    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-grpc-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.747188 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.747134    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-secret-thanos-querier-tls\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.748965 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.748949    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:00.752838 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.752817    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqcg\" (UniqueName: \"kubernetes.io/projected/9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036-kube-api-access-xfqcg\") pod \"thanos-querier-6c87b5b56-9rdp7\" (UID: \"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036\") " pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.867683 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.867653    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:00.875198 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.875172    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:00.877493 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:55:00.877465    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c67884_19be_4e28_9477_a8784aed3442.slice/crio-841b2b0200fece6a83771006b65edcd7804473d8b7fb128b664190d453ffd32f WatchSource:0}: Error finding container 841b2b0200fece6a83771006b65edcd7804473d8b7fb128b664190d453ffd32f: Status 404 returned error can't find the container with id 841b2b0200fece6a83771006b65edcd7804473d8b7fb128b664190d453ffd32f
Jul 02 19:55:00.994586 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:00.994467    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"]
Jul 02 19:55:00.996919 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:55:00.996894    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa4b38e_c4e4_4cef_8ee0_39a1b5b57036.slice/crio-d0d3f9eb8e8bcd796e157de1699bc5c26ae74be77503b67da217ab70945e5985 WatchSource:0}: Error finding container d0d3f9eb8e8bcd796e157de1699bc5c26ae74be77503b67da217ab70945e5985: Status 404 returned error can't find the container with id d0d3f9eb8e8bcd796e157de1699bc5c26ae74be77503b67da217ab70945e5985
Jul 02 19:55:01.552787 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:01.552746    2546 generic.go:356] "Generic (PLEG): container finished" podID="4c701304-f392-4e83-b025-981ade3584d5" containerID="2d3877f548ce4382d39897da8ef8cfe4c2a6c84979b39fceea6054c8d09999dc" exitCode=0
Jul 02 19:55:01.553246 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:01.552829    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llnv7" event={"ID":"4c701304-f392-4e83-b025-981ade3584d5","Type":"ContainerDied","Data":"2d3877f548ce4382d39897da8ef8cfe4c2a6c84979b39fceea6054c8d09999dc"}
Jul 02 19:55:01.554121 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:01.554092    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d6c54959-cz5pj" event={"ID":"e6c67884-19be-4e28-9477-a8784aed3442","Type":"ContainerStarted","Data":"841b2b0200fece6a83771006b65edcd7804473d8b7fb128b664190d453ffd32f"}
Jul 02 19:55:01.555296 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:01.555275    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"d0d3f9eb8e8bcd796e157de1699bc5c26ae74be77503b67da217ab70945e5985"}
Jul 02 19:55:02.562959 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.562909    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llnv7" event={"ID":"4c701304-f392-4e83-b025-981ade3584d5","Type":"ContainerStarted","Data":"a201870142ff7585d0f118b0952b0aff133805a7b0aa5e097b499e7f81e2183d"}
Jul 02 19:55:02.563477 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.562976    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llnv7" event={"ID":"4c701304-f392-4e83-b025-981ade3584d5","Type":"ContainerStarted","Data":"ce0e51f222d477e0763aa108ce1ba1fabded4d6dff6dc14e42470be08310cc6d"}
Jul 02 19:55:02.584954 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.584566    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llnv7" podStartSLOduration=3.436885576 podStartE2EDuration="4.584545644s" totalImagesPullingTime="1.083472459s" totalInitContainerRuntime="64.187609ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:02.583782017 +0000 UTC m=+75.839859408" watchObservedRunningTime="2026-07-02 19:55:02.584545644 +0000 UTC m=+75.840623025"
Jul 02 19:55:02.801393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.801361    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68f7c6487b-k4rm5"]
Jul 02 19:55:02.804490 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.804465    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.807019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.806998    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 19:55:02.807947 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.807893    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c5j7b\""
Jul 02 19:55:02.807947 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.807918    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 19:55:02.808123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.807970    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fp6u3h5tboqgt\""
Jul 02 19:55:02.808123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.807918    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 19:55:02.808123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.808018    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 19:55:02.814927 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.814838    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68f7c6487b-k4rm5"]
Jul 02 19:55:02.862324 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862282    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-client-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862495 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862345    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5nx2\" (UniqueName: \"kubernetes.io/projected/1e348eb1-28d6-4c23-868f-5fb98450cef6-kube-api-access-s5nx2\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862580 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862482    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-client-certs\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862580 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862528    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1e348eb1-28d6-4c23-868f-5fb98450cef6-audit-log\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862580 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862567    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862733 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862601    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-metrics-server-audit-profiles\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.862733 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.862641    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-tls\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963173 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963137    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5nx2\" (UniqueName: \"kubernetes.io/projected/1e348eb1-28d6-4c23-868f-5fb98450cef6-kube-api-access-s5nx2\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963409 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963345    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-client-certs\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963409 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963396    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1e348eb1-28d6-4c23-868f-5fb98450cef6-audit-log\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963537 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963431    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963537 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963456    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-metrics-server-audit-profiles\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963537 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963501    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-tls\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.963537 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963532    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-client-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.964380 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.963875    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1e348eb1-28d6-4c23-868f-5fb98450cef6-audit-log\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.964380 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.964285    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.964687 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.964669    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1e348eb1-28d6-4c23-868f-5fb98450cef6-metrics-server-audit-profiles\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.966251 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.966225    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-client-ca-bundle\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.966337 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.966247    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-client-certs\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.966337 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.966315    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1e348eb1-28d6-4c23-868f-5fb98450cef6-secret-metrics-server-tls\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:02.975036 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:02.975012    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5nx2\" (UniqueName: \"kubernetes.io/projected/1e348eb1-28d6-4c23-868f-5fb98450cef6-kube-api-access-s5nx2\") pod \"metrics-server-68f7c6487b-k4rm5\" (UID: \"1e348eb1-28d6-4c23-868f-5fb98450cef6\") " pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:03.116140 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:03.116095    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:04.578929 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:04.578648    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d6c54959-cz5pj" event={"ID":"e6c67884-19be-4e28-9477-a8784aed3442","Type":"ContainerStarted","Data":"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"}
Jul 02 19:55:04.598764 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:04.598693    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d6c54959-cz5pj" podStartSLOduration=0.989518604 podStartE2EDuration="4.598671459s" totalImagesPullingTime="3.609152855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:04.597210943 +0000 UTC m=+77.853288367" watchObservedRunningTime="2026-07-02 19:55:04.598671459 +0000 UTC m=+77.854748838"
Jul 02 19:55:04.641023 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:04.640991    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68f7c6487b-k4rm5"]
Jul 02 19:55:04.644562 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:55:04.644535    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e348eb1_28d6_4c23_868f_5fb98450cef6.slice/crio-a73c040f363dd1d4b5a0b821fe18360148befe575798a28b1ce884b96f4bd3a3 WatchSource:0}: Error finding container a73c040f363dd1d4b5a0b821fe18360148befe575798a28b1ce884b96f4bd3a3: Status 404 returned error can't find the container with id a73c040f363dd1d4b5a0b821fe18360148befe575798a28b1ce884b96f4bd3a3
Jul 02 19:55:05.586104 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:05.586054    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5" event={"ID":"1e348eb1-28d6-4c23-868f-5fb98450cef6","Type":"ContainerStarted","Data":"a73c040f363dd1d4b5a0b821fe18360148befe575798a28b1ce884b96f4bd3a3"}
Jul 02 19:55:05.588897 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:05.588863    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"cfb3a5b2eac568f5692545b3376d96c7d01d3ca5268ceacc3fabc855ddf9c742"}
Jul 02 19:55:05.588994 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:05.588930    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"5278ead384ae5ba10af3a429ac0588b2b631b4600efce09bcebdcaa8edd7fe56"}
Jul 02 19:55:05.588994 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:05.588959    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"ea48935877fa5719c04f758b6a7ef4d1c106a7fb26b4775a24dc5865b04bffc9"}
Jul 02 19:55:05.588994 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:05.588984    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"914712a1bb84a21c8989480541bc6dfd11ab97a79001e3c479f4bd1f6eadcd0b"}
Jul 02 19:55:06.594668 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:06.594631    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"96ec57435587911ca5a57fcd1535363feb5c618211c8b45a02b098b653d9361a"}
Jul 02 19:55:06.595082 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:06.594694    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" event={"ID":"9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036","Type":"ContainerStarted","Data":"973504fb82f25a7ae20abfdf07bb43067e2fbe4244ff13e4aebc08ef031312dd"}
Jul 02 19:55:06.595082 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:06.594768    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:06.617996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:06.617942    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7" podStartSLOduration=2.315974249 podStartE2EDuration="6.61792888s" totalImagesPullingTime="4.301954631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:06.616707677 +0000 UTC m=+79.872785077" watchObservedRunningTime="2026-07-02 19:55:06.61792888 +0000 UTC m=+79.874006258"
Jul 02 19:55:07.599394 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:07.599350    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5" event={"ID":"1e348eb1-28d6-4c23-868f-5fb98450cef6","Type":"ContainerStarted","Data":"ce0074ebf28a436703c7ea5aa5132e4c1d66fbe3c1c5b65a81d45b9c7f54adba"}
Jul 02 19:55:07.620369 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:07.620315    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5" podStartSLOduration=3.656516568 podStartE2EDuration="5.620300917s" totalImagesPullingTime="1.963784349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:07.618890854 +0000 UTC m=+80.874968273" watchObservedRunningTime="2026-07-02 19:55:07.620300917 +0000 UTC m=+80.876378324"
Jul 02 19:55:10.749887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:10.749751    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:10.749887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:10.749831    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:10.754549 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:10.754528    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:11.617359 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:11.617330    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:12.605917 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:12.605890    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c87b5b56-9rdp7"
Jul 02 19:55:19.366481 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.366441    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:55:19.388359 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.388322    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:55:19.388515 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.388424    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.396002 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.395485    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 19:55:19.496262 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496223    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496262 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496260    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496511 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496293    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmc2\" (UniqueName: \"kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496511 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496366    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496511 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496450    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496511 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496496    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.496648 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.496520    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597226 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597187    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmc2\" (UniqueName: \"kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597226 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597227    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597428 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597347    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597428 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597377    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597562 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597442    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597562 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597501    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.597562 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.597521    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.598146 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.598123    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.598243 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.598212    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.598279 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.598266    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.598445 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.598424    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.599800 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.599776    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.599950 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.599928    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.611248 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.611223    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmc2\" (UniqueName: \"kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2\") pod \"console-5dd4bccf7d-5wvtc\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") " pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.698485 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.698387    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:19.829392 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:19.829360    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:55:19.832548 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:55:19.832522    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86bd101_5016_409c_a0d9_4d8a541b291d.slice/crio-65e2357a1b49046d1f734f8d53c6d00dcd90717a5e996fb83ccac43e86d97695 WatchSource:0}: Error finding container 65e2357a1b49046d1f734f8d53c6d00dcd90717a5e996fb83ccac43e86d97695: Status 404 returned error can't find the container with id 65e2357a1b49046d1f734f8d53c6d00dcd90717a5e996fb83ccac43e86d97695
Jul 02 19:55:20.645724 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:20.645685    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd4bccf7d-5wvtc" event={"ID":"e86bd101-5016-409c-a0d9-4d8a541b291d","Type":"ContainerStarted","Data":"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"}
Jul 02 19:55:20.646124 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:20.645763    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd4bccf7d-5wvtc" event={"ID":"e86bd101-5016-409c-a0d9-4d8a541b291d","Type":"ContainerStarted","Data":"65e2357a1b49046d1f734f8d53c6d00dcd90717a5e996fb83ccac43e86d97695"}
Jul 02 19:55:20.670134 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:20.670082    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dd4bccf7d-5wvtc" podStartSLOduration=1.6700402269999999 podStartE2EDuration="1.670040227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:20.669716596 +0000 UTC m=+93.925793974" watchObservedRunningTime="2026-07-02 19:55:20.670040227 +0000 UTC m=+93.926117604"
Jul 02 19:55:23.116730 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:23.116683    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:23.117161 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:23.116759    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:29.546799 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:29.546767    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v6d6v"
Jul 02 19:55:29.698756 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:29.698714    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:29.698951 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:29.698787    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:29.703413 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:29.703372    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:30.684877 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:30.684846    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:55:30.741422 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:30.741392    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:43.121905 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:43.121873    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:43.125919 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:43.125891    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68f7c6487b-k4rm5"
Jul 02 19:55:55.763237 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:55.763195    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65d6c54959-cz5pj" podUID="e6c67884-19be-4e28-9477-a8784aed3442" containerName="console" containerID="cri-o://2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986" gracePeriod=15
Jul 02 19:55:56.004227 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.004198    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:56.068150 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068051    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068150 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068107    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068150 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068151    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068377 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068177    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068377 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068327    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnd7b\" (UniqueName: \"kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068473 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068410    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert\") pod \"e6c67884-19be-4e28-9477-a8784aed3442\" (UID: \"e6c67884-19be-4e28-9477-a8784aed3442\") "
Jul 02 19:55:56.068540 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068518    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config" (OuterVolumeSpecName: "console-config") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:55:56.068596 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068560    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:55:56.068596 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068581    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:55:56.068765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068686    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-oauth-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.068765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068699    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-console-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.068765 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.068708    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c67884-19be-4e28-9477-a8784aed3442-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.070505 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.070484    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:55:56.070505 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.070495    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b" (OuterVolumeSpecName: "kube-api-access-wnd7b") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "kube-api-access-wnd7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:55:56.070627 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.070532    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6c67884-19be-4e28-9477-a8784aed3442" (UID: "e6c67884-19be-4e28-9477-a8784aed3442"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:55:56.169397 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.169356    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnd7b\" (UniqueName: \"kubernetes.io/projected/e6c67884-19be-4e28-9477-a8784aed3442-kube-api-access-wnd7b\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.169397 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.169386    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.169397 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.169396    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c67884-19be-4e28-9477-a8784aed3442-console-oauth-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:55:56.774194 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.774153    2546 generic.go:356] "Generic (PLEG): container finished" podID="e6c67884-19be-4e28-9477-a8784aed3442" containerID="2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986" exitCode=0
Jul 02 19:55:56.774619 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.774203    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d6c54959-cz5pj"
Jul 02 19:55:56.774619 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.774203    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d6c54959-cz5pj" event={"ID":"e6c67884-19be-4e28-9477-a8784aed3442","Type":"ContainerDied","Data":"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"}
Jul 02 19:55:56.774619 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.774345    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d6c54959-cz5pj" event={"ID":"e6c67884-19be-4e28-9477-a8784aed3442","Type":"ContainerDied","Data":"841b2b0200fece6a83771006b65edcd7804473d8b7fb128b664190d453ffd32f"}
Jul 02 19:55:56.774619 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.774391    2546 scope.go:117] "RemoveContainer" containerID="2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"
Jul 02 19:55:56.782658 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.782641    2546 scope.go:117] "RemoveContainer" containerID="2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"
Jul 02 19:55:56.782932 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:55:56.782892    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986\": container with ID starting with 2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986 not found: ID does not exist" containerID="2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"
Jul 02 19:55:56.782998 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.782939    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986"} err="failed to get container status \"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986\": rpc error: code = NotFound desc = could not find container \"2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986\": container with ID starting with 2cf2a345eaec448c717f4cd6ef97ad6dadfcf5b1cbd42e5cb3f774bc4463d986 not found: ID does not exist"
Jul 02 19:55:56.795084 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.795044    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:56.801333 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:56.801312    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d6c54959-cz5pj"]
Jul 02 19:55:57.200490 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:55:57.200454    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c67884-19be-4e28-9477-a8784aed3442" path="/var/lib/kubelet/pods/e6c67884-19be-4e28-9477-a8784aed3442/volumes"
Jul 02 19:56:38.513874 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.513839    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 19:56:38.514348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.514141    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c67884-19be-4e28-9477-a8784aed3442" containerName="console"
Jul 02 19:56:38.514348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.514152    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c67884-19be-4e28-9477-a8784aed3442" containerName="console"
Jul 02 19:56:38.514348 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.514214    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c67884-19be-4e28-9477-a8784aed3442" containerName="console"
Jul 02 19:56:38.516900 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.516885    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.527237 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.527214    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 19:56:38.698270 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698235    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698270 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698277    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698489 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698311    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698489 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698329    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698489 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698353    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698489 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698375    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9pv\" (UniqueName: \"kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.698489 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.698411    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799161 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799083    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799161 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799118    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799333 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799164    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799333 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799182    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9pv\" (UniqueName: \"kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799333 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799203    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799445 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799331    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.799445 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799390    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.800012 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.799982    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.800162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.800028    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.800162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.800054    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.800162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.800101    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.801674 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.801642    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.801777 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.801693    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.806852 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.806832    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9pv\" (UniqueName: \"kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv\") pod \"console-dbf6495fb-kkhwp\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") " pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.825860 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.825824    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:38.951403 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:38.951368    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 19:56:38.954350 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:56:38.954321    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e05689_6949_4826_88cb_123c6b461cdc.slice/crio-842294f6603b0c352528a265d661c4f1701ed19fc9fbd37df1b576ef333d4841 WatchSource:0}: Error finding container 842294f6603b0c352528a265d661c4f1701ed19fc9fbd37df1b576ef333d4841: Status 404 returned error can't find the container with id 842294f6603b0c352528a265d661c4f1701ed19fc9fbd37df1b576ef333d4841
Jul 02 19:56:39.931978 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:39.931943    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbf6495fb-kkhwp" event={"ID":"78e05689-6949-4826-88cb-123c6b461cdc","Type":"ContainerStarted","Data":"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"}
Jul 02 19:56:39.932398 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:39.931995    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbf6495fb-kkhwp" event={"ID":"78e05689-6949-4826-88cb-123c6b461cdc","Type":"ContainerStarted","Data":"842294f6603b0c352528a265d661c4f1701ed19fc9fbd37df1b576ef333d4841"}
Jul 02 19:56:39.948744 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:39.948696    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dbf6495fb-kkhwp" podStartSLOduration=1.94867883 podStartE2EDuration="1.94867883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:39.946879685 +0000 UTC m=+173.202957101" watchObservedRunningTime="2026-07-02 19:56:39.94867883 +0000 UTC m=+173.204756209"
Jul 02 19:56:48.826840 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:48.826794    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:48.827284 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:48.826870    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:48.831663 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:48.831641    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:48.971312 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:48.971284    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 19:56:49.017854 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:56:49.017817    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:57:14.037542 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.037497    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5dd4bccf7d-5wvtc" podUID="e86bd101-5016-409c-a0d9-4d8a541b291d" containerName="console" containerID="cri-o://53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036" gracePeriod=15
Jul 02 19:57:14.287801 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.287742    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:57:14.362552 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362521    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362566    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfmc2\" (UniqueName: \"kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362600    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362624    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362663    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362687    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.362728 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362710    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert\") pod \"e86bd101-5016-409c-a0d9-4d8a541b291d\" (UID: \"e86bd101-5016-409c-a0d9-4d8a541b291d\") "
Jul 02 19:57:14.363040 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.362915    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:57:14.363380 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.363349    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:57:14.363538 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.363508    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config" (OuterVolumeSpecName: "console-config") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:57:14.363820 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.363796    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:57:14.364892 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.364864    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:57:14.364892 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.364873    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2" (OuterVolumeSpecName: "kube-api-access-lfmc2") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "kube-api-access-lfmc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:57:14.365010 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.364924    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e86bd101-5016-409c-a0d9-4d8a541b291d" (UID: "e86bd101-5016-409c-a0d9-4d8a541b291d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:57:14.463820 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463789    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-oauth-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.463820 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463817    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-oauth-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.463820 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463826    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-trusted-ca-bundle\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.464038 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463836    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-console-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.464038 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463845    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86bd101-5016-409c-a0d9-4d8a541b291d-console-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.464038 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463853    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86bd101-5016-409c-a0d9-4d8a541b291d-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:14.464038 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:14.463861    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfmc2\" (UniqueName: \"kubernetes.io/projected/e86bd101-5016-409c-a0d9-4d8a541b291d-kube-api-access-lfmc2\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:57:15.059686 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.059651    2546 generic.go:356] "Generic (PLEG): container finished" podID="e86bd101-5016-409c-a0d9-4d8a541b291d" containerID="53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036" exitCode=0
Jul 02 19:57:15.060137 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.059693    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd4bccf7d-5wvtc"
Jul 02 19:57:15.060137 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.059732    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd4bccf7d-5wvtc" event={"ID":"e86bd101-5016-409c-a0d9-4d8a541b291d","Type":"ContainerDied","Data":"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"}
Jul 02 19:57:15.060137 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.059787    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd4bccf7d-5wvtc" event={"ID":"e86bd101-5016-409c-a0d9-4d8a541b291d","Type":"ContainerDied","Data":"65e2357a1b49046d1f734f8d53c6d00dcd90717a5e996fb83ccac43e86d97695"}
Jul 02 19:57:15.060137 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.059807    2546 scope.go:117] "RemoveContainer" containerID="53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"
Jul 02 19:57:15.068002 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.067985    2546 scope.go:117] "RemoveContainer" containerID="53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"
Jul 02 19:57:15.068285 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:57:15.068266    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036\": container with ID starting with 53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036 not found: ID does not exist" containerID="53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"
Jul 02 19:57:15.068354 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.068293    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036"} err="failed to get container status \"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036\": rpc error: code = NotFound desc = could not find container \"53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036\": container with ID starting with 53eaefe0c227cc0168bd8a50724a01e99a5666f9f0f8e7037f8012856d6da036 not found: ID does not exist"
Jul 02 19:57:15.079996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.079968    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:57:15.084021 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.083996    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dd4bccf7d-5wvtc"]
Jul 02 19:57:15.201152 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:15.201121    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e86bd101-5016-409c-a0d9-4d8a541b291d" path="/var/lib/kubelet/pods/e86bd101-5016-409c-a0d9-4d8a541b291d/volumes"
Jul 02 19:57:36.281247 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.281208    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"]
Jul 02 19:57:36.281650 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.281515    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e86bd101-5016-409c-a0d9-4d8a541b291d" containerName="console"
Jul 02 19:57:36.281650 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.281527    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e86bd101-5016-409c-a0d9-4d8a541b291d" containerName="console"
Jul 02 19:57:36.281650 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.281583    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e86bd101-5016-409c-a0d9-4d8a541b291d" containerName="console"
Jul 02 19:57:36.285808 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.285787    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.288263 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.288241    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:57:36.288387 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.288329    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 19:57:36.288460 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.288446    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bhfqx\""
Jul 02 19:57:36.296667 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.296644    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"]
Jul 02 19:57:36.427393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.427354    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hm6k\" (UniqueName: \"kubernetes.io/projected/cf4beacb-d920-4f5f-84e3-e35254bd9319-kube-api-access-5hm6k\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.427608 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.427432    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4beacb-d920-4f5f-84e3-e35254bd9319-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.528512 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.528453    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4beacb-d920-4f5f-84e3-e35254bd9319-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.528706 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.528540    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hm6k\" (UniqueName: \"kubernetes.io/projected/cf4beacb-d920-4f5f-84e3-e35254bd9319-kube-api-access-5hm6k\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.528856 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.528835    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4beacb-d920-4f5f-84e3-e35254bd9319-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.536929 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.536862    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hm6k\" (UniqueName: \"kubernetes.io/projected/cf4beacb-d920-4f5f-84e3-e35254bd9319-kube-api-access-5hm6k\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrqd5\" (UID: \"cf4beacb-d920-4f5f-84e3-e35254bd9319\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.594904 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.594854    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"
Jul 02 19:57:36.729400 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:36.729370    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5"]
Jul 02 19:57:36.733632 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:57:36.733602    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4beacb_d920_4f5f_84e3_e35254bd9319.slice/crio-402f7e269af3a5c037ca1cef27443c87349345001e35a7c6e28a83664edcc348 WatchSource:0}: Error finding container 402f7e269af3a5c037ca1cef27443c87349345001e35a7c6e28a83664edcc348: Status 404 returned error can't find the container with id 402f7e269af3a5c037ca1cef27443c87349345001e35a7c6e28a83664edcc348
Jul 02 19:57:37.137736 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:37.137696    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5" event={"ID":"cf4beacb-d920-4f5f-84e3-e35254bd9319","Type":"ContainerStarted","Data":"402f7e269af3a5c037ca1cef27443c87349345001e35a7c6e28a83664edcc348"}
Jul 02 19:57:40.153987 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:40.153944    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5" event={"ID":"cf4beacb-d920-4f5f-84e3-e35254bd9319","Type":"ContainerStarted","Data":"2375eca7559e2c23c2ad03da1f63a8cdf1132e85e2a7cae9a6e51cbd7df08928"}
Jul 02 19:57:40.176954 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:40.176901    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrqd5" podStartSLOduration=1.372415654 podStartE2EDuration="4.17688405s" totalImagesPullingTime="2.804468396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:40.175376152 +0000 UTC m=+233.431453530" watchObservedRunningTime="2026-07-02 19:57:40.17688405 +0000 UTC m=+233.432961427"
Jul 02 19:57:52.050705 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.050667    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f96k"]
Jul 02 19:57:52.055192 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.055171    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.057531 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.057505    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 19:57:52.057531 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.057506    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 19:57:52.057689 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.057529    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v27wj\""
Jul 02 19:57:52.063787 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.063762    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f96k"]
Jul 02 19:57:52.161764 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.161722    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.161764 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.161765    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pbh8\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-kube-api-access-4pbh8\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.262787 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.262744    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.262787 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.262793    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pbh8\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-kube-api-access-4pbh8\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.271698 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.271671    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.271878 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.271862    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pbh8\" (UniqueName: \"kubernetes.io/projected/8a39b924-e5c7-4398-850a-648faace7402-kube-api-access-4pbh8\") pod \"cert-manager-55b4d954d5-6f96k\" (UID: \"8a39b924-e5c7-4398-850a-648faace7402\") " pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.364411 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.364381    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6f96k"
Jul 02 19:57:52.496513 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:52.496480    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f96k"]
Jul 02 19:57:52.502240 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:57:52.502198    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a39b924_e5c7_4398_850a_648faace7402.slice/crio-0a7e880f6202612189b3258946c84e87902a83451acd7d69875f8744d4687331 WatchSource:0}: Error finding container 0a7e880f6202612189b3258946c84e87902a83451acd7d69875f8744d4687331: Status 404 returned error can't find the container with id 0a7e880f6202612189b3258946c84e87902a83451acd7d69875f8744d4687331
Jul 02 19:57:53.202750 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:53.202706    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6f96k" event={"ID":"8a39b924-e5c7-4398-850a-648faace7402","Type":"ContainerStarted","Data":"0a7e880f6202612189b3258946c84e87902a83451acd7d69875f8744d4687331"}
Jul 02 19:57:54.433689 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.433649    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"]
Jul 02 19:57:54.437206 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.437184    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.439482 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.439460    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:57:54.440371 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.440352    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-98qmj\""
Jul 02 19:57:54.440371 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.440354    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:57:54.445889 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.445788    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"]
Jul 02 19:57:54.477887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.477847    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8vt\" (UniqueName: \"kubernetes.io/projected/c33af0ce-1ea6-4378-811b-b019eae0f126-kube-api-access-ct8vt\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.478083 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.477944    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33af0ce-1ea6-4378-811b-b019eae0f126-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.579261 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.579216    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33af0ce-1ea6-4378-811b-b019eae0f126-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.579453 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.579297    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8vt\" (UniqueName: \"kubernetes.io/projected/c33af0ce-1ea6-4378-811b-b019eae0f126-kube-api-access-ct8vt\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.579620 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.579602    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33af0ce-1ea6-4378-811b-b019eae0f126-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.588274 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.588244    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8vt\" (UniqueName: \"kubernetes.io/projected/c33af0ce-1ea6-4378-811b-b019eae0f126-kube-api-access-ct8vt\") pod \"openshift-lws-operator-fd8ccff4c-p5xht\" (UID: \"c33af0ce-1ea6-4378-811b-b019eae0f126\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:54.749263 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:54.749184    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"
Jul 02 19:57:55.301876 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:55.301849    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht"]
Jul 02 19:57:55.304481 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:57:55.304457    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc33af0ce_1ea6_4378_811b_b019eae0f126.slice/crio-35a0740f4200cdc9b0c6a63c25eebcbf32f33070b4114b2af4941da3aa4c0515 WatchSource:0}: Error finding container 35a0740f4200cdc9b0c6a63c25eebcbf32f33070b4114b2af4941da3aa4c0515: Status 404 returned error can't find the container with id 35a0740f4200cdc9b0c6a63c25eebcbf32f33070b4114b2af4941da3aa4c0515
Jul 02 19:57:56.217644 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:56.217602    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6f96k" event={"ID":"8a39b924-e5c7-4398-850a-648faace7402","Type":"ContainerStarted","Data":"a4dc8379632e3751d75ce52221dc63330b16535af251c4cf6e99ff503f061f32"}
Jul 02 19:57:56.218979 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:56.218946    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht" event={"ID":"c33af0ce-1ea6-4378-811b-b019eae0f126","Type":"ContainerStarted","Data":"35a0740f4200cdc9b0c6a63c25eebcbf32f33070b4114b2af4941da3aa4c0515"}
Jul 02 19:57:56.232573 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:57:56.232523    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6f96k" podStartSLOduration=1.495703989 podStartE2EDuration="4.232502253s" totalImagesPullingTime="2.736798264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:56.231666173 +0000 UTC m=+249.487743567" watchObservedRunningTime="2026-07-02 19:57:56.232502253 +0000 UTC m=+249.488579636"
Jul 02 19:58:11.282877 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:11.282838    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht" event={"ID":"c33af0ce-1ea6-4378-811b-b019eae0f126","Type":"ContainerStarted","Data":"3f9d137cf29d91d144971eeb3c267e7340ed63998f77dd6d1592da99d743442c"}
Jul 02 19:58:11.300320 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:11.300250    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p5xht" podStartSLOduration=2.120616631 podStartE2EDuration="17.300234366s" totalImagesPullingTime="15.179617735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:11.299727104 +0000 UTC m=+264.555804500" watchObservedRunningTime="2026-07-02 19:58:11.300234366 +0000 UTC m=+264.556311746"
Jul 02 19:58:29.896358 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.896312    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"]
Jul 02 19:58:29.904434 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.904410    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:29.907795 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.907767    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:58:29.907795 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.907791    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:58:29.907996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.907863    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:58:29.907996 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.907893    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmrc8\""
Jul 02 19:58:29.908473 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.908454    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:58:29.924656 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.924632    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"]
Jul 02 19:58:29.972008 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.971974    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:29.972221 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.972019    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:29.972221 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.972038    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:29.972221 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.972134    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9dj\" (UniqueName: \"kubernetes.io/projected/d9b096e1-8c37-48bc-9c58-743b750aa8e9-kube-api-access-7s9dj\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:29.972221 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:29.972174    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.072730 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.072692    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.072730 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.072726    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.072952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.072748    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9dj\" (UniqueName: \"kubernetes.io/projected/d9b096e1-8c37-48bc-9c58-743b750aa8e9-kube-api-access-7s9dj\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.072952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.072774    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.072952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.072832    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.073162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.073140    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.075193 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.075163    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b096e1-8c37-48bc-9c58-743b750aa8e9-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.075324 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.075312    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.075383 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.075350    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b096e1-8c37-48bc-9c58-743b750aa8e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.091634 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.090653    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9dj\" (UniqueName: \"kubernetes.io/projected/d9b096e1-8c37-48bc-9c58-743b750aa8e9-kube-api-access-7s9dj\") pod \"opendatahub-operator-controller-manager-844d4f46fb-59z6m\" (UID: \"d9b096e1-8c37-48bc-9c58-743b750aa8e9\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.213950 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.213853    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:30.348722 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.348682    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"]
Jul 02 19:58:30.353020 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:30.352993    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b096e1_8c37_48bc_9c58_743b750aa8e9.slice/crio-30c7c401386c98ae3cfc0b258461ae4601d8ca0d11f2d506610e6f22d8cb2c2a WatchSource:0}: Error finding container 30c7c401386c98ae3cfc0b258461ae4601d8ca0d11f2d506610e6f22d8cb2c2a: Status 404 returned error can't find the container with id 30c7c401386c98ae3cfc0b258461ae4601d8ca0d11f2d506610e6f22d8cb2c2a
Jul 02 19:58:30.358624 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:30.358598    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m" event={"ID":"d9b096e1-8c37-48bc-9c58-743b750aa8e9","Type":"ContainerStarted","Data":"30c7c401386c98ae3cfc0b258461ae4601d8ca0d11f2d506610e6f22d8cb2c2a"}
Jul 02 19:58:33.373784 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:33.373757    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m" event={"ID":"d9b096e1-8c37-48bc-9c58-743b750aa8e9","Type":"ContainerStarted","Data":"e9cad02f677fb5ad5bc11a10c11393d2121be168a437da9e3350ed77ae7f3b86"}
Jul 02 19:58:35.384178 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:35.384143    2546 generic.go:356] "Generic (PLEG): container finished" podID="d9b096e1-8c37-48bc-9c58-743b750aa8e9" containerID="e9cad02f677fb5ad5bc11a10c11393d2121be168a437da9e3350ed77ae7f3b86" exitCode=0
Jul 02 19:58:35.384554 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:35.384180    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m" event={"ID":"d9b096e1-8c37-48bc-9c58-743b750aa8e9","Type":"ContainerDied","Data":"e9cad02f677fb5ad5bc11a10c11393d2121be168a437da9e3350ed77ae7f3b86"}
Jul 02 19:58:36.393995 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:36.393962    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m" event={"ID":"d9b096e1-8c37-48bc-9c58-743b750aa8e9","Type":"ContainerStarted","Data":"ac1f3e06310ebe2242d5624322e674946c4517a90d0e40a6dd22ecce19b142d9"}
Jul 02 19:58:36.394410 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:36.394222    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:47.071426 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:47.071393    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:58:47.075171 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:47.075142    2546 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:58:47.075622 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:47.075603    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 19:58:47.400942 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:47.400910    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m"
Jul 02 19:58:47.421815 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:47.421746    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-59z6m" podStartSLOduration=14.087307349 podStartE2EDuration="18.421729504s" totalImagesPullingTime="3.260369271s" totalInitContainerRuntime="1.074052884s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:36.414383291 +0000 UTC m=+289.670460692" watchObservedRunningTime="2026-07-02 19:58:47.421729504 +0000 UTC m=+300.677806882"
Jul 02 19:58:49.770435 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.770402    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"]
Jul 02 19:58:49.773543 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.773521    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.778162 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.778132    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:58:49.778912 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.778875    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:58:49.779039 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.779015    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jn846\""
Jul 02 19:58:49.779141 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.779090    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:58:49.779141 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.779025    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:58:49.794211 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.794178    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"]
Jul 02 19:58:49.836487 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.836455    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zzgf6"]
Jul 02 19:58:49.838230 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.838207    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a4e755-440f-465f-9b48-62cdcaeb8699-tmp\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.838365 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.838261    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a4e755-440f-465f-9b48-62cdcaeb8699-tls-certs\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.838365 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.838331    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6b7\" (UniqueName: \"kubernetes.io/projected/81a4e755-440f-465f-9b48-62cdcaeb8699-kube-api-access-jd6b7\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.839727 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.839713    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:49.842558 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.842539    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 19:58:49.842669 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.842611    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9tjzz\""
Jul 02 19:58:49.856452 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.856429    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zzgf6"]
Jul 02 19:58:49.938720 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.938690    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a4e755-440f-465f-9b48-62cdcaeb8699-tmp\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.938902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.938740    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a4e755-440f-465f-9b48-62cdcaeb8699-tls-certs\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.938902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.938776    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwc6n\" (UniqueName: \"kubernetes.io/projected/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-kube-api-access-hwc6n\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:49.938902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.938795    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-cert\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:49.938902 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.938813    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6b7\" (UniqueName: \"kubernetes.io/projected/81a4e755-440f-465f-9b48-62cdcaeb8699-kube-api-access-jd6b7\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.940813 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.940792    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a4e755-440f-465f-9b48-62cdcaeb8699-tmp\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.941155 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.941136    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a4e755-440f-465f-9b48-62cdcaeb8699-tls-certs\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:49.948825 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:49.948804    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6b7\" (UniqueName: \"kubernetes.io/projected/81a4e755-440f-465f-9b48-62cdcaeb8699-kube-api-access-jd6b7\") pod \"kube-auth-proxy-67b994b5d7-2kb6m\" (UID: \"81a4e755-440f-465f-9b48-62cdcaeb8699\") " pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:50.040100 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.039980    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwc6n\" (UniqueName: \"kubernetes.io/projected/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-kube-api-access-hwc6n\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:50.040100 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.040019    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-cert\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:50.042473 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.042452    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-cert\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:50.052309 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.052284    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwc6n\" (UniqueName: \"kubernetes.io/projected/7ca275ff-284f-4e11-bb0b-c95f6998d6dc-kube-api-access-hwc6n\") pod \"odh-model-controller-7998c67dc4-zzgf6\" (UID: \"7ca275ff-284f-4e11-bb0b-c95f6998d6dc\") " pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:50.083161 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.083121    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"
Jul 02 19:58:50.149571 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.149540    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:50.218612 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.218589    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m"]
Jul 02 19:58:50.221398 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:50.221370    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a4e755_440f_465f_9b48_62cdcaeb8699.slice/crio-1adf2db117cdab6d82f09f0531a147033544ce9ceb3dd5410b89accd23f74cad WatchSource:0}: Error finding container 1adf2db117cdab6d82f09f0531a147033544ce9ceb3dd5410b89accd23f74cad: Status 404 returned error can't find the container with id 1adf2db117cdab6d82f09f0531a147033544ce9ceb3dd5410b89accd23f74cad
Jul 02 19:58:50.223368 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.223347    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:58:50.285282 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.285253    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zzgf6"]
Jul 02 19:58:50.287673 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:50.287648    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca275ff_284f_4e11_bb0b_c95f6998d6dc.slice/crio-9afcb893bc6abfe53f15d0983ad9b4c0f7a38237d7ed28b8d5d87e9813de6aa2 WatchSource:0}: Error finding container 9afcb893bc6abfe53f15d0983ad9b4c0f7a38237d7ed28b8d5d87e9813de6aa2: Status 404 returned error can't find the container with id 9afcb893bc6abfe53f15d0983ad9b4c0f7a38237d7ed28b8d5d87e9813de6aa2
Jul 02 19:58:50.426779 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.426746    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zfrr6"]
Jul 02 19:58:50.431308 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.431290    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:50.434259 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.434238    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 19:58:50.442848 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.442825    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:50.442989 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.442873    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz67q\" (UniqueName: \"kubernetes.io/projected/28915fa1-8b6f-4950-a225-ca26b56f873f-kube-api-access-tz67q\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:50.444847 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.444824    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zfrr6"]
Jul 02 19:58:50.457962 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.457928    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m" event={"ID":"81a4e755-440f-465f-9b48-62cdcaeb8699","Type":"ContainerStarted","Data":"1adf2db117cdab6d82f09f0531a147033544ce9ceb3dd5410b89accd23f74cad"}
Jul 02 19:58:50.458961 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.458941    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6" event={"ID":"7ca275ff-284f-4e11-bb0b-c95f6998d6dc","Type":"ContainerStarted","Data":"9afcb893bc6abfe53f15d0983ad9b4c0f7a38237d7ed28b8d5d87e9813de6aa2"}
Jul 02 19:58:50.544119 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.543995    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:50.544119 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.544053    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz67q\" (UniqueName: \"kubernetes.io/projected/28915fa1-8b6f-4950-a225-ca26b56f873f-kube-api-access-tz67q\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:50.544355 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:58:50.544159    2546 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 02 19:58:50.544355 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:58:50.544225    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs podName:28915fa1-8b6f-4950-a225-ca26b56f873f nodeName:}" failed. No retries permitted until 2026-07-02 19:58:51.044208626 +0000 UTC m=+304.300285983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs") pod "model-serving-api-54d89bd5fc-zfrr6" (UID: "28915fa1-8b6f-4950-a225-ca26b56f873f") : secret "model-serving-api-tls" not found
Jul 02 19:58:50.553144 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:50.553108    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz67q\" (UniqueName: \"kubernetes.io/projected/28915fa1-8b6f-4950-a225-ca26b56f873f-kube-api-access-tz67q\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:51.046773 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.046731    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:51.049719 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.049651    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28915fa1-8b6f-4950-a225-ca26b56f873f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zfrr6\" (UID: \"28915fa1-8b6f-4950-a225-ca26b56f873f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:51.341761 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.341717    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:51.437008 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.436968    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:58:51.440736 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.440713    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.443793 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.443764    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 19:58:51.444024 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.444006    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:58:51.444244 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.444227    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 19:58:51.444432 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.444415    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-95sqn\""
Jul 02 19:58:51.444700 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.444681    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 19:58:51.450019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.449904    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.449940    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzmmd\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.449971    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450210 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.450039    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450210 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.450136    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450317 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.450207    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.450317 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.450231    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.455446 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.455421    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:58:51.515481 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.515453    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zfrr6"]
Jul 02 19:58:51.519187 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:51.519140    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28915fa1_8b6f_4950_a225_ca26b56f873f.slice/crio-15d6f0bdb6687e35725f671c03b52ca5764318f756221d91c905cde6ba881bb3 WatchSource:0}: Error finding container 15d6f0bdb6687e35725f671c03b52ca5764318f756221d91c905cde6ba881bb3: Status 404 returned error can't find the container with id 15d6f0bdb6687e35725f671c03b52ca5764318f756221d91c905cde6ba881bb3
Jul 02 19:58:51.550963 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.550915    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.550975    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551008    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551032    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551102    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551125    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzmmd\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.551207 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551150    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.552013 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.551984    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.553846 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.553801    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.553965 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.553946    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.554029 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.553973    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.554113 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.554026    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.560043 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.560001    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.560417 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.560382    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzmmd\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd\") pod \"istiod-openshift-gateway-7574459656-k268q\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.753929 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.753812    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:51.942381 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:51.942352    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:58:51.944792 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:51.944761    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba72e49_6c76_42d3_ab1b_2803597fa9d3.slice/crio-483cbb519d1df5a30d4020a9a7dd6df2a8f838ec71ac5e2010989c14da55ed0a WatchSource:0}: Error finding container 483cbb519d1df5a30d4020a9a7dd6df2a8f838ec71ac5e2010989c14da55ed0a: Status 404 returned error can't find the container with id 483cbb519d1df5a30d4020a9a7dd6df2a8f838ec71ac5e2010989c14da55ed0a
Jul 02 19:58:52.470420 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:52.470383    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" event={"ID":"7ba72e49-6c76-42d3-ab1b-2803597fa9d3","Type":"ContainerStarted","Data":"483cbb519d1df5a30d4020a9a7dd6df2a8f838ec71ac5e2010989c14da55ed0a"}
Jul 02 19:58:52.471585 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:52.471548    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6" event={"ID":"28915fa1-8b6f-4950-a225-ca26b56f873f","Type":"ContainerStarted","Data":"15d6f0bdb6687e35725f671c03b52ca5764318f756221d91c905cde6ba881bb3"}
Jul 02 19:58:55.540396 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:55.540355    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 19:58:55.540727 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:55.540458    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 19:58:56.495424 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.495375    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6" event={"ID":"7ca275ff-284f-4e11-bb0b-c95f6998d6dc","Type":"ContainerStarted","Data":"36fa7146e945917c84adad72d9076717a173716fbc5c4103165cbf6f274af6a6"}
Jul 02 19:58:56.496271 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.496242    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:58:56.498364 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.498302    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" event={"ID":"7ba72e49-6c76-42d3-ab1b-2803597fa9d3","Type":"ContainerStarted","Data":"c2e807437e5be2094bf1daeeb4dd40656e3bbc18885fb3e57659cdd87d44c1db"}
Jul 02 19:58:56.498529 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.498456    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:56.500159 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.500090    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6" event={"ID":"28915fa1-8b6f-4950-a225-ca26b56f873f","Type":"ContainerStarted","Data":"85cbe15bb0774016a9aaaa34e1ba67196a14d3fa635c76e72697df13a024739d"}
Jul 02 19:58:56.500159 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.500155    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:58:56.500678 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.500656    2546 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k268q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:58:56.500772 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.500699    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:58:56.501843 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.501823    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m" event={"ID":"81a4e755-440f-465f-9b48-62cdcaeb8699","Type":"ContainerStarted","Data":"acfab76a5c6423676cc319c2c9235d376739d1feb97e8f3e432a237ae12a859a"}
Jul 02 19:58:56.526616 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.526562    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6" podStartSLOduration=2.348043106 podStartE2EDuration="7.526543694s" totalImagesPullingTime="5.178500588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:56.526434725 +0000 UTC m=+309.782512125" watchObservedRunningTime="2026-07-02 19:58:56.526543694 +0000 UTC m=+309.782621071"
Jul 02 19:58:56.548088 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.548007    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67b994b5d7-2kb6m" podStartSLOduration=2.304007088 podStartE2EDuration="7.547990748s" totalImagesPullingTime="5.24398366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:56.54587728 +0000 UTC m=+309.801954659" watchObservedRunningTime="2026-07-02 19:58:56.547990748 +0000 UTC m=+309.804068158"
Jul 02 19:58:56.567414 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.567355    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6" podStartSLOduration=2.6168949550000002 podStartE2EDuration="6.567336536s" totalImagesPullingTime="3.950441581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:56.56511709 +0000 UTC m=+309.821194496" watchObservedRunningTime="2026-07-02 19:58:56.567336536 +0000 UTC m=+309.823413918"
Jul 02 19:58:56.587928 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:56.587876    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" podStartSLOduration=1.996337902 podStartE2EDuration="5.587858901s" totalImagesPullingTime="3.591520999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:56.585705601 +0000 UTC m=+309.841782979" watchObservedRunningTime="2026-07-02 19:58:56.587858901 +0000 UTC m=+309.843936280"
Jul 02 19:58:57.169685 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.169645    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"]
Jul 02 19:58:57.173004 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.172980    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.175688 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.175665    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kpg4q\""
Jul 02 19:58:57.185734 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.185708    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"]
Jul 02 19:58:57.201795 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201765    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.201964 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201814    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.201964 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201835    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.201964 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201918    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.202096 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201964    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.202096 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.201992    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.202096 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.202020    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.202191 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.202122    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.202191 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.202158    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rss6g\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-kube-api-access-rss6g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303055 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303022    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303268 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303097    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303268 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303218    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rss6g\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-kube-api-access-rss6g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303269    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303318    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303393 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303359    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303606 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303396    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303606 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303427    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303606 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303472    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303606 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303539    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303752 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303707    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303809 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303769    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303870 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303854    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.303922 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.303898    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.305779 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.305752    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.306111 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.306092    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.321321 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.321278    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.321470 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.321378    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rss6g\" (UniqueName: \"kubernetes.io/projected/f8b24f26-4aa4-466a-b0cc-626262ba06c6-kube-api-access-rss6g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zv5kb\" (UID: \"f8b24f26-4aa4-466a-b0cc-626262ba06c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.484019 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.483925    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:58:57.507154 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.507127    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:58:57.633266 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:57.633238    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"]
Jul 02 19:58:57.635826 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:58:57.635801    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b24f26_4aa4_466a_b0cc_626262ba06c6.slice/crio-1ada9a3d280bddd74b8d156b240c11d318b70ec6170a731a22f2a3f6bcc0aeaf WatchSource:0}: Error finding container 1ada9a3d280bddd74b8d156b240c11d318b70ec6170a731a22f2a3f6bcc0aeaf: Status 404 returned error can't find the container with id 1ada9a3d280bddd74b8d156b240c11d318b70ec6170a731a22f2a3f6bcc0aeaf
Jul 02 19:58:58.511778 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:58.511741    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb" event={"ID":"f8b24f26-4aa4-466a-b0cc-626262ba06c6","Type":"ContainerStarted","Data":"1ada9a3d280bddd74b8d156b240c11d318b70ec6170a731a22f2a3f6bcc0aeaf"}
Jul 02 19:58:59.886675 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.886634    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"]
Jul 02 19:58:59.897232 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.897202    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:58:59.899817 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.899791    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 19:58:59.899968 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.899896    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cp5dq\""
Jul 02 19:58:59.900102 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.900082    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"]
Jul 02 19:58:59.905048 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.905014    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"]
Jul 02 19:58:59.905224 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.905202    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:58:59.907504 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.907483    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 19:58:59.907664 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.907644    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g9j8h\""
Jul 02 19:58:59.914434 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.914410    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"]
Jul 02 19:58:59.930780 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.930750    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a01346-8bf0-47b3-ad90-d727e9676844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:58:59.930946 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.930796    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88f4t\" (UniqueName: \"kubernetes.io/projected/9f9e3147-47d6-4efc-b46d-9991dedda550-kube-api-access-88f4t\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:58:59.930946 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.930827    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f9e3147-47d6-4efc-b46d-9991dedda550-cert\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:58:59.930946 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.930933    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzg7\" (UniqueName: \"kubernetes.io/projected/81a01346-8bf0-47b3-ad90-d727e9676844-kube-api-access-wmzg7\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:58:59.987179 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.987136    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 19:58:59.987285 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.987213    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 19:58:59.987285 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:58:59.987261    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 19:59:00.032033 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.032002    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a01346-8bf0-47b3-ad90-d727e9676844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:00.032202 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.032051    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88f4t\" (UniqueName: \"kubernetes.io/projected/9f9e3147-47d6-4efc-b46d-9991dedda550-kube-api-access-88f4t\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:00.032202 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.032167    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f9e3147-47d6-4efc-b46d-9991dedda550-cert\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:00.032316 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.032265    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzg7\" (UniqueName: \"kubernetes.io/projected/81a01346-8bf0-47b3-ad90-d727e9676844-kube-api-access-wmzg7\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:00.034513 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.034484    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a01346-8bf0-47b3-ad90-d727e9676844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:00.034619 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.034496    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f9e3147-47d6-4efc-b46d-9991dedda550-cert\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:00.046886 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.046859    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88f4t\" (UniqueName: \"kubernetes.io/projected/9f9e3147-47d6-4efc-b46d-9991dedda550-kube-api-access-88f4t\") pod \"kserve-controller-manager-d6f4b65b8-gsxzv\" (UID: \"9f9e3147-47d6-4efc-b46d-9991dedda550\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:00.050187 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.050159    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzg7\" (UniqueName: \"kubernetes.io/projected/81a01346-8bf0-47b3-ad90-d727e9676844-kube-api-access-wmzg7\") pod \"llmisvc-controller-manager-777c6bd7d5-488ff\" (UID: \"81a01346-8bf0-47b3-ad90-d727e9676844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:00.210187 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.210089    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:00.219422 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.219390    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:00.363111 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.363080    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"]
Jul 02 19:59:00.366161 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:59:00.366130    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9e3147_47d6_4efc_b46d_9991dedda550.slice/crio-a8e51217fca3ea9ba8c96136a62650c8ab2080c99ef2778819210a35bd1706cc WatchSource:0}: Error finding container a8e51217fca3ea9ba8c96136a62650c8ab2080c99ef2778819210a35bd1706cc: Status 404 returned error can't find the container with id a8e51217fca3ea9ba8c96136a62650c8ab2080c99ef2778819210a35bd1706cc
Jul 02 19:59:00.386143 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.386112    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"]
Jul 02 19:59:00.389538 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:59:00.389510    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81a01346_8bf0_47b3_ad90_d727e9676844.slice/crio-c87017ebff573d0f14579e3f58166d044fd628d464703f1f178c5d7e65329287 WatchSource:0}: Error finding container c87017ebff573d0f14579e3f58166d044fd628d464703f1f178c5d7e65329287: Status 404 returned error can't find the container with id c87017ebff573d0f14579e3f58166d044fd628d464703f1f178c5d7e65329287
Jul 02 19:59:00.521623 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.521519    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb" event={"ID":"f8b24f26-4aa4-466a-b0cc-626262ba06c6","Type":"ContainerStarted","Data":"9747d5ec0d48d941381b12d16fe1413f4023687a197eae9a04d3c95de1e19fce"}
Jul 02 19:59:00.522769 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.522743    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff" event={"ID":"81a01346-8bf0-47b3-ad90-d727e9676844","Type":"ContainerStarted","Data":"c87017ebff573d0f14579e3f58166d044fd628d464703f1f178c5d7e65329287"}
Jul 02 19:59:00.523805 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.523780    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv" event={"ID":"9f9e3147-47d6-4efc-b46d-9991dedda550","Type":"ContainerStarted","Data":"a8e51217fca3ea9ba8c96136a62650c8ab2080c99ef2778819210a35bd1706cc"}
Jul 02 19:59:00.554864 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:00.554809    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb" podStartSLOduration=1.205848781 podStartE2EDuration="3.554791348s" totalImagesPullingTime="2.348942567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:00.553484197 +0000 UTC m=+313.809561576" watchObservedRunningTime="2026-07-02 19:59:00.554791348 +0000 UTC m=+313.810868728"
Jul 02 19:59:01.260126 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.260071    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:59:01.260620 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.260345    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerName="discovery" containerID="cri-o://c2e807437e5be2094bf1daeeb4dd40656e3bbc18885fb3e57659cdd87d44c1db" gracePeriod=30
Jul 02 19:59:01.484687 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.484651    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:59:01.490593 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.490563    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:59:01.532965 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.532813    2546 generic.go:356] "Generic (PLEG): container finished" podID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerID="c2e807437e5be2094bf1daeeb4dd40656e3bbc18885fb3e57659cdd87d44c1db" exitCode=0
Jul 02 19:59:01.532965 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.532852    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" event={"ID":"7ba72e49-6c76-42d3-ab1b-2803597fa9d3","Type":"ContainerDied","Data":"c2e807437e5be2094bf1daeeb4dd40656e3bbc18885fb3e57659cdd87d44c1db"}
Jul 02 19:59:01.533195 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.533094    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:59:01.534484 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.534445    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zv5kb"
Jul 02 19:59:01.711879 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.711816    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:59:01.749306 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749271    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749344    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749368    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749392    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749493 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749425    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzmmd\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749692 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749552    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749692 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749606    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs\") pod \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\" (UID: \"7ba72e49-6c76-42d3-ab1b-2803597fa9d3\") "
Jul 02 19:59:01.749832 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749806    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:59:01.749930 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.749905    2546 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-ca-configmap\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.752453 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.752421    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:59:01.752578 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.752471    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts" (OuterVolumeSpecName: "cacerts") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:59:01.752692 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.752638    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:01.752928 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.752883    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs" (OuterVolumeSpecName: "local-certs") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:59:01.753089 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.753043    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:59:01.753184 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.753167    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd" (OuterVolumeSpecName: "kube-api-access-bzmmd") pod "7ba72e49-6c76-42d3-ab1b-2803597fa9d3" (UID: "7ba72e49-6c76-42d3-ab1b-2803597fa9d3"). InnerVolumeSpecName "kube-api-access-bzmmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:01.850887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850856    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.850887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850887    2546 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-csr-dns-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.850887 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850897    2546 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-istio-kubeconfig\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.851309 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850906    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzmmd\" (UniqueName: \"kubernetes.io/projected/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-kube-api-access-bzmmd\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.851309 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850915    2546 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-cacerts\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:01.851309 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:01.850925    2546 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba72e49-6c76-42d3-ab1b-2803597fa9d3-local-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:02.540040 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:02.540008    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q"
Jul 02 19:59:02.540557 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:02.540048    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k268q" event={"ID":"7ba72e49-6c76-42d3-ab1b-2803597fa9d3","Type":"ContainerDied","Data":"483cbb519d1df5a30d4020a9a7dd6df2a8f838ec71ac5e2010989c14da55ed0a"}
Jul 02 19:59:02.540557 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:02.540135    2546 scope.go:117] "RemoveContainer" containerID="c2e807437e5be2094bf1daeeb4dd40656e3bbc18885fb3e57659cdd87d44c1db"
Jul 02 19:59:02.565298 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:02.565269    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:59:02.569198 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:02.569170    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k268q"]
Jul 02 19:59:03.203271 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:03.203156    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" path="/var/lib/kubelet/pods/7ba72e49-6c76-42d3-ab1b-2803597fa9d3/volumes"
Jul 02 19:59:04.551415 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.551379    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv" event={"ID":"9f9e3147-47d6-4efc-b46d-9991dedda550","Type":"ContainerStarted","Data":"27f3d7b18c0d6e044dbe4ff33ae6a0683ea6eb39280a2872e6ebbb5a7b68349c"}
Jul 02 19:59:04.551978 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.551439    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:04.552837 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.552815    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff" event={"ID":"81a01346-8bf0-47b3-ad90-d727e9676844","Type":"ContainerStarted","Data":"f8da5a575133fafbabeb98c8f6076eafb8d3ccf9216ae1ea83448a31b802a64b"}
Jul 02 19:59:04.552973 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.552959    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:04.565785 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.565616    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv" podStartSLOduration=2.445046761 podStartE2EDuration="5.565598706s" totalImagesPullingTime="3.120551945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:04.565413888 +0000 UTC m=+317.821491277" watchObservedRunningTime="2026-07-02 19:59:04.565598706 +0000 UTC m=+317.821676085"
Jul 02 19:59:04.582708 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:04.582661    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff" podStartSLOduration=2.480913705 podStartE2EDuration="5.582647525s" totalImagesPullingTime="3.10173382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:04.581301723 +0000 UTC m=+317.837379098" watchObservedRunningTime="2026-07-02 19:59:04.582647525 +0000 UTC m=+317.838724902"
Jul 02 19:59:07.510777 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:07.510747    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zfrr6"
Jul 02 19:59:08.513742 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:08.513714    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zzgf6"
Jul 02 19:59:35.560337 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:35.560305    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-488ff"
Jul 02 19:59:35.563499 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:35.563475    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gsxzv"
Jul 02 19:59:50.604343 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.604305    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:50.604861 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.604841    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerName="discovery"
Jul 02 19:59:50.604932 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.604865    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerName="discovery"
Jul 02 19:59:50.604983 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.604970    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba72e49-6c76-42d3-ab1b-2803597fa9d3" containerName="discovery"
Jul 02 19:59:50.609123 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.609101    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:50.611707 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.611679    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:59:50.611839 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.611679    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:59:50.612388 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.612368    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rlpcv\""
Jul 02 19:59:50.619420 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.619391    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:50.668109 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.668045    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p896\" (UniqueName: \"kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896\") pod \"kuadrant-operator-catalog-95vlv\" (UID: \"808b8281-4867-47ca-ae76-eca0b169b614\") " pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:50.768993 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.768957    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p896\" (UniqueName: \"kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896\") pod \"kuadrant-operator-catalog-95vlv\" (UID: \"808b8281-4867-47ca-ae76-eca0b169b614\") " pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:50.789791 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.789765    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p896\" (UniqueName: \"kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896\") pod \"kuadrant-operator-catalog-95vlv\" (UID: \"808b8281-4867-47ca-ae76-eca0b169b614\") " pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:50.920952 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:50.920847    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:51.053963 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.053940    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:51.056027 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:59:51.055998    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808b8281_4867_47ca_ae76_eca0b169b614.slice/crio-4c26312104e8ac6db671829be254fdc3018d71a8ca029f26efc7fe5a7cae410c WatchSource:0}: Error finding container 4c26312104e8ac6db671829be254fdc3018d71a8ca029f26efc7fe5a7cae410c: Status 404 returned error can't find the container with id 4c26312104e8ac6db671829be254fdc3018d71a8ca029f26efc7fe5a7cae410c
Jul 02 19:59:51.183110 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.183011    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:51.202083 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.202038    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kr969"]
Jul 02 19:59:51.206448 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.206430    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 19:59:51.212893 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.212853    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kr969"]
Jul 02 19:59:51.273423 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.273381    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jnc\" (UniqueName: \"kubernetes.io/projected/43aeca53-fa39-4d06-94f0-47a1e333d692-kube-api-access-z7jnc\") pod \"kuadrant-operator-catalog-kr969\" (UID: \"43aeca53-fa39-4d06-94f0-47a1e333d692\") " pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 19:59:51.374675 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.374586    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jnc\" (UniqueName: \"kubernetes.io/projected/43aeca53-fa39-4d06-94f0-47a1e333d692-kube-api-access-z7jnc\") pod \"kuadrant-operator-catalog-kr969\" (UID: \"43aeca53-fa39-4d06-94f0-47a1e333d692\") " pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 19:59:51.383768 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.383735    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jnc\" (UniqueName: \"kubernetes.io/projected/43aeca53-fa39-4d06-94f0-47a1e333d692-kube-api-access-z7jnc\") pod \"kuadrant-operator-catalog-kr969\" (UID: \"43aeca53-fa39-4d06-94f0-47a1e333d692\") " pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 19:59:51.517120 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.517012    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 19:59:51.658663 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.658570    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kr969"]
Jul 02 19:59:51.664307 ip-10-0-142-141 kubenswrapper[2546]: W0702 19:59:51.663139    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43aeca53_fa39_4d06_94f0_47a1e333d692.slice/crio-0758b952d2044dd48aaf2662ce9daa783d94cbd0208d1277ff5be555974bc990 WatchSource:0}: Error finding container 0758b952d2044dd48aaf2662ce9daa783d94cbd0208d1277ff5be555974bc990: Status 404 returned error can't find the container with id 0758b952d2044dd48aaf2662ce9daa783d94cbd0208d1277ff5be555974bc990
Jul 02 19:59:51.762752 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.762711    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kr969" event={"ID":"43aeca53-fa39-4d06-94f0-47a1e333d692","Type":"ContainerStarted","Data":"0758b952d2044dd48aaf2662ce9daa783d94cbd0208d1277ff5be555974bc990"}
Jul 02 19:59:51.763784 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:51.763759    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" event={"ID":"808b8281-4867-47ca-ae76-eca0b169b614","Type":"ContainerStarted","Data":"4c26312104e8ac6db671829be254fdc3018d71a8ca029f26efc7fe5a7cae410c"}
Jul 02 19:59:53.775116 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:53.775053    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kr969" event={"ID":"43aeca53-fa39-4d06-94f0-47a1e333d692","Type":"ContainerStarted","Data":"f14c70fc607e2f3ebbc0683c1963207b64b9b8d71252253266e91e5b8109ba1f"}
Jul 02 19:59:53.776567 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:53.776532    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" event={"ID":"808b8281-4867-47ca-ae76-eca0b169b614","Type":"ContainerStarted","Data":"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"}
Jul 02 19:59:53.776687 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:53.776603    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" podUID="808b8281-4867-47ca-ae76-eca0b169b614" containerName="registry-server" containerID="cri-o://0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812" gracePeriod=2
Jul 02 19:59:53.791615 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:53.791567    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kr969" podStartSLOduration=1.335777937 podStartE2EDuration="2.791548561s" totalImagesPullingTime="1.455770624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:53.789073651 +0000 UTC m=+367.045151041" watchObservedRunningTime="2026-07-02 19:59:53.791548561 +0000 UTC m=+367.047625942"
Jul 02 19:59:53.804124 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:53.804075    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" podStartSLOduration=1.741680957 podStartE2EDuration="3.804043035s" totalImagesPullingTime="2.062362078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:53.803133006 +0000 UTC m=+367.059210411" watchObservedRunningTime="2026-07-02 19:59:53.804043035 +0000 UTC m=+367.060120414"
Jul 02 19:59:54.025861 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.025803    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:54.098723 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.098685    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p896\" (UniqueName: \"kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896\") pod \"808b8281-4867-47ca-ae76-eca0b169b614\" (UID: \"808b8281-4867-47ca-ae76-eca0b169b614\") "
Jul 02 19:59:54.100910 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.100882    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896" (OuterVolumeSpecName: "kube-api-access-5p896") pod "808b8281-4867-47ca-ae76-eca0b169b614" (UID: "808b8281-4867-47ca-ae76-eca0b169b614"). InnerVolumeSpecName "kube-api-access-5p896". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:54.199579 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.199542    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p896\" (UniqueName: \"kubernetes.io/projected/808b8281-4867-47ca-ae76-eca0b169b614-kube-api-access-5p896\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 19:59:54.781873 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.781835    2546 generic.go:356] "Generic (PLEG): container finished" podID="808b8281-4867-47ca-ae76-eca0b169b614" containerID="0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812" exitCode=0
Jul 02 19:59:54.782369 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.781882    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-95vlv"
Jul 02 19:59:54.782369 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.781930    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" event={"ID":"808b8281-4867-47ca-ae76-eca0b169b614","Type":"ContainerDied","Data":"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"}
Jul 02 19:59:54.782369 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.781993    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-95vlv" event={"ID":"808b8281-4867-47ca-ae76-eca0b169b614","Type":"ContainerDied","Data":"4c26312104e8ac6db671829be254fdc3018d71a8ca029f26efc7fe5a7cae410c"}
Jul 02 19:59:54.782369 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.782025    2546 scope.go:117] "RemoveContainer" containerID="0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"
Jul 02 19:59:54.791367 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.791349    2546 scope.go:117] "RemoveContainer" containerID="0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"
Jul 02 19:59:54.791609 ip-10-0-142-141 kubenswrapper[2546]: E0702 19:59:54.791594    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812\": container with ID starting with 0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812 not found: ID does not exist" containerID="0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"
Jul 02 19:59:54.791649 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.791620    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812"} err="failed to get container status \"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812\": rpc error: code = NotFound desc = could not find container \"0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812\": container with ID starting with 0347da450295a884558efbf8faf10fddc8b5162bf1799acb29fafe44ffd0d812 not found: ID does not exist"
Jul 02 19:59:54.803028 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.803001    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:54.806587 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:54.806564    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-95vlv"]
Jul 02 19:59:55.202525 ip-10-0-142-141 kubenswrapper[2546]: I0702 19:59:55.202485    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="808b8281-4867-47ca-ae76-eca0b169b614" path="/var/lib/kubelet/pods/808b8281-4867-47ca-ae76-eca0b169b614/volumes"
Jul 02 20:00:01.518134 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:01.518100    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 20:00:01.518567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:01.518334    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 20:00:01.541403 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:01.541373    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 20:00:01.834097 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:01.834068    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kr969"
Jul 02 20:00:17.511896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.511861    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"]
Jul 02 20:00:17.512404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.512220    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808b8281-4867-47ca-ae76-eca0b169b614" containerName="registry-server"
Jul 02 20:00:17.512404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.512236    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="808b8281-4867-47ca-ae76-eca0b169b614" containerName="registry-server"
Jul 02 20:00:17.512404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.512287    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="808b8281-4867-47ca-ae76-eca0b169b614" containerName="registry-server"
Jul 02 20:00:17.515195 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.515178    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:17.517410 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.517387    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sdtpp\""
Jul 02 20:00:17.527158 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.527130    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"]
Jul 02 20:00:17.601400 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.601368    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvz4s\" (UniqueName: \"kubernetes.io/projected/3379cfec-a1de-4ccf-82e6-0099cc5cdd82-kube-api-access-wvz4s\") pod \"authorino-operator-75cc8d5cb7-9jr99\" (UID: \"3379cfec-a1de-4ccf-82e6-0099cc5cdd82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:17.702084 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.702017    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvz4s\" (UniqueName: \"kubernetes.io/projected/3379cfec-a1de-4ccf-82e6-0099cc5cdd82-kube-api-access-wvz4s\") pod \"authorino-operator-75cc8d5cb7-9jr99\" (UID: \"3379cfec-a1de-4ccf-82e6-0099cc5cdd82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:17.711304 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.711274    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvz4s\" (UniqueName: \"kubernetes.io/projected/3379cfec-a1de-4ccf-82e6-0099cc5cdd82-kube-api-access-wvz4s\") pod \"authorino-operator-75cc8d5cb7-9jr99\" (UID: \"3379cfec-a1de-4ccf-82e6-0099cc5cdd82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:17.825133 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.825098    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:17.963324 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:17.963294    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"]
Jul 02 20:00:17.965077 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:17.965038    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3379cfec_a1de_4ccf_82e6_0099cc5cdd82.slice/crio-7cf476c7fb49e3cf2c33f00cf1d0a720627ef1925457ecd2c6a6fe597396da8b WatchSource:0}: Error finding container 7cf476c7fb49e3cf2c33f00cf1d0a720627ef1925457ecd2c6a6fe597396da8b: Status 404 returned error can't find the container with id 7cf476c7fb49e3cf2c33f00cf1d0a720627ef1925457ecd2c6a6fe597396da8b
Jul 02 20:00:18.886925 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:18.886885    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99" event={"ID":"3379cfec-a1de-4ccf-82e6-0099cc5cdd82","Type":"ContainerStarted","Data":"7cf476c7fb49e3cf2c33f00cf1d0a720627ef1925457ecd2c6a6fe597396da8b"}
Jul 02 20:00:20.901142 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.901101    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99" event={"ID":"3379cfec-a1de-4ccf-82e6-0099cc5cdd82","Type":"ContainerStarted","Data":"a9f3578b79be1707df4da6ce10c407b682a2be09c6e877f0c2bbf8c253158751"}
Jul 02 20:00:20.901522 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.901214    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:20.922390 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.922334    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99" podStartSLOduration=1.782677128 podStartE2EDuration="3.922316714s" totalImagesPullingTime="2.139639586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:20.922265096 +0000 UTC m=+394.178342497" watchObservedRunningTime="2026-07-02 20:00:20.922316714 +0000 UTC m=+394.178394156"
Jul 02 20:00:20.938836 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.938804    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"]
Jul 02 20:00:20.942207 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.942188    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:20.944678 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.944657    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8drjw\""
Jul 02 20:00:20.954298 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:20.954273    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"]
Jul 02 20:00:21.132854 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.132811    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd28d\" (UniqueName: \"kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d\") pod \"limitador-operator-controller-manager-859d7b78bd-s45j8\" (UID: \"07534c06-231e-4f05-9ea5-38546225eee1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:21.228268 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.228191    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6749958675-krfhd"]
Jul 02 20:00:21.231497 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.231480    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.233305 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.233278    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd28d\" (UniqueName: \"kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d\") pod \"limitador-operator-controller-manager-859d7b78bd-s45j8\" (UID: \"07534c06-231e-4f05-9ea5-38546225eee1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:21.244533 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.244505    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6749958675-krfhd"]
Jul 02 20:00:21.250519 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.250491    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd28d\" (UniqueName: \"kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d\") pod \"limitador-operator-controller-manager-859d7b78bd-s45j8\" (UID: \"07534c06-231e-4f05-9ea5-38546225eee1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:21.252010 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.251977    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:21.334017 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.333986    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-oauth-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334017 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334021    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-trusted-ca-bundle\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334255 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334159    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-service-ca\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334255 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334209    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-oauth-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334255 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334233    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334346 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334286    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kchk\" (UniqueName: \"kubernetes.io/projected/fe4068b0-f4e2-49cc-a082-4a741a9c4298-kube-api-access-7kchk\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.334346 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.334308    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.394200 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.394174    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"]
Jul 02 20:00:21.396583 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:21.396551    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07534c06_231e_4f05_9ea5_38546225eee1.slice/crio-ab70f47812adbce73a95c5951ffd6cc939f5fbb20c73739b50a208cf735e25fa WatchSource:0}: Error finding container ab70f47812adbce73a95c5951ffd6cc939f5fbb20c73739b50a208cf735e25fa: Status 404 returned error can't find the container with id ab70f47812adbce73a95c5951ffd6cc939f5fbb20c73739b50a208cf735e25fa
Jul 02 20:00:21.435216 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435176    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kchk\" (UniqueName: \"kubernetes.io/projected/fe4068b0-f4e2-49cc-a082-4a741a9c4298-kube-api-access-7kchk\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435216 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435217    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435251    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-oauth-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435269    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-trusted-ca-bundle\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435404    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-service-ca\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435444    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-oauth-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.435646 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.435478    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.436193 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.436164    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-oauth-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.436313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.436246    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-service-ca\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.436408 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.436391    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-trusted-ca-bundle\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.436471 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.436388    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.437806 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.437790    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-serving-cert\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.437874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.437809    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe4068b0-f4e2-49cc-a082-4a741a9c4298-console-oauth-config\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.443117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.443095    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kchk\" (UniqueName: \"kubernetes.io/projected/fe4068b0-f4e2-49cc-a082-4a741a9c4298-kube-api-access-7kchk\") pod \"console-6749958675-krfhd\" (UID: \"fe4068b0-f4e2-49cc-a082-4a741a9c4298\") " pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.541091 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.541010    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:21.687023 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.686998    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6749958675-krfhd"]
Jul 02 20:00:21.689002 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:21.688964    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4068b0_f4e2_49cc_a082_4a741a9c4298.slice/crio-91c1b3254a2f16740c28c6ef0f9a951835354c6efca97991fabddb0d82a94d49 WatchSource:0}: Error finding container 91c1b3254a2f16740c28c6ef0f9a951835354c6efca97991fabddb0d82a94d49: Status 404 returned error can't find the container with id 91c1b3254a2f16740c28c6ef0f9a951835354c6efca97991fabddb0d82a94d49
Jul 02 20:00:21.915193 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.915143    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6749958675-krfhd" event={"ID":"fe4068b0-f4e2-49cc-a082-4a741a9c4298","Type":"ContainerStarted","Data":"a60610280230beea0e142745d244b09b1c2e1c2bdcc16ede9c7572c096cd1d4f"}
Jul 02 20:00:21.915657 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.915281    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6749958675-krfhd" event={"ID":"fe4068b0-f4e2-49cc-a082-4a741a9c4298","Type":"ContainerStarted","Data":"91c1b3254a2f16740c28c6ef0f9a951835354c6efca97991fabddb0d82a94d49"}
Jul 02 20:00:21.918573 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.918542    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8" event={"ID":"07534c06-231e-4f05-9ea5-38546225eee1","Type":"ContainerStarted","Data":"ab70f47812adbce73a95c5951ffd6cc939f5fbb20c73739b50a208cf735e25fa"}
Jul 02 20:00:21.939340 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:21.939285    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6749958675-krfhd" podStartSLOduration=0.939267761 podStartE2EDuration="939.267761ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:21.937240206 +0000 UTC m=+395.193317613" watchObservedRunningTime="2026-07-02 20:00:21.939267761 +0000 UTC m=+395.195345139"
Jul 02 20:00:23.931940 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:23.931903    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8" event={"ID":"07534c06-231e-4f05-9ea5-38546225eee1","Type":"ContainerStarted","Data":"324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1"}
Jul 02 20:00:23.932415 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:23.932041    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:23.954436 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:23.954384    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8" podStartSLOduration=2.131849615 podStartE2EDuration="3.954365464s" totalImagesPullingTime="1.822515849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:23.952627535 +0000 UTC m=+397.208704928" watchObservedRunningTime="2026-07-02 20:00:23.954365464 +0000 UTC m=+397.210442841"
Jul 02 20:00:25.808549 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.808515    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"]
Jul 02 20:00:25.816788 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.816759    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:25.820786 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.820761    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzpwx\""
Jul 02 20:00:25.831402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.831363    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"]
Jul 02 20:00:25.976319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.976277    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbgp\" (UniqueName: \"kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:25.976508 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:25.976334    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.077801 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.077761    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbgp\" (UniqueName: \"kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.077979 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.077824    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.078210 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.078189    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.097673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.097647    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbgp\" (UniqueName: \"kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.127557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.127507    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:26.274102 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.274053    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"]
Jul 02 20:00:26.276727 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:26.276701    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31aa04df_5508_4fe0_8afd_f2d184f60432.slice/crio-5045e889e2fe93a6546623e580143054768520160ae67d63a43c2166596fd021 WatchSource:0}: Error finding container 5045e889e2fe93a6546623e580143054768520160ae67d63a43c2166596fd021: Status 404 returned error can't find the container with id 5045e889e2fe93a6546623e580143054768520160ae67d63a43c2166596fd021
Jul 02 20:00:26.947909 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:26.947874    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7" event={"ID":"31aa04df-5508-4fe0-8afd-f2d184f60432","Type":"ContainerStarted","Data":"5045e889e2fe93a6546623e580143054768520160ae67d63a43c2166596fd021"}
Jul 02 20:00:31.542126 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:31.542088    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:31.542575 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:31.542160    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:31.547980 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:31.547942    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:31.921923 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:31.921884    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jr99"
Jul 02 20:00:31.978299 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:31.978269    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6749958675-krfhd"
Jul 02 20:00:32.034793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:32.034765    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 20:00:32.980054 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:32.980001    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7" event={"ID":"31aa04df-5508-4fe0-8afd-f2d184f60432","Type":"ContainerStarted","Data":"253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a"}
Jul 02 20:00:32.980446 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:32.980106    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:33.004173 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:33.004120    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7" podStartSLOduration=1.767160925 podStartE2EDuration="8.004104242s" totalImagesPullingTime="6.236943317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:33.003325564 +0000 UTC m=+406.259402970" watchObservedRunningTime="2026-07-02 20:00:33.004104242 +0000 UTC m=+406.260181620"
Jul 02 20:00:34.939480 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:34.939445    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:43.987593 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:43.987561    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.025612 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.025578    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"]
Jul 02 20:00:46.026034 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.025775    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" containerName="manager" containerID="cri-o://253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a" gracePeriod=2
Jul 02 20:00:46.039807 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.039775    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"]
Jul 02 20:00:46.054611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.054579    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"]
Jul 02 20:00:46.054855 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.054817    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8" podUID="07534c06-231e-4f05-9ea5-38546225eee1" containerName="manager" containerID="cri-o://324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1" gracePeriod=2
Jul 02 20:00:46.057104 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.057079    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:00:46.057717 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.057698    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" containerName="manager"
Jul 02 20:00:46.058044 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.058028    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" containerName="manager"
Jul 02 20:00:46.058398 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.058368    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" containerName="manager"
Jul 02 20:00:46.061791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.061767    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"]
Jul 02 20:00:46.061955 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.061890    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.063583 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.063547    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.065409 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.065386    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.084729 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.084685    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:00:46.096442 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.096408    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"]
Jul 02 20:00:46.096964 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.096946    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07534c06-231e-4f05-9ea5-38546225eee1" containerName="manager"
Jul 02 20:00:46.097005 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.096969    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="07534c06-231e-4f05-9ea5-38546225eee1" containerName="manager"
Jul 02 20:00:46.097095 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.097081    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="07534c06-231e-4f05-9ea5-38546225eee1" containerName="manager"
Jul 02 20:00:46.100370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.100346    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:46.110985 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.110678    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:46.112720 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.112690    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:46.114649 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.114624    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"]
Jul 02 20:00:46.114649 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.114641    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.161178 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.161147    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69zl\" (UniqueName: \"kubernetes.io/projected/6b779277-6776-4aea-8fe8-7035aed8e2f4-kube-api-access-x69zl\") pod \"limitador-operator-controller-manager-859d7b78bd-9656w\" (UID: \"6b779277-6776-4aea-8fe8-7035aed8e2f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:46.161358 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.161193    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxjq\" (UniqueName: \"kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.161358 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.161218    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.262456 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.262417    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69zl\" (UniqueName: \"kubernetes.io/projected/6b779277-6776-4aea-8fe8-7035aed8e2f4-kube-api-access-x69zl\") pod \"limitador-operator-controller-manager-859d7b78bd-9656w\" (UID: \"6b779277-6776-4aea-8fe8-7035aed8e2f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:46.262666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.262474    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxjq\" (UniqueName: \"kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.262666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.262509    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.262969 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.262946    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.270831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.270803    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxjq\" (UniqueName: \"kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w8t2w\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.271035 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.270997    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69zl\" (UniqueName: \"kubernetes.io/projected/6b779277-6776-4aea-8fe8-7035aed8e2f4-kube-api-access-x69zl\") pod \"limitador-operator-controller-manager-859d7b78bd-9656w\" (UID: \"6b779277-6776-4aea-8fe8-7035aed8e2f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:46.300483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.300460    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.302879 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.302841    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:46.304569 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.304542    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.307221 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.307186    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:46.309011 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.308988    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:46.310765 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:46.310742    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:46.363421 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.363377    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sbgp\" (UniqueName: \"kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp\") pod \"31aa04df-5508-4fe0-8afd-f2d184f60432\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") "
Jul 02 20:00:46.363421 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.363430    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume\") pod \"31aa04df-5508-4fe0-8afd-f2d184f60432\" (UID: \"31aa04df-5508-4fe0-8afd-f2d184f60432\") "
Jul 02 20:00:46.363674 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.363510    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd28d\" (UniqueName: \"kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d\") pod \"07534c06-231e-4f05-9ea5-38546225eee1\" (UID: \"07534c06-231e-4f05-9ea5-38546225eee1\") "
Jul 02 20:00:46.363906 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.363879    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31aa04df-5508-4fe0-8afd-f2d184f60432" (UID: "31aa04df-5508-4fe0-8afd-f2d184f60432"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:00:46.365620 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.365598    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp" (OuterVolumeSpecName: "kube-api-access-6sbgp") pod "31aa04df-5508-4fe0-8afd-f2d184f60432" (UID: "31aa04df-5508-4fe0-8afd-f2d184f60432"). InnerVolumeSpecName "kube-api-access-6sbgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:00:46.365702 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.365616    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d" (OuterVolumeSpecName: "kube-api-access-pd28d") pod "07534c06-231e-4f05-9ea5-38546225eee1" (UID: "07534c06-231e-4f05-9ea5-38546225eee1"). InnerVolumeSpecName "kube-api-access-pd28d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:00:46.464962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.464931    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sbgp\" (UniqueName: \"kubernetes.io/projected/31aa04df-5508-4fe0-8afd-f2d184f60432-kube-api-access-6sbgp\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:46.464962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.464958    2546 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31aa04df-5508-4fe0-8afd-f2d184f60432-extensions-socket-volume\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:46.464962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.464967    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd28d\" (UniqueName: \"kubernetes.io/projected/07534c06-231e-4f05-9ea5-38546225eee1-kube-api-access-pd28d\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:46.476038 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.476007    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:46.483222 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.483192    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:46.645669 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.645632    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:00:46.648835 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:46.648802    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1616a298_ca68_47b6_a158_4cdbb9020cce.slice/crio-f96906be3182aadbe0620076f772dc14ba3d5cc0082d909fd8e2c51cdd8572ed WatchSource:0}: Error finding container f96906be3182aadbe0620076f772dc14ba3d5cc0082d909fd8e2c51cdd8572ed: Status 404 returned error can't find the container with id f96906be3182aadbe0620076f772dc14ba3d5cc0082d909fd8e2c51cdd8572ed
Jul 02 20:00:46.663187 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:46.663155    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"]
Jul 02 20:00:46.666227 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:00:46.666199    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b779277_6776_4aea_8fe8_7035aed8e2f4.slice/crio-4d70b82bc506fb55c43144bfa3be30379ff5516e66c3b3d379e39b88641b7964 WatchSource:0}: Error finding container 4d70b82bc506fb55c43144bfa3be30379ff5516e66c3b3d379e39b88641b7964: Status 404 returned error can't find the container with id 4d70b82bc506fb55c43144bfa3be30379ff5516e66c3b3d379e39b88641b7964
Jul 02 20:00:47.053634 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.053601    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w" event={"ID":"6b779277-6776-4aea-8fe8-7035aed8e2f4","Type":"ContainerStarted","Data":"0aead6b7529ed0824c5264541de4c5b327f812b51f80dc1369148659dbadc3de"}
Jul 02 20:00:47.054049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.053666    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w" event={"ID":"6b779277-6776-4aea-8fe8-7035aed8e2f4","Type":"ContainerStarted","Data":"4d70b82bc506fb55c43144bfa3be30379ff5516e66c3b3d379e39b88641b7964"}
Jul 02 20:00:47.054049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.053699    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:47.054900 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.054874    2546 generic.go:356] "Generic (PLEG): container finished" podID="07534c06-231e-4f05-9ea5-38546225eee1" containerID="324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1" exitCode=0
Jul 02 20:00:47.055002 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.054907    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:47.055002 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.054974    2546 scope.go:117] "RemoveContainer" containerID="324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1"
Jul 02 20:00:47.056260 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.056240    2546 generic.go:356] "Generic (PLEG): container finished" podID="31aa04df-5508-4fe0-8afd-f2d184f60432" containerID="253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a" exitCode=0
Jul 02 20:00:47.056336 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.056281    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:47.056923 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.056895    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:47.058192 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.058166    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" event={"ID":"1616a298-ca68-47b6-a158-4cdbb9020cce","Type":"ContainerStarted","Data":"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"}
Jul 02 20:00:47.058288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.058216    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" event={"ID":"1616a298-ca68-47b6-a158-4cdbb9020cce","Type":"ContainerStarted","Data":"f96906be3182aadbe0620076f772dc14ba3d5cc0082d909fd8e2c51cdd8572ed"}
Jul 02 20:00:47.058288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.058244    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:47.063924 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.063847    2546 scope.go:117] "RemoveContainer" containerID="324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1"
Jul 02 20:00:47.064220 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.064197    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1\": container with ID starting with 324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1 not found: ID does not exist" containerID="324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1"
Jul 02 20:00:47.064310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.064226    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1"} err="failed to get container status \"324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1\": rpc error: code = NotFound desc = could not find container \"324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1\": container with ID starting with 324ab7cb23ba05242b91c9057780c96baa64234fc55856ad86cbfc01e360b6b1 not found: ID does not exist"
Jul 02 20:00:47.064310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.064250    2546 scope.go:117] "RemoveContainer" containerID="253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a"
Jul 02 20:00:47.073005 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.072989    2546 scope.go:117] "RemoveContainer" containerID="253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a"
Jul 02 20:00:47.073273 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.073255    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a\": container with ID starting with 253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a not found: ID does not exist" containerID="253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a"
Jul 02 20:00:47.073333 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.073278    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a"} err="failed to get container status \"253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a\": rpc error: code = NotFound desc = could not find container \"253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a\": container with ID starting with 253a4be533bac8e691af66fdc0c678bd901d457e05e80cef1ea246fc4f95696a not found: ID does not exist"
Jul 02 20:00:47.101931 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.101874    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w" podStartSLOduration=1.101859879 podStartE2EDuration="1.101859879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:47.100606807 +0000 UTC m=+420.356684206" watchObservedRunningTime="2026-07-02 20:00:47.101859879 +0000 UTC m=+420.357937257"
Jul 02 20:00:47.102885 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.102854    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:47.105836 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.105811    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:47.110099 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.110075    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:47.177016 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.176939    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" podStartSLOduration=1.176922953 podStartE2EDuration="1.176922953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:47.176050941 +0000 UTC m=+420.432128320" watchObservedRunningTime="2026-07-02 20:00:47.176922953 +0000 UTC m=+420.433000333"
Jul 02 20:00:47.200945 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.200905    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s45j8\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="07534c06-231e-4f05-9ea5-38546225eee1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s45j8"
Jul 02 20:00:47.202824 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:47.202796    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7n4q7\" is forbidden: User \"system:node:ip-10-0-142-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-141.ec2.internal' and this object" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7n4q7"
Jul 02 20:00:47.202943 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.202924    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07534c06-231e-4f05-9ea5-38546225eee1" path="/var/lib/kubelet/pods/07534c06-231e-4f05-9ea5-38546225eee1/volumes"
Jul 02 20:00:47.203333 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:47.203320    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31aa04df-5508-4fe0-8afd-f2d184f60432" path="/var/lib/kubelet/pods/31aa04df-5508-4fe0-8afd-f2d184f60432/volumes"
Jul 02 20:00:57.058926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.058883    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dbf6495fb-kkhwp" podUID="78e05689-6949-4826-88cb-123c6b461cdc" containerName="console" containerID="cri-o://ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415" gracePeriod=15
Jul 02 20:00:57.310201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.310122    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 20:00:57.460915 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.460884    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461124 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.460937    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461124 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.460958    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461208 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461119    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk9pv\" (UniqueName: \"kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461208 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461190    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461308 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461221    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461308 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461246    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert\") pod \"78e05689-6949-4826-88cb-123c6b461cdc\" (UID: \"78e05689-6949-4826-88cb-123c6b461cdc\") "
Jul 02 20:00:57.461420 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461389    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:00:57.461597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461480    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config" (OuterVolumeSpecName: "console-config") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:00:57.461597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461564    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-console-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.461597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461591    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-oauth-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.461597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461564    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca" (OuterVolumeSpecName: "service-ca") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:00:57.461817 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.461592    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:00:57.463198 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.463172    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:00:57.463303 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.463240    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv" (OuterVolumeSpecName: "kube-api-access-hk9pv") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "kube-api-access-hk9pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:00:57.463423 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.463398    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78e05689-6949-4826-88cb-123c6b461cdc" (UID: "78e05689-6949-4826-88cb-123c6b461cdc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:00:57.563119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.562984    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-oauth-config\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.563119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.563032    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk9pv\" (UniqueName: \"kubernetes.io/projected/78e05689-6949-4826-88cb-123c6b461cdc-kube-api-access-hk9pv\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.563119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.563043    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.563119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.563051    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78e05689-6949-4826-88cb-123c6b461cdc-trusted-ca-bundle\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:57.563119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:57.563087    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78e05689-6949-4826-88cb-123c6b461cdc-console-serving-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:00:58.068960 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.068927    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9656w"
Jul 02 20:00:58.069444 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.069014    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:00:58.118370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.118334    2546 generic.go:356] "Generic (PLEG): container finished" podID="78e05689-6949-4826-88cb-123c6b461cdc" containerID="ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415" exitCode=0
Jul 02 20:00:58.118560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.118390    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbf6495fb-kkhwp"
Jul 02 20:00:58.118560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.118418    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbf6495fb-kkhwp" event={"ID":"78e05689-6949-4826-88cb-123c6b461cdc","Type":"ContainerDied","Data":"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"}
Jul 02 20:00:58.118560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.118483    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbf6495fb-kkhwp" event={"ID":"78e05689-6949-4826-88cb-123c6b461cdc","Type":"ContainerDied","Data":"842294f6603b0c352528a265d661c4f1701ed19fc9fbd37df1b576ef333d4841"}
Jul 02 20:00:58.118560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.118511    2546 scope.go:117] "RemoveContainer" containerID="ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"
Jul 02 20:00:58.129650 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.129629    2546 scope.go:117] "RemoveContainer" containerID="ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"
Jul 02 20:00:58.129981 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:00:58.129963    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415\": container with ID starting with ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415 not found: ID does not exist" containerID="ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"
Jul 02 20:00:58.130027 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.129991    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415"} err="failed to get container status \"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415\": rpc error: code = NotFound desc = could not find container \"ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415\": container with ID starting with ac318591db641f649353a526ba0445e7068197f996c8c0257a28e00091c08415 not found: ID does not exist"
Jul 02 20:00:58.156080 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.156036    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 20:00:58.160184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:58.160153    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dbf6495fb-kkhwp"]
Jul 02 20:00:59.202611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:00:59.202573    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e05689-6949-4826-88cb-123c6b461cdc" path="/var/lib/kubelet/pods/78e05689-6949-4826-88cb-123c6b461cdc/volumes"
Jul 02 20:01:16.957206 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:16.957113    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:01:16.957659 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:16.957366    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" podUID="1616a298-ca68-47b6-a158-4cdbb9020cce" containerName="manager" containerID="cri-o://766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649" gracePeriod=10
Jul 02 20:01:17.208826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.208760    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:01:17.217099 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217054    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume\") pod \"1616a298-ca68-47b6-a158-4cdbb9020cce\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") "
Jul 02 20:01:17.217254 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217112    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfxjq\" (UniqueName: \"kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq\") pod \"1616a298-ca68-47b6-a158-4cdbb9020cce\" (UID: \"1616a298-ca68-47b6-a158-4cdbb9020cce\") "
Jul 02 20:01:17.217452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217425    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1616a298-ca68-47b6-a158-4cdbb9020cce" (UID: "1616a298-ca68-47b6-a158-4cdbb9020cce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:01:17.217562 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217537    2546 generic.go:356] "Generic (PLEG): container finished" podID="1616a298-ca68-47b6-a158-4cdbb9020cce" containerID="766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649" exitCode=0
Jul 02 20:01:17.217619 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217580    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"
Jul 02 20:01:17.217669 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217621    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" event={"ID":"1616a298-ca68-47b6-a158-4cdbb9020cce","Type":"ContainerDied","Data":"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"}
Jul 02 20:01:17.217720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217681    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w" event={"ID":"1616a298-ca68-47b6-a158-4cdbb9020cce","Type":"ContainerDied","Data":"f96906be3182aadbe0620076f772dc14ba3d5cc0082d909fd8e2c51cdd8572ed"}
Jul 02 20:01:17.217720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.217716    2546 scope.go:117] "RemoveContainer" containerID="766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"
Jul 02 20:01:17.219578 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.219538    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq" (OuterVolumeSpecName: "kube-api-access-jfxjq") pod "1616a298-ca68-47b6-a158-4cdbb9020cce" (UID: "1616a298-ca68-47b6-a158-4cdbb9020cce"). InnerVolumeSpecName "kube-api-access-jfxjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:01:17.230557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.230535    2546 scope.go:117] "RemoveContainer" containerID="766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"
Jul 02 20:01:17.230849 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:01:17.230828    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649\": container with ID starting with 766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649 not found: ID does not exist" containerID="766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"
Jul 02 20:01:17.230911 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.230858    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649"} err="failed to get container status \"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649\": rpc error: code = NotFound desc = could not find container \"766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649\": container with ID starting with 766940234baef8ca69c6fb3da90c78befdb42b53c7376dabc8a79d861a35f649 not found: ID does not exist"
Jul 02 20:01:17.318275 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.318234    2546 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1616a298-ca68-47b6-a158-4cdbb9020cce-extensions-socket-volume\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:01:17.318275 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.318265    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfxjq\" (UniqueName: \"kubernetes.io/projected/1616a298-ca68-47b6-a158-4cdbb9020cce-kube-api-access-jfxjq\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:01:17.546728 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.546692    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:01:17.553280 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:17.553254    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w8t2w"]
Jul 02 20:01:19.202610 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:19.202576    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1616a298-ca68-47b6-a158-4cdbb9020cce" path="/var/lib/kubelet/pods/1616a298-ca68-47b6-a158-4cdbb9020cce/volumes"
Jul 02 20:01:33.337633 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.337594    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"]
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.337938    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1616a298-ca68-47b6-a158-4cdbb9020cce" containerName="manager"
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.337949    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="1616a298-ca68-47b6-a158-4cdbb9020cce" containerName="manager"
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.337960    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e05689-6949-4826-88cb-123c6b461cdc" containerName="console"
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.337965    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e05689-6949-4826-88cb-123c6b461cdc" containerName="console"
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.338013    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="1616a298-ca68-47b6-a158-4cdbb9020cce" containerName="manager"
Jul 02 20:01:33.338112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.338021    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e05689-6949-4826-88cb-123c6b461cdc" containerName="console"
Jul 02 20:01:33.342370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.342349    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.344945 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.344928    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zmjrk\""
Jul 02 20:01:33.353138 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.353110    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"]
Jul 02 20:01:33.462527 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462492    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462543    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462585    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462622    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462648    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462678    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3968ec40-f10c-4295-92dc-2ae56302b1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462702    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kq7q\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-kube-api-access-9kq7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462725    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.462895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.462772    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563648    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3968ec40-f10c-4295-92dc-2ae56302b1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563689    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kq7q\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-kube-api-access-9kq7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563711    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563736    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563760    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563789    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563831    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.563936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563851    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564277 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.564259    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.564292    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.563876    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.564359    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564455 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.564392    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.564546 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.564525    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3968ec40-f10c-4295-92dc-2ae56302b1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.566187 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.566166    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.566410 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.566391    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.572178 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.572149    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.572422 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.572404    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kq7q\" (UniqueName: \"kubernetes.io/projected/3968ec40-f10c-4295-92dc-2ae56302b1a1-kube-api-access-9kq7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-82rts\" (UID: \"3968ec40-f10c-4295-92dc-2ae56302b1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.652784 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.652695    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:33.791855 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.791825    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"]
Jul 02 20:01:33.794140 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:01:33.794110    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3968ec40_f10c_4295_92dc_2ae56302b1a1.slice/crio-ea783bae3515a25b479710712e47c260b113f1e1a1e80da960ed42a640721326 WatchSource:0}: Error finding container ea783bae3515a25b479710712e47c260b113f1e1a1e80da960ed42a640721326: Status 404 returned error can't find the container with id ea783bae3515a25b479710712e47c260b113f1e1a1e80da960ed42a640721326
Jul 02 20:01:33.796395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.796347    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:01:33.796475 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.796427    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:01:33.796475 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:33.796460    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:01:34.299319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:34.299271    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" event={"ID":"3968ec40-f10c-4295-92dc-2ae56302b1a1","Type":"ContainerStarted","Data":"fb3dacee2b22b62c94f0e5f7388208352b28694dcb32c18c3c57106b22deb801"}
Jul 02 20:01:34.299501 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:34.299337    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" event={"ID":"3968ec40-f10c-4295-92dc-2ae56302b1a1","Type":"ContainerStarted","Data":"ea783bae3515a25b479710712e47c260b113f1e1a1e80da960ed42a640721326"}
Jul 02 20:01:34.318667 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:34.318620    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" podStartSLOduration=1.318602878 podStartE2EDuration="1.318602878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:34.316752078 +0000 UTC m=+467.572829467" watchObservedRunningTime="2026-07-02 20:01:34.318602878 +0000 UTC m=+467.574680255"
Jul 02 20:01:34.653419 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:34.653382    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:34.657759 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:34.657734    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:35.304327 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:35.304289    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:35.305220 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:35.305201    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:01:37.000548 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.000499    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:37.004236 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.004215    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.007469 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.007444    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7dvzc\""
Jul 02 20:01:37.007609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.007489    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 20:01:37.013995 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.013967    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:37.096905 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.096868    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:37.097250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.097224    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpt4n\" (UniqueName: \"kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.097352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.097285    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.197929 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.197892    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.198143 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.198045    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpt4n\" (UniqueName: \"kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.198684 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.198664    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.210714 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.210674    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpt4n\" (UniqueName: \"kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n\") pod \"limitador-limitador-64c94fd64f-55qtl\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.316413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.316320    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:37.480596 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.480577    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:37.482976 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:01:37.482944    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fbf6c7_80f9_416a_b4d6_d81be02631c2.slice/crio-a31bf1f97482705932961fcdfa707c1c2e269990acc8cb21307407e6924897a4 WatchSource:0}: Error finding container a31bf1f97482705932961fcdfa707c1c2e269990acc8cb21307407e6924897a4: Status 404 returned error can't find the container with id a31bf1f97482705932961fcdfa707c1c2e269990acc8cb21307407e6924897a4
Jul 02 20:01:37.895770 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.895734    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:37.900300 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.900274    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:37.902890 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.902868    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pngrw\""
Jul 02 20:01:37.906116 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:37.906089    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:38.006124 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.006087    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr944\" (UniqueName: \"kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944\") pod \"authorino-58cd955675-kt8gc\" (UID: \"5cce26be-8596-41b3-a9e9-f7a5117fb2db\") " pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:38.106750 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.106711    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr944\" (UniqueName: \"kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944\") pod \"authorino-58cd955675-kt8gc\" (UID: \"5cce26be-8596-41b3-a9e9-f7a5117fb2db\") " pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:38.116769 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.116741    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr944\" (UniqueName: \"kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944\") pod \"authorino-58cd955675-kt8gc\" (UID: \"5cce26be-8596-41b3-a9e9-f7a5117fb2db\") " pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:38.138496 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.138461    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:01:38.141806 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.141783    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:01:38.147920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.147848    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:01:38.208257 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.208193    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwst\" (UniqueName: \"kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst\") pod \"authorino-75d556bd77-jwtfg\" (UID: \"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a\") " pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:01:38.212029 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.211999    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:38.310041 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.310002    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwst\" (UniqueName: \"kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst\") pod \"authorino-75d556bd77-jwtfg\" (UID: \"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a\") " pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:01:38.327013 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.326966    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwst\" (UniqueName: \"kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst\") pod \"authorino-75d556bd77-jwtfg\" (UID: \"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a\") " pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:01:38.328296 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.328265    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" event={"ID":"63fbf6c7-80f9-416a-b4d6-d81be02631c2","Type":"ContainerStarted","Data":"a31bf1f97482705932961fcdfa707c1c2e269990acc8cb21307407e6924897a4"}
Jul 02 20:01:38.406402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.406170    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:38.409526 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:01:38.409489    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cce26be_8596_41b3_a9e9_f7a5117fb2db.slice/crio-46c659eab44f1b7cc1e40e81a38961172d5273f1268136522e17e27b26f22abb WatchSource:0}: Error finding container 46c659eab44f1b7cc1e40e81a38961172d5273f1268136522e17e27b26f22abb: Status 404 returned error can't find the container with id 46c659eab44f1b7cc1e40e81a38961172d5273f1268136522e17e27b26f22abb
Jul 02 20:01:38.455309 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.455043    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:01:38.633494 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:38.633461    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:01:38.635825 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:01:38.635791    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6acce6ad_2b9c_470f_9f4e_e9b1c22a684a.slice/crio-728ee7e0e3dd772ef5981845a1cd55ac671fbe7753c3ebb3050da2e4d86765f2 WatchSource:0}: Error finding container 728ee7e0e3dd772ef5981845a1cd55ac671fbe7753c3ebb3050da2e4d86765f2: Status 404 returned error can't find the container with id 728ee7e0e3dd772ef5981845a1cd55ac671fbe7753c3ebb3050da2e4d86765f2
Jul 02 20:01:39.335926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:39.335885    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jwtfg" event={"ID":"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a","Type":"ContainerStarted","Data":"728ee7e0e3dd772ef5981845a1cd55ac671fbe7753c3ebb3050da2e4d86765f2"}
Jul 02 20:01:39.337254 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:39.337225    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kt8gc" event={"ID":"5cce26be-8596-41b3-a9e9-f7a5117fb2db","Type":"ContainerStarted","Data":"46c659eab44f1b7cc1e40e81a38961172d5273f1268136522e17e27b26f22abb"}
Jul 02 20:01:41.353107 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:41.352940    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" event={"ID":"63fbf6c7-80f9-416a-b4d6-d81be02631c2","Type":"ContainerStarted","Data":"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"}
Jul 02 20:01:41.353617 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:41.353114    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:41.370036 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:41.369471    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" podStartSLOduration=2.1061511 podStartE2EDuration="5.369447038s" totalImagesPullingTime="3.263295938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:41.368269746 +0000 UTC m=+474.624347129" watchObservedRunningTime="2026-07-02 20:01:41.369447038 +0000 UTC m=+474.625524462"
Jul 02 20:01:43.364962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:43.364921    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kt8gc" event={"ID":"5cce26be-8596-41b3-a9e9-f7a5117fb2db","Type":"ContainerStarted","Data":"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"}
Jul 02 20:01:43.366462 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:43.366438    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jwtfg" event={"ID":"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a","Type":"ContainerStarted","Data":"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"}
Jul 02 20:01:43.380749 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:43.380698    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kt8gc" podStartSLOduration=1.846050703 podStartE2EDuration="6.380682638s" totalImagesPullingTime="4.534631935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:43.379295674 +0000 UTC m=+476.635373077" watchObservedRunningTime="2026-07-02 20:01:43.380682638 +0000 UTC m=+476.636760015"
Jul 02 20:01:43.395081 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:43.395013    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jwtfg" podStartSLOduration=1.09704745 podStartE2EDuration="5.394994557s" totalImagesPullingTime="4.297947107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:43.393349574 +0000 UTC m=+476.649426969" watchObservedRunningTime="2026-07-02 20:01:43.394994557 +0000 UTC m=+476.651071935"
Jul 02 20:01:43.419338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:43.419303    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:45.376788 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:45.376750    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kt8gc" podUID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" containerName="authorino" containerID="cri-o://b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b" gracePeriod=30
Jul 02 20:01:45.620607 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:45.620578    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:45.783729 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:45.783611    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr944\" (UniqueName: \"kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944\") pod \"5cce26be-8596-41b3-a9e9-f7a5117fb2db\" (UID: \"5cce26be-8596-41b3-a9e9-f7a5117fb2db\") "
Jul 02 20:01:45.785836 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:45.785811    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944" (OuterVolumeSpecName: "kube-api-access-pr944") pod "5cce26be-8596-41b3-a9e9-f7a5117fb2db" (UID: "5cce26be-8596-41b3-a9e9-f7a5117fb2db"). InnerVolumeSpecName "kube-api-access-pr944". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:01:45.884335 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:45.884297    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr944\" (UniqueName: \"kubernetes.io/projected/5cce26be-8596-41b3-a9e9-f7a5117fb2db-kube-api-access-pr944\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:01:46.382574 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.382533    2546 generic.go:356] "Generic (PLEG): container finished" podID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" containerID="b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b" exitCode=0
Jul 02 20:01:46.382574 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.382577    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kt8gc"
Jul 02 20:01:46.383098 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.382615    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kt8gc" event={"ID":"5cce26be-8596-41b3-a9e9-f7a5117fb2db","Type":"ContainerDied","Data":"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"}
Jul 02 20:01:46.383098 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.382660    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kt8gc" event={"ID":"5cce26be-8596-41b3-a9e9-f7a5117fb2db","Type":"ContainerDied","Data":"46c659eab44f1b7cc1e40e81a38961172d5273f1268136522e17e27b26f22abb"}
Jul 02 20:01:46.383098 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.382679    2546 scope.go:117] "RemoveContainer" containerID="b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"
Jul 02 20:01:46.391509 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.391492    2546 scope.go:117] "RemoveContainer" containerID="b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"
Jul 02 20:01:46.391779 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:01:46.391757    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b\": container with ID starting with b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b not found: ID does not exist" containerID="b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"
Jul 02 20:01:46.391820 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.391790    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b"} err="failed to get container status \"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b\": rpc error: code = NotFound desc = could not find container \"b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b\": container with ID starting with b3b7146e06b871f693f18c7919a0494762f548c069dce903807da21af7346a2b not found: ID does not exist"
Jul 02 20:01:46.406707 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.406674    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:46.411096 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:46.411073    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kt8gc"]
Jul 02 20:01:47.203014 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:47.202981    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" path="/var/lib/kubelet/pods/5cce26be-8596-41b3-a9e9-f7a5117fb2db/volumes"
Jul 02 20:01:52.111521 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:52.111481    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:52.111962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:52.111699    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" podUID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" containerName="limitador" containerID="cri-o://7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f" gracePeriod=30
Jul 02 20:01:52.112407 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:52.112369    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:53.062750 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.062716    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:53.146017 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.145982    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file\") pod \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") "
Jul 02 20:01:53.146519 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.146045    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpt4n\" (UniqueName: \"kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n\") pod \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\" (UID: \"63fbf6c7-80f9-416a-b4d6-d81be02631c2\") "
Jul 02 20:01:53.146519 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.146377    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file" (OuterVolumeSpecName: "config-file") pod "63fbf6c7-80f9-416a-b4d6-d81be02631c2" (UID: "63fbf6c7-80f9-416a-b4d6-d81be02631c2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:01:53.148230 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.148205    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n" (OuterVolumeSpecName: "kube-api-access-gpt4n") pod "63fbf6c7-80f9-416a-b4d6-d81be02631c2" (UID: "63fbf6c7-80f9-416a-b4d6-d81be02631c2"). InnerVolumeSpecName "kube-api-access-gpt4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:01:53.246879 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.246845    2546 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63fbf6c7-80f9-416a-b4d6-d81be02631c2-config-file\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:01:53.247051 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.246903    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpt4n\" (UniqueName: \"kubernetes.io/projected/63fbf6c7-80f9-416a-b4d6-d81be02631c2-kube-api-access-gpt4n\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:01:53.421009 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.420971    2546 generic.go:356] "Generic (PLEG): container finished" podID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" containerID="7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f" exitCode=0
Jul 02 20:01:53.421189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.421028    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl"
Jul 02 20:01:53.421189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.421077    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" event={"ID":"63fbf6c7-80f9-416a-b4d6-d81be02631c2","Type":"ContainerDied","Data":"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"}
Jul 02 20:01:53.421189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.421135    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-55qtl" event={"ID":"63fbf6c7-80f9-416a-b4d6-d81be02631c2","Type":"ContainerDied","Data":"a31bf1f97482705932961fcdfa707c1c2e269990acc8cb21307407e6924897a4"}
Jul 02 20:01:53.421189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.421163    2546 scope.go:117] "RemoveContainer" containerID="7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"
Jul 02 20:01:53.429726 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.429710    2546 scope.go:117] "RemoveContainer" containerID="7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"
Jul 02 20:01:53.429988 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:01:53.429970    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f\": container with ID starting with 7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f not found: ID does not exist" containerID="7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"
Jul 02 20:01:53.430036 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.429996    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f"} err="failed to get container status \"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f\": rpc error: code = NotFound desc = could not find container \"7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f\": container with ID starting with 7dcc8376919074b9d6d082344de9821f91bf3d3860644dfdee347001e63f807f not found: ID does not exist"
Jul 02 20:01:53.436926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.436900    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:53.441088 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:53.441046    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-55qtl"]
Jul 02 20:01:55.201920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:55.201886    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" path="/var/lib/kubelet/pods/63fbf6c7-80f9-416a-b4d6-d81be02631c2/volumes"
Jul 02 20:01:56.828521 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828488    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-fvg7v"]
Jul 02 20:01:56.828896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828838    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" containerName="authorino"
Jul 02 20:01:56.828896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828850    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" containerName="authorino"
Jul 02 20:01:56.828896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828864    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" containerName="limitador"
Jul 02 20:01:56.828896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828870    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" containerName="limitador"
Jul 02 20:01:56.829045 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828931    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fbf6c7-80f9-416a-b4d6-d81be02631c2" containerName="limitador"
Jul 02 20:01:56.829045 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.828937    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cce26be-8596-41b3-a9e9-f7a5117fb2db" containerName="authorino"
Jul 02 20:01:56.833306 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.833285    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:56.835461 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.835437    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pr7bl\""
Jul 02 20:01:56.835583 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.835450    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 20:01:56.839104 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.839074    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-fvg7v"]
Jul 02 20:01:56.980895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.980859    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqsqj\" (UniqueName: \"kubernetes.io/projected/425e1985-3f79-488a-8754-c7232610a9cd-kube-api-access-vqsqj\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:56.980895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:56.980897    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/425e1985-3f79-488a-8754-c7232610a9cd-data\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.081718 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.081631    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsqj\" (UniqueName: \"kubernetes.io/projected/425e1985-3f79-488a-8754-c7232610a9cd-kube-api-access-vqsqj\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.081718 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.081670    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/425e1985-3f79-488a-8754-c7232610a9cd-data\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.082010 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.081994    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/425e1985-3f79-488a-8754-c7232610a9cd-data\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.089850 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.089823    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqsqj\" (UniqueName: \"kubernetes.io/projected/425e1985-3f79-488a-8754-c7232610a9cd-kube-api-access-vqsqj\") pod \"postgres-69fb4594cf-fvg7v\" (UID: \"425e1985-3f79-488a-8754-c7232610a9cd\") " pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.147726 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.147693    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:01:57.284733 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.284707    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-fvg7v"]
Jul 02 20:01:57.287026 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:01:57.286997    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425e1985_3f79_488a_8754_c7232610a9cd.slice/crio-46baa0de6a87f5b33b9fd63a3ed427ce4e38afd7cd40968ca4e0884c6a50aa1b WatchSource:0}: Error finding container 46baa0de6a87f5b33b9fd63a3ed427ce4e38afd7cd40968ca4e0884c6a50aa1b: Status 404 returned error can't find the container with id 46baa0de6a87f5b33b9fd63a3ed427ce4e38afd7cd40968ca4e0884c6a50aa1b
Jul 02 20:01:57.442181 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:01:57.442086    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-fvg7v" event={"ID":"425e1985-3f79-488a-8754-c7232610a9cd","Type":"ContainerStarted","Data":"46baa0de6a87f5b33b9fd63a3ed427ce4e38afd7cd40968ca4e0884c6a50aa1b"}
Jul 02 20:02:02.477478 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:02.477441    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-fvg7v" event={"ID":"425e1985-3f79-488a-8754-c7232610a9cd","Type":"ContainerStarted","Data":"2ee6ada86e6729f408853ab9bc4519dc49ce0edc1653c74d72a0337c5ed7d801"}
Jul 02 20:02:02.477870 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:02.477553    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:02:02.495911 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:02.495858    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-fvg7v" podStartSLOduration=1.463311101 podStartE2EDuration="6.495843461s" totalImagesPullingTime="5.03253236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:02.495380504 +0000 UTC m=+495.751457884" watchObservedRunningTime="2026-07-02 20:02:02.495843461 +0000 UTC m=+495.751920840"
Jul 02 20:02:08.512286 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:08.512258    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-fvg7v"
Jul 02 20:02:09.051595 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.051560    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:09.057424 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.057401    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:09.062176 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.062149    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:09.085586 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.085548    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4cx\" (UniqueName: \"kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx\") pod \"authorino-5d4b67c446-g6wdq\" (UID: \"58d030bf-16c4-4605-bab3-00af7bec5709\") " pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:09.186592 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.186552    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4cx\" (UniqueName: \"kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx\") pod \"authorino-5d4b67c446-g6wdq\" (UID: \"58d030bf-16c4-4605-bab3-00af7bec5709\") " pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:09.194508 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.194479    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4cx\" (UniqueName: \"kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx\") pod \"authorino-5d4b67c446-g6wdq\" (UID: \"58d030bf-16c4-4605-bab3-00af7bec5709\") " pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:09.281807 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.281769    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:09.282056 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.282043    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:09.307719 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.307646    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56b9c5985c-phwhv"]
Jul 02 20:02:09.313247 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.313220    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.319489 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.319460    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56b9c5985c-phwhv"]
Jul 02 20:02:09.358892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.358858    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b9c5985c-phwhv"]
Jul 02 20:02:09.359160 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:02:09.359140    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vfb4d], unattached volumes=[], failed to process volumes=[kube-api-access-vfb4d]: context canceled" pod="kuadrant-system/authorino-56b9c5985c-phwhv" podUID="84b75ca0-a278-41d6-80e5-d1d69a68a470"
Jul 02 20:02:09.387750 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.387719    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfb4d\" (UniqueName: \"kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d\") pod \"authorino-56b9c5985c-phwhv\" (UID: \"84b75ca0-a278-41d6-80e5-d1d69a68a470\") " pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.390390 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.390361    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:02:09.394595 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.394571    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.397092 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.397054    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 20:02:09.403265 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.403230    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:02:09.425446 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.425368    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:09.428004 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:09.427975    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58d030bf_16c4_4605_bab3_00af7bec5709.slice/crio-030df8513660a65e2816bbc0bf3ca9c3cce1de69410d7a54055199cb317fc348 WatchSource:0}: Error finding container 030df8513660a65e2816bbc0bf3ca9c3cce1de69410d7a54055199cb317fc348: Status 404 returned error can't find the container with id 030df8513660a65e2816bbc0bf3ca9c3cce1de69410d7a54055199cb317fc348
Jul 02 20:02:09.489080 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.489008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvt9\" (UniqueName: \"kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.489266 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.489108    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfb4d\" (UniqueName: \"kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d\") pod \"authorino-56b9c5985c-phwhv\" (UID: \"84b75ca0-a278-41d6-80e5-d1d69a68a470\") " pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.489266 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.489232    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.497450 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.497415    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfb4d\" (UniqueName: \"kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d\") pod \"authorino-56b9c5985c-phwhv\" (UID: \"84b75ca0-a278-41d6-80e5-d1d69a68a470\") " pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.510348 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.510320    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.510507 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.510345    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" event={"ID":"58d030bf-16c4-4605-bab3-00af7bec5709","Type":"ContainerStarted","Data":"030df8513660a65e2816bbc0bf3ca9c3cce1de69410d7a54055199cb317fc348"}
Jul 02 20:02:09.519336 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.519310    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:09.590129 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.590094    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfb4d\" (UniqueName: \"kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d\") pod \"84b75ca0-a278-41d6-80e5-d1d69a68a470\" (UID: \"84b75ca0-a278-41d6-80e5-d1d69a68a470\") "
Jul 02 20:02:09.590305 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.590216    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.590305 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.590265    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvt9\" (UniqueName: \"kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.592308 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.592279    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d" (OuterVolumeSpecName: "kube-api-access-vfb4d") pod "84b75ca0-a278-41d6-80e5-d1d69a68a470" (UID: "84b75ca0-a278-41d6-80e5-d1d69a68a470"). InnerVolumeSpecName "kube-api-access-vfb4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:02:09.592591 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.592569    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.597610 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.597589    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvt9\" (UniqueName: \"kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9\") pod \"authorino-d47cf8f85-n2pxv\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") " pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.690973 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.690931    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfb4d\" (UniqueName: \"kubernetes.io/projected/84b75ca0-a278-41d6-80e5-d1d69a68a470-kube-api-access-vfb4d\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:02:09.707426 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.707391    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:02:09.841080 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:09.841008    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:02:09.844519 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:09.844493    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb49e31aa_9474_41db_b612_b56a91a70a81.slice/crio-54cccc8b1bd8eb4bce309408024ab0868e2571ff63e05970e64a68eaed0f9ea1 WatchSource:0}: Error finding container 54cccc8b1bd8eb4bce309408024ab0868e2571ff63e05970e64a68eaed0f9ea1: Status 404 returned error can't find the container with id 54cccc8b1bd8eb4bce309408024ab0868e2571ff63e05970e64a68eaed0f9ea1
Jul 02 20:02:10.516430 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.516303    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" event={"ID":"58d030bf-16c4-4605-bab3-00af7bec5709","Type":"ContainerStarted","Data":"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"}
Jul 02 20:02:10.516430 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.516322    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" podUID="58d030bf-16c4-4605-bab3-00af7bec5709" containerName="authorino" containerID="cri-o://43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd" gracePeriod=30
Jul 02 20:02:10.517930 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.517901    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" event={"ID":"b49e31aa-9474-41db-b612-b56a91a70a81","Type":"ContainerStarted","Data":"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"}
Jul 02 20:02:10.518033 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.517946    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" event={"ID":"b49e31aa-9474-41db-b612-b56a91a70a81","Type":"ContainerStarted","Data":"54cccc8b1bd8eb4bce309408024ab0868e2571ff63e05970e64a68eaed0f9ea1"}
Jul 02 20:02:10.518033 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.517974    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b9c5985c-phwhv"
Jul 02 20:02:10.532720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.532663    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" podStartSLOduration=1.128739449 podStartE2EDuration="1.532646478s" totalImagesPullingTime="403.907029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:10.530862386 +0000 UTC m=+503.786939782" watchObservedRunningTime="2026-07-02 20:02:10.532646478 +0000 UTC m=+503.788723856"
Jul 02 20:02:10.550833 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.550776    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" podStartSLOduration=1.250388474 podStartE2EDuration="1.550759986s" totalImagesPullingTime="300.371512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:10.549733629 +0000 UTC m=+503.805811010" watchObservedRunningTime="2026-07-02 20:02:10.550759986 +0000 UTC m=+503.806837365"
Jul 02 20:02:10.576617 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.576583    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:02:10.576802 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.576779    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jwtfg" podUID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" containerName="authorino" containerID="cri-o://c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6" gracePeriod=30
Jul 02 20:02:10.597705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.597673    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b9c5985c-phwhv"]
Jul 02 20:02:10.601714 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.601679    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56b9c5985c-phwhv"]
Jul 02 20:02:10.825655 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.825631    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:10.869529 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.869498    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:02:10.900588 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.900554    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxwst\" (UniqueName: \"kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst\") pod \"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a\" (UID: \"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a\") "
Jul 02 20:02:10.900844 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.900605    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz4cx\" (UniqueName: \"kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx\") pod \"58d030bf-16c4-4605-bab3-00af7bec5709\" (UID: \"58d030bf-16c4-4605-bab3-00af7bec5709\") "
Jul 02 20:02:10.902598 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.902569    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx" (OuterVolumeSpecName: "kube-api-access-sz4cx") pod "58d030bf-16c4-4605-bab3-00af7bec5709" (UID: "58d030bf-16c4-4605-bab3-00af7bec5709"). InnerVolumeSpecName "kube-api-access-sz4cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:02:10.902671 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:10.902591    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst" (OuterVolumeSpecName: "kube-api-access-mxwst") pod "6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" (UID: "6acce6ad-2b9c-470f-9f4e-e9b1c22a684a"). InnerVolumeSpecName "kube-api-access-mxwst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:02:11.001404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.001370    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxwst\" (UniqueName: \"kubernetes.io/projected/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a-kube-api-access-mxwst\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:02:11.001404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.001398    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz4cx\" (UniqueName: \"kubernetes.io/projected/58d030bf-16c4-4605-bab3-00af7bec5709-kube-api-access-sz4cx\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:02:11.205089 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.205044    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84b75ca0-a278-41d6-80e5-d1d69a68a470" path="/var/lib/kubelet/pods/84b75ca0-a278-41d6-80e5-d1d69a68a470/volumes"
Jul 02 20:02:11.524662 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.524575    2546 generic.go:356] "Generic (PLEG): container finished" podID="58d030bf-16c4-4605-bab3-00af7bec5709" containerID="43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd" exitCode=0
Jul 02 20:02:11.524662 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.524624    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g6wdq"
Jul 02 20:02:11.524880 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.524613    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" event={"ID":"58d030bf-16c4-4605-bab3-00af7bec5709","Type":"ContainerDied","Data":"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"}
Jul 02 20:02:11.524880 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.524754    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g6wdq" event={"ID":"58d030bf-16c4-4605-bab3-00af7bec5709","Type":"ContainerDied","Data":"030df8513660a65e2816bbc0bf3ca9c3cce1de69410d7a54055199cb317fc348"}
Jul 02 20:02:11.524880 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.524775    2546 scope.go:117] "RemoveContainer" containerID="43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"
Jul 02 20:02:11.526228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.526019    2546 generic.go:356] "Generic (PLEG): container finished" podID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" containerID="c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6" exitCode=0
Jul 02 20:02:11.526228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.526072    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jwtfg"
Jul 02 20:02:11.526228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.526113    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jwtfg" event={"ID":"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a","Type":"ContainerDied","Data":"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"}
Jul 02 20:02:11.526228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.526154    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jwtfg" event={"ID":"6acce6ad-2b9c-470f-9f4e-e9b1c22a684a","Type":"ContainerDied","Data":"728ee7e0e3dd772ef5981845a1cd55ac671fbe7753c3ebb3050da2e4d86765f2"}
Jul 02 20:02:11.533376 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.533360    2546 scope.go:117] "RemoveContainer" containerID="43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"
Jul 02 20:02:11.533663 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:02:11.533635    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd\": container with ID starting with 43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd not found: ID does not exist" containerID="43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"
Jul 02 20:02:11.533700 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.533658    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd"} err="failed to get container status \"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd\": rpc error: code = NotFound desc = could not find container \"43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd\": container with ID starting with 43a6763d0fb4d737100e07e594e818a368c1576da96d4f0994d0398cb168dafd not found: ID does not exist"
Jul 02 20:02:11.533700 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.533677    2546 scope.go:117] "RemoveContainer" containerID="c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"
Jul 02 20:02:11.542709 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.542684    2546 scope.go:117] "RemoveContainer" containerID="c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"
Jul 02 20:02:11.543053 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:02:11.543032    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6\": container with ID starting with c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6 not found: ID does not exist" containerID="c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"
Jul 02 20:02:11.543222 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.543199    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6"} err="failed to get container status \"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6\": rpc error: code = NotFound desc = could not find container \"c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6\": container with ID starting with c1f53504c9fe7b658eebc6f54d0984693e5372e8afa37f0902660f92a3ac9cc6 not found: ID does not exist"
Jul 02 20:02:11.544432 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.544413    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:11.547716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.547692    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g6wdq"]
Jul 02 20:02:11.557609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.557580    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:02:11.561396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:11.561372    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jwtfg"]
Jul 02 20:02:13.202827 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:13.202794    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d030bf-16c4-4605-bab3-00af7bec5709" path="/var/lib/kubelet/pods/58d030bf-16c4-4605-bab3-00af7bec5709/volumes"
Jul 02 20:02:13.203250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:13.203134    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" path="/var/lib/kubelet/pods/6acce6ad-2b9c-470f-9f4e-e9b1c22a684a/volumes"
Jul 02 20:02:14.877805 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.877766    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:14.878419 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878289    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d030bf-16c4-4605-bab3-00af7bec5709" containerName="authorino"
Jul 02 20:02:14.878419 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878307    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d030bf-16c4-4605-bab3-00af7bec5709" containerName="authorino"
Jul 02 20:02:14.878419 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878318    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" containerName="authorino"
Jul 02 20:02:14.878419 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878327    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" containerName="authorino"
Jul 02 20:02:14.878656 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878427    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6acce6ad-2b9c-470f-9f4e-e9b1c22a684a" containerName="authorino"
Jul 02 20:02:14.878656 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.878441    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d030bf-16c4-4605-bab3-00af7bec5709" containerName="authorino"
Jul 02 20:02:14.943279 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.943220    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:14.943485 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.943367    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:14.946307 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.946286    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:02:14.947342 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.947320    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qtqj\""
Jul 02 20:02:14.947342 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:14.947340    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:02:15.035934 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.035899    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.036124 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.035973    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9hr2\" (UniqueName: \"kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.092892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.092856    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:02:15.104488 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.104456    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.105740 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.105713    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:02:15.137091 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.136992    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9hr2\" (UniqueName: \"kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.137262 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.137117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.137262 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.137162    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vl7\" (UniqueName: \"kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.137262 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.137210    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.139639 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.139615    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.144728 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.144704    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9hr2\" (UniqueName: \"kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2\") pod \"maas-controller-686c488699-h5mxn\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") " pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.237959 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.237927    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vl7\" (UniqueName: \"kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.238169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.237972    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.240535 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.240511    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.245937 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.245908    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vl7\" (UniqueName: \"kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7\") pod \"maas-controller-c7695b477-ll9sj\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") " pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.253659 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.253614    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:15.407467 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.407436    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:15.409143 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:15.409119    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1cfbbd_1203_464b_8db4_358d9e68c5a3.slice/crio-a3595266050359c26659f404cf43df200b1b09a9771841eb71dc58be3c4a8ff6 WatchSource:0}: Error finding container a3595266050359c26659f404cf43df200b1b09a9771841eb71dc58be3c4a8ff6: Status 404 returned error can't find the container with id a3595266050359c26659f404cf43df200b1b09a9771841eb71dc58be3c4a8ff6
Jul 02 20:02:15.417332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.417308    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:15.548347 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.548308    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686c488699-h5mxn" event={"ID":"5a1cfbbd-1203-464b-8db4-358d9e68c5a3","Type":"ContainerStarted","Data":"a3595266050359c26659f404cf43df200b1b09a9771841eb71dc58be3c4a8ff6"}
Jul 02 20:02:15.578843 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:15.578760    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:02:15.581450 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:15.581419    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd614f895_ce1a_4687_953d_21417c2e7e0b.slice/crio-590f300d5f8a1036792363c4b89fdcc8e4e00d69101157b0877ce4a04ff042bb WatchSource:0}: Error finding container 590f300d5f8a1036792363c4b89fdcc8e4e00d69101157b0877ce4a04ff042bb: Status 404 returned error can't find the container with id 590f300d5f8a1036792363c4b89fdcc8e4e00d69101157b0877ce4a04ff042bb
Jul 02 20:02:16.561460 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:16.561381    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-ll9sj" event={"ID":"d614f895-ce1a-4687-953d-21417c2e7e0b","Type":"ContainerStarted","Data":"590f300d5f8a1036792363c4b89fdcc8e4e00d69101157b0877ce4a04ff042bb"}
Jul 02 20:02:18.575975 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:18.575575    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686c488699-h5mxn" event={"ID":"5a1cfbbd-1203-464b-8db4-358d9e68c5a3","Type":"ContainerStarted","Data":"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"}
Jul 02 20:02:18.575975 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:18.575767    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:18.577629 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:18.577606    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-ll9sj" event={"ID":"d614f895-ce1a-4687-953d-21417c2e7e0b","Type":"ContainerStarted","Data":"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"}
Jul 02 20:02:18.577743 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:18.577727    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:18.610626 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:18.610574    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686c488699-h5mxn" podStartSLOduration=1.6552821930000001 podStartE2EDuration="4.610556827s" totalImagesPullingTime="2.955274634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:18.609194666 +0000 UTC m=+511.865272046" watchObservedRunningTime="2026-07-02 20:02:18.610556827 +0000 UTC m=+511.866634205"
Jul 02 20:02:29.587407 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.587373    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:29.587860 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.587441    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:02:29.607416 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.607352    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c7695b477-ll9sj" podStartSLOduration=11.831073715 podStartE2EDuration="14.607333617s" totalImagesPullingTime="2.776259902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:18.633543018 +0000 UTC m=+511.889620421" watchObservedRunningTime="2026-07-02 20:02:29.607333617 +0000 UTC m=+522.863410995"
Jul 02 20:02:29.649909 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.649869    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:29.650190 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.650154    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-686c488699-h5mxn" podUID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" containerName="manager" containerID="cri-o://b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a" gracePeriod=30
Jul 02 20:02:29.899958 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.899928    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:29.974584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.974551    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert\") pod \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") "
Jul 02 20:02:29.974771 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.974648    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9hr2\" (UniqueName: \"kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2\") pod \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\" (UID: \"5a1cfbbd-1203-464b-8db4-358d9e68c5a3\") "
Jul 02 20:02:29.976793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.976758    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5a1cfbbd-1203-464b-8db4-358d9e68c5a3" (UID: "5a1cfbbd-1203-464b-8db4-358d9e68c5a3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:02:29.976793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:29.976771    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2" (OuterVolumeSpecName: "kube-api-access-h9hr2") pod "5a1cfbbd-1203-464b-8db4-358d9e68c5a3" (UID: "5a1cfbbd-1203-464b-8db4-358d9e68c5a3"). InnerVolumeSpecName "kube-api-access-h9hr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:02:30.075689 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.075648    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9hr2\" (UniqueName: \"kubernetes.io/projected/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-kube-api-access-h9hr2\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:02:30.075689 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.075684    2546 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a1cfbbd-1203-464b-8db4-358d9e68c5a3-webhook-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:02:30.634946 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.634914    2546 generic.go:356] "Generic (PLEG): container finished" podID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" containerID="b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a" exitCode=0
Jul 02 20:02:30.635393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.634956    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686c488699-h5mxn"
Jul 02 20:02:30.635393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.634999    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686c488699-h5mxn" event={"ID":"5a1cfbbd-1203-464b-8db4-358d9e68c5a3","Type":"ContainerDied","Data":"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"}
Jul 02 20:02:30.635393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.635052    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686c488699-h5mxn" event={"ID":"5a1cfbbd-1203-464b-8db4-358d9e68c5a3","Type":"ContainerDied","Data":"a3595266050359c26659f404cf43df200b1b09a9771841eb71dc58be3c4a8ff6"}
Jul 02 20:02:30.635393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.635092    2546 scope.go:117] "RemoveContainer" containerID="b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"
Jul 02 20:02:30.644553 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.644529    2546 scope.go:117] "RemoveContainer" containerID="b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"
Jul 02 20:02:30.644860 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:02:30.644839    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a\": container with ID starting with b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a not found: ID does not exist" containerID="b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"
Jul 02 20:02:30.644905 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.644870    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a"} err="failed to get container status \"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a\": rpc error: code = NotFound desc = could not find container \"b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a\": container with ID starting with b7b10e56a6952b4dfc497b18bbabccf6acc0aed1bb4e1c8955b725e0c5dc5b3a not found: ID does not exist"
Jul 02 20:02:30.657746 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.657713    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:30.661649 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:30.661615    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-686c488699-h5mxn"]
Jul 02 20:02:31.203102 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:31.203048    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" path="/var/lib/kubelet/pods/5a1cfbbd-1203-464b-8db4-358d9e68c5a3/volumes"
Jul 02 20:02:50.556934 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.556895    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7676dfbcb7-vnncp"]
Jul 02 20:02:50.557361 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.557302    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" containerName="manager"
Jul 02 20:02:50.557361 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.557315    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" containerName="manager"
Jul 02 20:02:50.557439 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.557376    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a1cfbbd-1203-464b-8db4-358d9e68c5a3" containerName="manager"
Jul 02 20:02:50.563672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.563648    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.566494 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.566472    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 20:02:50.566604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.566491    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zvdpx\""
Jul 02 20:02:50.572901 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.572871    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7676dfbcb7-vnncp"]
Jul 02 20:02:50.761742 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.761703    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmrg\" (UniqueName: \"kubernetes.io/projected/336185e1-7b0d-46a7-b0f6-823a658e66cb-kube-api-access-fvmrg\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.761932 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.761773    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/336185e1-7b0d-46a7-b0f6-823a658e66cb-openshift-service-ca\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.761932 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.761792    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/336185e1-7b0d-46a7-b0f6-823a658e66cb-maas-api-tls\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.863189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.863146    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmrg\" (UniqueName: \"kubernetes.io/projected/336185e1-7b0d-46a7-b0f6-823a658e66cb-kube-api-access-fvmrg\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.863398 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.863245    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/336185e1-7b0d-46a7-b0f6-823a658e66cb-openshift-service-ca\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.863398 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.863302    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/336185e1-7b0d-46a7-b0f6-823a658e66cb-maas-api-tls\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.863991 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.863973    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/336185e1-7b0d-46a7-b0f6-823a658e66cb-openshift-service-ca\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.865686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.865667    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/336185e1-7b0d-46a7-b0f6-823a658e66cb-maas-api-tls\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.872204 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.872176    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmrg\" (UniqueName: \"kubernetes.io/projected/336185e1-7b0d-46a7-b0f6-823a658e66cb-kube-api-access-fvmrg\") pod \"maas-api-7676dfbcb7-vnncp\" (UID: \"336185e1-7b0d-46a7-b0f6-823a658e66cb\") " pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:50.874956 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:50.874929    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:51.022077 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.022036    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7676dfbcb7-vnncp"]
Jul 02 20:02:51.023805 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:51.023772    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336185e1_7b0d_46a7_b0f6_823a658e66cb.slice/crio-fb402b296c20b099266b37d351519e82bee9c6111fa75e3bb6fcc495b80f4d8d WatchSource:0}: Error finding container fb402b296c20b099266b37d351519e82bee9c6111fa75e3bb6fcc495b80f4d8d: Status 404 returned error can't find the container with id fb402b296c20b099266b37d351519e82bee9c6111fa75e3bb6fcc495b80f4d8d
Jul 02 20:02:51.159532 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.159450    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fvqcc"]
Jul 02 20:02:51.165436 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.165414    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.172196 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.170729    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vvkjw\""
Jul 02 20:02:51.172196 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.171041    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 20:02:51.175395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.175369    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fvqcc"]
Jul 02 20:02:51.180673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.180650    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vxjlr"]
Jul 02 20:02:51.184880 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.184860    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.194753 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.194721    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vxjlr"]
Jul 02 20:02:51.268251 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.268215    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f884b05-009b-4cd7-b404-114024f7838f-plugins-config-volume\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.268452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.268289    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/458cb335-97c6-478c-b753-d03290eca4af-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.268452 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.268431    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7n92\" (UniqueName: \"kubernetes.io/projected/6f884b05-009b-4cd7-b404-114024f7838f-kube-api-access-v7n92\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.268570 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.268519    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cpml\" (UniqueName: \"kubernetes.io/projected/458cb335-97c6-478c-b753-d03290eca4af-kube-api-access-8cpml\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.369965 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.369895    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f884b05-009b-4cd7-b404-114024f7838f-plugins-config-volume\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.369965 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.369953    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/458cb335-97c6-478c-b753-d03290eca4af-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.370245 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.370026    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7n92\" (UniqueName: \"kubernetes.io/projected/6f884b05-009b-4cd7-b404-114024f7838f-kube-api-access-v7n92\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.370494 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.370467    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cpml\" (UniqueName: \"kubernetes.io/projected/458cb335-97c6-478c-b753-d03290eca4af-kube-api-access-8cpml\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.371350 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.371318    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f884b05-009b-4cd7-b404-114024f7838f-plugins-config-volume\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.371455 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.371326    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/458cb335-97c6-478c-b753-d03290eca4af-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.378262 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.378238    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cpml\" (UniqueName: \"kubernetes.io/projected/458cb335-97c6-478c-b753-d03290eca4af-kube-api-access-8cpml\") pod \"payload-pre-processing-7964457696-fvqcc\" (UID: \"458cb335-97c6-478c-b753-d03290eca4af\") " pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.378378 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.378324    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7n92\" (UniqueName: \"kubernetes.io/projected/6f884b05-009b-4cd7-b404-114024f7838f-kube-api-access-v7n92\") pod \"payload-processing-58f86c7798-vxjlr\" (UID: \"6f884b05-009b-4cd7-b404-114024f7838f\") " pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.483438 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.483348    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:51.496943 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.496919    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:51.640551 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.640508    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fvqcc"]
Jul 02 20:02:51.643758 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:51.643727    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458cb335_97c6_478c_b753_d03290eca4af.slice/crio-10e36510c42443966479a0d0b16b44579935194b17bd44beb6180a60bddd5c89 WatchSource:0}: Error finding container 10e36510c42443966479a0d0b16b44579935194b17bd44beb6180a60bddd5c89: Status 404 returned error can't find the container with id 10e36510c42443966479a0d0b16b44579935194b17bd44beb6180a60bddd5c89
Jul 02 20:02:51.666146 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.665927    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vxjlr"]
Jul 02 20:02:51.668516 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:02:51.668490    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f884b05_009b_4cd7_b404_114024f7838f.slice/crio-ab7c50d2606ef7c20968af2abb009e4ab010c52bf2eb5fea6581d9d98bd709a0 WatchSource:0}: Error finding container ab7c50d2606ef7c20968af2abb009e4ab010c52bf2eb5fea6581d9d98bd709a0: Status 404 returned error can't find the container with id ab7c50d2606ef7c20968af2abb009e4ab010c52bf2eb5fea6581d9d98bd709a0
Jul 02 20:02:51.743127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.743016    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc" event={"ID":"458cb335-97c6-478c-b753-d03290eca4af","Type":"ContainerStarted","Data":"10e36510c42443966479a0d0b16b44579935194b17bd44beb6180a60bddd5c89"}
Jul 02 20:02:51.744309 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.744281    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr" event={"ID":"6f884b05-009b-4cd7-b404-114024f7838f","Type":"ContainerStarted","Data":"ab7c50d2606ef7c20968af2abb009e4ab010c52bf2eb5fea6581d9d98bd709a0"}
Jul 02 20:02:51.745474 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:51.745453    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7676dfbcb7-vnncp" event={"ID":"336185e1-7b0d-46a7-b0f6-823a658e66cb","Type":"ContainerStarted","Data":"fb402b296c20b099266b37d351519e82bee9c6111fa75e3bb6fcc495b80f4d8d"}
Jul 02 20:02:54.771330 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.771287    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc" event={"ID":"458cb335-97c6-478c-b753-d03290eca4af","Type":"ContainerStarted","Data":"7a113bb2b1b3f61bf0d7dd2de65d5f8f0a896943144887e5b742269fb7cffd0b"}
Jul 02 20:02:54.771786 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.771363    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:02:54.772878 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.772856    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr" event={"ID":"6f884b05-009b-4cd7-b404-114024f7838f","Type":"ContainerStarted","Data":"30bed50047008bbae0d2e2247956f67e9379f5987a4a9f024d8a57fa20a73cd4"}
Jul 02 20:02:54.772997 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.772909    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:02:54.774409 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.774383    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7676dfbcb7-vnncp" event={"ID":"336185e1-7b0d-46a7-b0f6-823a658e66cb","Type":"ContainerStarted","Data":"2d5a0c509436449ed5029b3d00eb038440d3090d4766fe329638145d442d5b5c"}
Jul 02 20:02:54.774539 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.774514    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:02:54.787645 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.787569    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc" podStartSLOduration=1.773191237 podStartE2EDuration="3.787553994s" totalImagesPullingTime="2.014362757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:54.785619651 +0000 UTC m=+548.041697055" watchObservedRunningTime="2026-07-02 20:02:54.787553994 +0000 UTC m=+548.043631373"
Jul 02 20:02:54.800784 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.800732    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr" podStartSLOduration=1.8136177039999999 podStartE2EDuration="3.800714103s" totalImagesPullingTime="1.987096399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:54.799855399 +0000 UTC m=+548.055932800" watchObservedRunningTime="2026-07-02 20:02:54.800714103 +0000 UTC m=+548.056791482"
Jul 02 20:02:54.816378 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:54.816320    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7676dfbcb7-vnncp" podStartSLOduration=2.184297946 podStartE2EDuration="4.816304213s" totalImagesPullingTime="2.632006267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:54.814792611 +0000 UTC m=+548.070869991" watchObservedRunningTime="2026-07-02 20:02:54.816304213 +0000 UTC m=+548.072381592"
Jul 02 20:02:58.798534 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.798440    2546 generic.go:356] "Generic (PLEG): container finished" podID="3968ec40-f10c-4295-92dc-2ae56302b1a1" containerID="fb3dacee2b22b62c94f0e5f7388208352b28694dcb32c18c3c57106b22deb801" exitCode=0
Jul 02 20:02:58.798534 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.798522    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" event={"ID":"3968ec40-f10c-4295-92dc-2ae56302b1a1","Type":"ContainerDied","Data":"fb3dacee2b22b62c94f0e5f7388208352b28694dcb32c18c3c57106b22deb801"}
Jul 02 20:02:58.798985 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.798905    2546 scope.go:117] "RemoveContainer" containerID="fb3dacee2b22b62c94f0e5f7388208352b28694dcb32c18c3c57106b22deb801"
Jul 02 20:02:58.799879 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.799854    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:02:58.799936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.799923    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:02:58.799975 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:58.799961    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:02:59.805351 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:02:59.805317    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" event={"ID":"3968ec40-f10c-4295-92dc-2ae56302b1a1","Type":"ContainerStarted","Data":"06eee0d780bed7be8ae98daedbcf4ea62743cdacb9e1e05df0c1de04f974a454"}
Jul 02 20:03:00.653258 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:00.653210    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:03:00.654585 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:00.654556    2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82rts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 20:03:00.654719 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:00.654615    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" podUID="3968ec40-f10c-4295-92dc-2ae56302b1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 20:03:00.789296 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:00.789267    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7676dfbcb7-vnncp"
Jul 02 20:03:01.654185 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:01.654127    2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82rts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 20:03:01.654661 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:01.654226    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" podUID="3968ec40-f10c-4295-92dc-2ae56302b1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 20:03:02.654114 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:02.654074    2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82rts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 20:03:02.654442 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:02.654411    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" podUID="3968ec40-f10c-4295-92dc-2ae56302b1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 20:03:03.654340 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:03.653755    2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82rts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 20:03:03.654340 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:03.653837    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts" podUID="3968ec40-f10c-4295-92dc-2ae56302b1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 20:03:04.657147 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:04.657116    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:03:04.657531 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:04.657388    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:03:04.658028 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:04.658008    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82rts"
Jul 02 20:03:05.783994 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:05.783954    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc" podUID="458cb335-97c6-478c-b753-d03290eca4af" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.47:9004: connect: connection refused"
Jul 02 20:03:05.784490 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:05.784440    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-vxjlr"
Jul 02 20:03:15.783488 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:15.783450    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-fvqcc"
Jul 02 20:03:41.498322 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.498278    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"]
Jul 02 20:03:41.502091 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.502053    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.505547 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.505522    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:03:41.505693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.505551    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 20:03:41.505693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.505530    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:03:41.505693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.505602    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-whwbw\""
Jul 02 20:03:41.511121 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.511098    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"]
Jul 02 20:03:41.531846 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.531809    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.532023 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.531851    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373e2fb5-bc21-4dea-aa59-429a86c184c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.532023 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.531932    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.532023 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.531974    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8jxl\" (UniqueName: \"kubernetes.io/projected/373e2fb5-bc21-4dea-aa59-429a86c184c8-kube-api-access-j8jxl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.532184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.532084    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.532184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.532133    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633392 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633357    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633392 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633396    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373e2fb5-bc21-4dea-aa59-429a86c184c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633632 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633443    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633632 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633467    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8jxl\" (UniqueName: \"kubernetes.io/projected/373e2fb5-bc21-4dea-aa59-429a86c184c8-kube-api-access-j8jxl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633632 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633516    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633632 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633540    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633844 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633796    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633901 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633873    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.633953 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.633925    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.635926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.635902    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373e2fb5-bc21-4dea-aa59-429a86c184c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.636197 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.636177    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373e2fb5-bc21-4dea-aa59-429a86c184c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.642494 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.642470    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8jxl\" (UniqueName: \"kubernetes.io/projected/373e2fb5-bc21-4dea-aa59-429a86c184c8-kube-api-access-j8jxl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nvmks\" (UID: \"373e2fb5-bc21-4dea-aa59-429a86c184c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.813431 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.813350    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:41.950022 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:41.949969    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"]
Jul 02 20:03:41.952366 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:03:41.952339    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373e2fb5_bc21_4dea_aa59_429a86c184c8.slice/crio-b55c646992e3c4d9eee884a8bc014012243b5369b237827261e6e208ad7e60ca WatchSource:0}: Error finding container b55c646992e3c4d9eee884a8bc014012243b5369b237827261e6e208ad7e60ca: Status 404 returned error can't find the container with id b55c646992e3c4d9eee884a8bc014012243b5369b237827261e6e208ad7e60ca
Jul 02 20:03:42.018236 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:42.018202    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks" event={"ID":"373e2fb5-bc21-4dea-aa59-429a86c184c8","Type":"ContainerStarted","Data":"b55c646992e3c4d9eee884a8bc014012243b5369b237827261e6e208ad7e60ca"}
Jul 02 20:03:44.033213 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:44.033175    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks" event={"ID":"373e2fb5-bc21-4dea-aa59-429a86c184c8","Type":"ContainerStarted","Data":"cfd71cd6a88eddfea42dd2d3f8d2a052f858af898c1769b6492dfeba3338e43c"}
Jul 02 20:03:44.050822 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:44.050756    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks" podStartSLOduration=1.869983519 podStartE2EDuration="3.050734787s" totalImagesPullingTime="1.180751268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:44.049380853 +0000 UTC m=+597.305458231" watchObservedRunningTime="2026-07-02 20:03:44.050734787 +0000 UTC m=+597.306812166"
Jul 02 20:03:47.105022 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:47.104993    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:03:47.105930 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:47.105908    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:03:51.814004 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:51.813970    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:51.814443 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:51.814047    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:51.828716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:51.828687    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:03:52.084326 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:03:52.084302    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nvmks"
Jul 02 20:04:13.992018 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:13.991930    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"]
Jul 02 20:04:13.999162 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:13.999139    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.001872 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.001849    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 20:04:14.003499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.003471    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"]
Jul 02 20:04:14.128988 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.128950    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.128988 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.128992    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.129238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.129008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.129238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.129040    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.129238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.129079    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh22t\" (UniqueName: \"kubernetes.io/projected/106d7737-ea92-4bd8-84f3-0f5be3145aa6-kube-api-access-gh22t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.129238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.129112    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230532 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230496    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230547    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230576    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230628    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230657    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh22t\" (UniqueName: \"kubernetes.io/projected/106d7737-ea92-4bd8-84f3-0f5be3145aa6-kube-api-access-gh22t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.230722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.230708    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.231084 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.231043    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.231204 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.231093    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.231204 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.231079    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.233097 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.233045    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106d7737-ea92-4bd8-84f3-0f5be3145aa6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.233236 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.233215    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106d7737-ea92-4bd8-84f3-0f5be3145aa6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.238763 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.238741    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh22t\" (UniqueName: \"kubernetes.io/projected/106d7737-ea92-4bd8-84f3-0f5be3145aa6-kube-api-access-gh22t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr4xc\" (UID: \"106d7737-ea92-4bd8-84f3-0f5be3145aa6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.311749 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.311660    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:14.456697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.456659    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"]
Jul 02 20:04:14.461163 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:04:14.461135    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106d7737_ea92_4bd8_84f3_0f5be3145aa6.slice/crio-1bc9f4e0c3b3aaaefeb10bc6f407b1fa004e26459824c01b26968ee4dc135b9a WatchSource:0}: Error finding container 1bc9f4e0c3b3aaaefeb10bc6f407b1fa004e26459824c01b26968ee4dc135b9a: Status 404 returned error can't find the container with id 1bc9f4e0c3b3aaaefeb10bc6f407b1fa004e26459824c01b26968ee4dc135b9a
Jul 02 20:04:14.462424 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:14.462403    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:04:15.191402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:15.191360    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc" event={"ID":"106d7737-ea92-4bd8-84f3-0f5be3145aa6","Type":"ContainerStarted","Data":"43059dbb17a1636b2de0b5af367930458e3d632bd85d2dad215207e315755c41"}
Jul 02 20:04:15.191871 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:15.191421    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc" event={"ID":"106d7737-ea92-4bd8-84f3-0f5be3145aa6","Type":"ContainerStarted","Data":"1bc9f4e0c3b3aaaefeb10bc6f407b1fa004e26459824c01b26968ee4dc135b9a"}
Jul 02 20:04:15.208685 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:15.208627    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc" podStartSLOduration=2.019466657 podStartE2EDuration="2.208611919s" totalImagesPullingTime="189.145262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:04:15.207856742 +0000 UTC m=+628.463934124" watchObservedRunningTime="2026-07-02 20:04:15.208611919 +0000 UTC m=+628.464689297"
Jul 02 20:04:24.311895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:24.311849    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:24.312388 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:24.311927    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:24.324406 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:24.324378    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:04:25.260729 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:04:25.260699    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr4xc"
Jul 02 20:05:35.363137 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.363101    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84c57dbf4d-pmp9f"]
Jul 02 20:05:35.367020 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.366993    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.374933 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.374236    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c57dbf4d-pmp9f"]
Jul 02 20:05:35.482854 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.482818    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c67c92bb-cd04-4048-8ba3-876cf727460c-tls-cert\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.483034 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.482870    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcvk\" (UniqueName: \"kubernetes.io/projected/c67c92bb-cd04-4048-8ba3-876cf727460c-kube-api-access-hpcvk\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.584226 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.584187    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c67c92bb-cd04-4048-8ba3-876cf727460c-tls-cert\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.584404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.584238    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcvk\" (UniqueName: \"kubernetes.io/projected/c67c92bb-cd04-4048-8ba3-876cf727460c-kube-api-access-hpcvk\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.586700 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.586676    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c67c92bb-cd04-4048-8ba3-876cf727460c-tls-cert\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.591881 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.591849    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcvk\" (UniqueName: \"kubernetes.io/projected/c67c92bb-cd04-4048-8ba3-876cf727460c-kube-api-access-hpcvk\") pod \"authorino-84c57dbf4d-pmp9f\" (UID: \"c67c92bb-cd04-4048-8ba3-876cf727460c\") " pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.678793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.678707    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c57dbf4d-pmp9f"
Jul 02 20:05:35.827103 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:35.827076    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c57dbf4d-pmp9f"]
Jul 02 20:05:35.829168 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:05:35.829136    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc67c92bb_cd04_4048_8ba3_876cf727460c.slice/crio-06207f182d306c077101a9b1857757f0fa5435381db6de95abab667c713daaea WatchSource:0}: Error finding container 06207f182d306c077101a9b1857757f0fa5435381db6de95abab667c713daaea: Status 404 returned error can't find the container with id 06207f182d306c077101a9b1857757f0fa5435381db6de95abab667c713daaea
Jul 02 20:05:36.616304 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.616256    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c57dbf4d-pmp9f" event={"ID":"c67c92bb-cd04-4048-8ba3-876cf727460c","Type":"ContainerStarted","Data":"84b456efcc14a9ca65d0c1af1c4d73e5ba2993cc17fc48aefa2d1dcf0cf43401"}
Jul 02 20:05:36.616304 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.616315    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c57dbf4d-pmp9f" event={"ID":"c67c92bb-cd04-4048-8ba3-876cf727460c","Type":"ContainerStarted","Data":"06207f182d306c077101a9b1857757f0fa5435381db6de95abab667c713daaea"}
Jul 02 20:05:36.634666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.634578    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84c57dbf4d-pmp9f" podStartSLOduration=1.328961128 podStartE2EDuration="1.634562185s" totalImagesPullingTime="305.601057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:05:36.633367911 +0000 UTC m=+709.889445289" watchObservedRunningTime="2026-07-02 20:05:36.634562185 +0000 UTC m=+709.890639563"
Jul 02 20:05:36.668243 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.668196    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:05:36.668462 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.668426    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" podUID="b49e31aa-9474-41db-b612-b56a91a70a81" containerName="authorino" containerID="cri-o://86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3" gracePeriod=30
Jul 02 20:05:36.942611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:36.942581    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:05:37.100027 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.099987    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert\") pod \"b49e31aa-9474-41db-b612-b56a91a70a81\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") "
Jul 02 20:05:37.100238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.100114    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqvt9\" (UniqueName: \"kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9\") pod \"b49e31aa-9474-41db-b612-b56a91a70a81\" (UID: \"b49e31aa-9474-41db-b612-b56a91a70a81\") "
Jul 02 20:05:37.102136 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.102104    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9" (OuterVolumeSpecName: "kube-api-access-gqvt9") pod "b49e31aa-9474-41db-b612-b56a91a70a81" (UID: "b49e31aa-9474-41db-b612-b56a91a70a81"). InnerVolumeSpecName "kube-api-access-gqvt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:05:37.113685 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.113657    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b49e31aa-9474-41db-b612-b56a91a70a81" (UID: "b49e31aa-9474-41db-b612-b56a91a70a81"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:05:37.201576 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.201480    2546 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b49e31aa-9474-41db-b612-b56a91a70a81-tls-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:05:37.201576 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.201516    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqvt9\" (UniqueName: \"kubernetes.io/projected/b49e31aa-9474-41db-b612-b56a91a70a81-kube-api-access-gqvt9\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:05:37.624176 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.624139    2546 generic.go:356] "Generic (PLEG): container finished" podID="b49e31aa-9474-41db-b612-b56a91a70a81" containerID="86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3" exitCode=0
Jul 02 20:05:37.624584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.624200    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47cf8f85-n2pxv"
Jul 02 20:05:37.624584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.624242    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" event={"ID":"b49e31aa-9474-41db-b612-b56a91a70a81","Type":"ContainerDied","Data":"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"}
Jul 02 20:05:37.624584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.624293    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d47cf8f85-n2pxv" event={"ID":"b49e31aa-9474-41db-b612-b56a91a70a81","Type":"ContainerDied","Data":"54cccc8b1bd8eb4bce309408024ab0868e2571ff63e05970e64a68eaed0f9ea1"}
Jul 02 20:05:37.624584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.624319    2546 scope.go:117] "RemoveContainer" containerID="86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"
Jul 02 20:05:37.634872 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.634850    2546 scope.go:117] "RemoveContainer" containerID="86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"
Jul 02 20:05:37.635229 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:05:37.635196    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3\": container with ID starting with 86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3 not found: ID does not exist" containerID="86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"
Jul 02 20:05:37.635299 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.635236    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3"} err="failed to get container status \"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3\": rpc error: code = NotFound desc = could not find container \"86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3\": container with ID starting with 86cd2a9269f26086010e094ba4f207cc07efcce772ce43e0a5b73939cbb92ec3 not found: ID does not exist"
Jul 02 20:05:37.654703 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.654669    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:05:37.661592 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:37.661558    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d47cf8f85-n2pxv"]
Jul 02 20:05:39.203556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:05:39.203472    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49e31aa-9474-41db-b612-b56a91a70a81" path="/var/lib/kubelet/pods/b49e31aa-9474-41db-b612-b56a91a70a81/volumes"
Jul 02 20:06:47.601402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.601365    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:06:47.601953 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.601572    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c7695b477-ll9sj" podUID="d614f895-ce1a-4687-953d-21417c2e7e0b" containerName="manager" containerID="cri-o://61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf" gracePeriod=30
Jul 02 20:06:47.851282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.851234    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:06:47.963369 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.963270    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert\") pod \"d614f895-ce1a-4687-953d-21417c2e7e0b\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") "
Jul 02 20:06:47.963369 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.963328    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94vl7\" (UniqueName: \"kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7\") pod \"d614f895-ce1a-4687-953d-21417c2e7e0b\" (UID: \"d614f895-ce1a-4687-953d-21417c2e7e0b\") "
Jul 02 20:06:47.965413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.965379    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d614f895-ce1a-4687-953d-21417c2e7e0b" (UID: "d614f895-ce1a-4687-953d-21417c2e7e0b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:06:47.965413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.965385    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7" (OuterVolumeSpecName: "kube-api-access-94vl7") pod "d614f895-ce1a-4687-953d-21417c2e7e0b" (UID: "d614f895-ce1a-4687-953d-21417c2e7e0b"). InnerVolumeSpecName "kube-api-access-94vl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:06:47.991774 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.991740    2546 generic.go:356] "Generic (PLEG): container finished" podID="d614f895-ce1a-4687-953d-21417c2e7e0b" containerID="61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf" exitCode=0
Jul 02 20:06:47.991952 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.991780    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-ll9sj"
Jul 02 20:06:47.991952 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.991833    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-ll9sj" event={"ID":"d614f895-ce1a-4687-953d-21417c2e7e0b","Type":"ContainerDied","Data":"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"}
Jul 02 20:06:47.991952 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.991884    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-ll9sj" event={"ID":"d614f895-ce1a-4687-953d-21417c2e7e0b","Type":"ContainerDied","Data":"590f300d5f8a1036792363c4b89fdcc8e4e00d69101157b0877ce4a04ff042bb"}
Jul 02 20:06:47.991952 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:47.991906    2546 scope.go:117] "RemoveContainer" containerID="61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"
Jul 02 20:06:48.001408 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.001380    2546 scope.go:117] "RemoveContainer" containerID="61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"
Jul 02 20:06:48.001693 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:06:48.001676    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf\": container with ID starting with 61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf not found: ID does not exist" containerID="61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"
Jul 02 20:06:48.001747 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.001703    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf"} err="failed to get container status \"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf\": rpc error: code = NotFound desc = could not find container \"61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf\": container with ID starting with 61c1187836d33231d2ee0f49c2bb12abe27e27264f69f71d2c944aa8caabfacf not found: ID does not exist"
Jul 02 20:06:48.012512 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.012470    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:06:48.016121 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.016095    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c7695b477-ll9sj"]
Jul 02 20:06:48.064649 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.064613    2546 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614f895-ce1a-4687-953d-21417c2e7e0b-webhook-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:06:48.064649 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.064650    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94vl7\" (UniqueName: \"kubernetes.io/projected/d614f895-ce1a-4687-953d-21417c2e7e0b-kube-api-access-94vl7\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:06:48.816844 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.816809    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c7695b477-mvh7x"]
Jul 02 20:06:48.817302 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817234    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d614f895-ce1a-4687-953d-21417c2e7e0b" containerName="manager"
Jul 02 20:06:48.817302 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817247    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d614f895-ce1a-4687-953d-21417c2e7e0b" containerName="manager"
Jul 02 20:06:48.817302 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817260    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49e31aa-9474-41db-b612-b56a91a70a81" containerName="authorino"
Jul 02 20:06:48.817302 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817265    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49e31aa-9474-41db-b612-b56a91a70a81" containerName="authorino"
Jul 02 20:06:48.817437 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817333    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d614f895-ce1a-4687-953d-21417c2e7e0b" containerName="manager"
Jul 02 20:06:48.817437 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.817344    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49e31aa-9474-41db-b612-b56a91a70a81" containerName="authorino"
Jul 02 20:06:48.821611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.821592    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.824955 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.824926    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qtqj\""
Jul 02 20:06:48.825150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.825055    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:06:48.825150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.825091    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:06:48.827559 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.827532    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7695b477-mvh7x"]
Jul 02 20:06:48.873111 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.873040    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn958\" (UniqueName: \"kubernetes.io/projected/b77df281-611a-421c-b735-9f3df879b8e7-kube-api-access-gn958\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.873314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.873128    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b77df281-611a-421c-b735-9f3df879b8e7-webhook-cert\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.974154 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.974112    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn958\" (UniqueName: \"kubernetes.io/projected/b77df281-611a-421c-b735-9f3df879b8e7-kube-api-access-gn958\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.974154 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.974161    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b77df281-611a-421c-b735-9f3df879b8e7-webhook-cert\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.976652 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.976621    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b77df281-611a-421c-b735-9f3df879b8e7-webhook-cert\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:48.982199 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:48.982173    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn958\" (UniqueName: \"kubernetes.io/projected/b77df281-611a-421c-b735-9f3df879b8e7-kube-api-access-gn958\") pod \"maas-controller-c7695b477-mvh7x\" (UID: \"b77df281-611a-421c-b735-9f3df879b8e7\") " pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:49.134562 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:49.134516    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:49.210804 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:49.210751    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d614f895-ce1a-4687-953d-21417c2e7e0b" path="/var/lib/kubelet/pods/d614f895-ce1a-4687-953d-21417c2e7e0b/volumes"
Jul 02 20:06:49.279354 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:49.279329    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7695b477-mvh7x"]
Jul 02 20:06:49.282091 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:06:49.282044    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77df281_611a_421c_b735_9f3df879b8e7.slice/crio-623c29fb2b3cbae0d82086ae87c766e00a0b633e438e2d807bb9f4fa3aac5171 WatchSource:0}: Error finding container 623c29fb2b3cbae0d82086ae87c766e00a0b633e438e2d807bb9f4fa3aac5171: Status 404 returned error can't find the container with id 623c29fb2b3cbae0d82086ae87c766e00a0b633e438e2d807bb9f4fa3aac5171
Jul 02 20:06:50.003211 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:50.003178    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-mvh7x" event={"ID":"b77df281-611a-421c-b735-9f3df879b8e7","Type":"ContainerStarted","Data":"623c29fb2b3cbae0d82086ae87c766e00a0b633e438e2d807bb9f4fa3aac5171"}
Jul 02 20:06:51.009214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:51.009160    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7695b477-mvh7x" event={"ID":"b77df281-611a-421c-b735-9f3df879b8e7","Type":"ContainerStarted","Data":"80dfbab68b6803719f7ab50387b0c75ebf505e0f6a7efedf0378fa06a43a729b"}
Jul 02 20:06:51.009629 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:51.009343    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:06:51.031219 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:06:51.031162    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c7695b477-mvh7x" podStartSLOduration=2.274493811 podStartE2EDuration="3.031145611s" totalImagesPullingTime="756.6518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:06:51.030175034 +0000 UTC m=+784.286252413" watchObservedRunningTime="2026-07-02 20:06:51.031145611 +0000 UTC m=+784.287222988"
Jul 02 20:07:02.020562 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:07:02.020512    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c7695b477-mvh7x"
Jul 02 20:08:47.143158 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:08:47.143118    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:08:47.143728 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:08:47.143697    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:13:47.174281 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:13:47.174248    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:13:47.176754 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:13:47.175521    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:18:37.811304 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.811265    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:37.815205 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.815182    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.817775 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.817756    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cbc955b7-openshift-default-dockercfg-k57pn\""
Jul 02 20:18:37.840666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.840639    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:37.905346 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905289    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905376    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905444    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905477    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905498    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905561    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905686    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905731    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5gpf\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:37.905874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:37.905790    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007711 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007667    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007711 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007710    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007729    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007761    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007784    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007809    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5gpf\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007841    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007871    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.007981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.007909    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.008507 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.008171    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.008507 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.008208    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.008507 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.008243    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.008507 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.008365    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.008862 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.008842    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.010173 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.010153    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.010409 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.010392    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.015736 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.015702    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.015938 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.015923    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5gpf\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf\") pod \"e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") " pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.126276 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.126233    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:38.277174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.277143    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:38.277310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.277215    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:38.277310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.277299    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:38.277434 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.277342    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:38.607336 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.607290    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" event={"ID":"5de7b48a-279e-4336-bb2f-b25948896e8b","Type":"ContainerStarted","Data":"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"}
Jul 02 20:18:38.607524 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.607351    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" event={"ID":"5de7b48a-279e-4336-bb2f-b25948896e8b","Type":"ContainerStarted","Data":"dc1284e1d3abc7d580c6a7ef87f924d91a6e450c8b3c7c8d95a2f3827cb355fc"}
Jul 02 20:18:38.627434 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:38.627374    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" podStartSLOduration=1.6273515139999999 podStartE2EDuration="1.627351514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:38.626593482 +0000 UTC m=+1491.882670861" watchObservedRunningTime="2026-07-02 20:18:38.627351514 +0000 UTC m=+1491.883428896"
Jul 02 20:18:39.127447 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.127414    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:39.133104 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.133073    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:39.175579 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.175545    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:39.179554 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.179532    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.181658 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.181631    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-cbc955b7-serving-cert\""
Jul 02 20:18:39.188770 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.188722    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:39.320991 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.320959    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.321197 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.321029    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6nj\" (UniqueName: \"kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.321197 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.321109    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.421757 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.421667    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.421757 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.421723    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6nj\" (UniqueName: \"kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.421954 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.421765    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.422385 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.422356    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.424258 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.424239    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.434229 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.434185    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6nj\" (UniqueName: \"kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj\") pod \"maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") " pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.491704 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.491668    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:39.613528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.613499    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:39.614626 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.614602    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:39.629389 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.629361    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:39.631236 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:18:39.631202    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6474a26_e11a_4d0e_bed0_47c254eb1255.slice/crio-e9efeeac3fdb7a1215cbed6f0f494821cc1084e402a170bf16d0005ebcc8e460 WatchSource:0}: Error finding container e9efeeac3fdb7a1215cbed6f0f494821cc1084e402a170bf16d0005ebcc8e460: Status 404 returned error can't find the container with id e9efeeac3fdb7a1215cbed6f0f494821cc1084e402a170bf16d0005ebcc8e460
Jul 02 20:18:39.633497 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:39.633465    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:18:40.620160 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:40.620118    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" event={"ID":"e6474a26-e11a-4d0e-bed0-47c254eb1255","Type":"ContainerStarted","Data":"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"}
Jul 02 20:18:40.620663 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:40.620182    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" event={"ID":"e6474a26-e11a-4d0e-bed0-47c254eb1255","Type":"ContainerStarted","Data":"e9efeeac3fdb7a1215cbed6f0f494821cc1084e402a170bf16d0005ebcc8e460"}
Jul 02 20:18:40.637075 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:40.636993    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" podStartSLOduration=1.050208016 podStartE2EDuration="1.636972433s" totalImagesPullingTime="586.764417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:40.63541925 +0000 UTC m=+1493.891496652" watchObservedRunningTime="2026-07-02 20:18:40.636972433 +0000 UTC m=+1493.893049815"
Jul 02 20:18:41.625686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:41.625656    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:44.274132 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.274093    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:44.274676 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.274289    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" podUID="5de7b48a-279e-4336-bb2f-b25948896e8b" containerName="istio-proxy" containerID="cri-o://bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50" gracePeriod=30
Jul 02 20:18:44.383314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.383262    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:44.383516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.383490    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" podUID="e6474a26-e11a-4d0e-bed0-47c254eb1255" containerName="maas-api" containerID="cri-o://eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059" gracePeriod=30
Jul 02 20:18:44.634318 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.634273    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:44.640280 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.640249    2546 generic.go:356] "Generic (PLEG): container finished" podID="e6474a26-e11a-4d0e-bed0-47c254eb1255" containerID="eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059" exitCode=0
Jul 02 20:18:44.640411 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.640294    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"
Jul 02 20:18:44.640411 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.640329    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" event={"ID":"e6474a26-e11a-4d0e-bed0-47c254eb1255","Type":"ContainerDied","Data":"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"}
Jul 02 20:18:44.640411 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.640390    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g" event={"ID":"e6474a26-e11a-4d0e-bed0-47c254eb1255","Type":"ContainerDied","Data":"e9efeeac3fdb7a1215cbed6f0f494821cc1084e402a170bf16d0005ebcc8e460"}
Jul 02 20:18:44.640565 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.640414    2546 scope.go:117] "RemoveContainer" containerID="eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"
Jul 02 20:18:44.648569 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.648550    2546 scope.go:117] "RemoveContainer" containerID="eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"
Jul 02 20:18:44.648810 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:18:44.648791    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059\": container with ID starting with eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059 not found: ID does not exist" containerID="eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"
Jul 02 20:18:44.648858 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.648823    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059"} err="failed to get container status \"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059\": rpc error: code = NotFound desc = could not find container \"eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059\": container with ID starting with eb606ea04a46df86c5dd92cfb7f2536e76f1d2738e80c6c3fd596e04315a6059 not found: ID does not exist"
Jul 02 20:18:44.673769 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.673742    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg6nj\" (UniqueName: \"kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj\") pod \"e6474a26-e11a-4d0e-bed0-47c254eb1255\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") "
Jul 02 20:18:44.673920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.673841    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca\") pod \"e6474a26-e11a-4d0e-bed0-47c254eb1255\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") "
Jul 02 20:18:44.673920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.673861    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls\") pod \"e6474a26-e11a-4d0e-bed0-47c254eb1255\" (UID: \"e6474a26-e11a-4d0e-bed0-47c254eb1255\") "
Jul 02 20:18:44.674274 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.674234    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6474a26-e11a-4d0e-bed0-47c254eb1255" (UID: "e6474a26-e11a-4d0e-bed0-47c254eb1255"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:18:44.676319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.676294    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6474a26-e11a-4d0e-bed0-47c254eb1255" (UID: "e6474a26-e11a-4d0e-bed0-47c254eb1255"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:18:44.676319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.676310    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj" (OuterVolumeSpecName: "kube-api-access-tg6nj") pod "e6474a26-e11a-4d0e-bed0-47c254eb1255" (UID: "e6474a26-e11a-4d0e-bed0-47c254eb1255"). InnerVolumeSpecName "kube-api-access-tg6nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:18:44.774557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.774497    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6474a26-e11a-4d0e-bed0-47c254eb1255-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:44.774557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.774541    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6474a26-e11a-4d0e-bed0-47c254eb1255-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:44.774557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.774555    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg6nj\" (UniqueName: \"kubernetes.io/projected/e6474a26-e11a-4d0e-bed0-47c254eb1255-kube-api-access-tg6nj\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:44.961172 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.961130    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:44.963589 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:44.963560    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-cbc955b7-95dfc9cbb-9v87g"]
Jul 02 20:18:45.202919 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:45.202843    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6474a26-e11a-4d0e-bed0-47c254eb1255" path="/var/lib/kubelet/pods/e6474a26-e11a-4d0e-bed0-47c254eb1255/volumes"
Jul 02 20:18:47.212335 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:47.212234    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:18:47.221845 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:47.218052    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:18:49.529731 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.529707    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:49.616737 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616703    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.616912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616748    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.616912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616790    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.616912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616827    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5gpf\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.616912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616857    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.616912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616883    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.617224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616916    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.617224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.616987    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.617224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617014    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket\") pod \"5de7b48a-279e-4336-bb2f-b25948896e8b\" (UID: \"5de7b48a-279e-4336-bb2f-b25948896e8b\") "
Jul 02 20:18:49.617224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617187    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:18:49.617224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617197    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617342    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617397    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617484    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617481    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617502    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de7b48a-279e-4336-bb2f-b25948896e8b-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617515    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.617716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.617530    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.619117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.619095    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:18:49.619176 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.619115    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:18:49.619404 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.619385    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:18:49.619469 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.619391    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf" (OuterVolumeSpecName: "kube-api-access-d5gpf") pod "5de7b48a-279e-4336-bb2f-b25948896e8b" (UID: "5de7b48a-279e-4336-bb2f-b25948896e8b"). InnerVolumeSpecName "kube-api-access-d5gpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:18:49.666350 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.666315    2546 generic.go:356] "Generic (PLEG): container finished" podID="5de7b48a-279e-4336-bb2f-b25948896e8b" containerID="bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50" exitCode=0
Jul 02 20:18:49.666482 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.666362    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"
Jul 02 20:18:49.666482 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.666397    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" event={"ID":"5de7b48a-279e-4336-bb2f-b25948896e8b","Type":"ContainerDied","Data":"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"}
Jul 02 20:18:49.666482 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.666450    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c" event={"ID":"5de7b48a-279e-4336-bb2f-b25948896e8b","Type":"ContainerDied","Data":"dc1284e1d3abc7d580c6a7ef87f924d91a6e450c8b3c7c8d95a2f3827cb355fc"}
Jul 02 20:18:49.666482 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.666471    2546 scope.go:117] "RemoveContainer" containerID="bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"
Jul 02 20:18:49.675878 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.675860    2546 scope.go:117] "RemoveContainer" containerID="bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"
Jul 02 20:18:49.676153 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:18:49.676132    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50\": container with ID starting with bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50 not found: ID does not exist" containerID="bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"
Jul 02 20:18:49.676246 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.676160    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50"} err="failed to get container status \"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50\": rpc error: code = NotFound desc = could not find container \"bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50\": container with ID starting with bf724a022aa3441a415944ef1d4c097a9253de5fe0e0f71cfcae60f5b017fb50 not found: ID does not exist"
Jul 02 20:18:49.688402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.688367    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:49.692405 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.692384    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cbc955b7-openshift-default-5c56f4c64c-9k45c"]
Jul 02 20:18:49.718448 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.718428    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.718448 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.718448    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5gpf\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-kube-api-access-d5gpf\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.718586 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.718458    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.718586 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.718469    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:49.718586 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:49.718476    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de7b48a-279e-4336-bb2f-b25948896e8b-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:50.523655 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.523618    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:18:50.524279 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524258    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de7b48a-279e-4336-bb2f-b25948896e8b" containerName="istio-proxy"
Jul 02 20:18:50.524338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524283    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de7b48a-279e-4336-bb2f-b25948896e8b" containerName="istio-proxy"
Jul 02 20:18:50.524338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524304    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6474a26-e11a-4d0e-bed0-47c254eb1255" containerName="maas-api"
Jul 02 20:18:50.524338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524313    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6474a26-e11a-4d0e-bed0-47c254eb1255" containerName="maas-api"
Jul 02 20:18:50.524459 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524445    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6474a26-e11a-4d0e-bed0-47c254eb1255" containerName="maas-api"
Jul 02 20:18:50.524499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.524465    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5de7b48a-279e-4336-bb2f-b25948896e8b" containerName="istio-proxy"
Jul 02 20:18:50.529310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.529286    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.531495 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.531476    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-448329fe-openshift-default-dockercfg-pw6xt\""
Jul 02 20:18:50.540858 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.540837    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:18:50.626388 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626357    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626578 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626403    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626578 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626479    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626578 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626558    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626743 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626612    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626743 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626644    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626743 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626667    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626863 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626754    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.626863 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.626782    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhkdc\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728111 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728053    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728170    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728208    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728244    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728274    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728313 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728299    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728696 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728351    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728696 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728383    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhkdc\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728696 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728504    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728696 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728607    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728696 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728685    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.728932 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.728731    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.729231 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.729195    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.729375 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.729280    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.730541 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.730479    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.731238 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.731212    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.736299 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.736280    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.736965 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.736945    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhkdc\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc\") pod \"e2e-ait-448329fe-openshift-default-cb6878f57-457fr\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") " pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.841782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.841747    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:50.977831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.977802    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:18:50.980582 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:18:50.980555    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8cf709_2ec3_4347_9423_1120a50e1575.slice/crio-93653d65ae750e658afbaa614a7d9afc72cc875561656ea6f5c3254e91e27fbe WatchSource:0}: Error finding container 93653d65ae750e658afbaa614a7d9afc72cc875561656ea6f5c3254e91e27fbe: Status 404 returned error can't find the container with id 93653d65ae750e658afbaa614a7d9afc72cc875561656ea6f5c3254e91e27fbe
Jul 02 20:18:50.982666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.982633    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:50.982759 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.982695    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:50.982759 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:50.982729    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:18:51.204105 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.203982    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5de7b48a-279e-4336-bb2f-b25948896e8b" path="/var/lib/kubelet/pods/5de7b48a-279e-4336-bb2f-b25948896e8b/volumes"
Jul 02 20:18:51.680051 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.680013    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" event={"ID":"9c8cf709-2ec3-4347-9423-1120a50e1575","Type":"ContainerStarted","Data":"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"}
Jul 02 20:18:51.680468 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.680088    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" event={"ID":"9c8cf709-2ec3-4347-9423-1120a50e1575","Type":"ContainerStarted","Data":"93653d65ae750e658afbaa614a7d9afc72cc875561656ea6f5c3254e91e27fbe"}
Jul 02 20:18:51.700960 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.700910    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" podStartSLOduration=1.700896307 podStartE2EDuration="1.700896307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:51.698720711 +0000 UTC m=+1504.954798114" watchObservedRunningTime="2026-07-02 20:18:51.700896307 +0000 UTC m=+1504.956973684"
Jul 02 20:18:51.839356 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.839317    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:51.843808 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.843781    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:51.844013 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.843905    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:51.846713 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.846692    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-448329fe-serving-cert\""
Jul 02 20:18:51.854740 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.854650    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:51.942677 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.942581    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnxp\" (UniqueName: \"kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:51.942677 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.942649    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:51.942928 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:51.942872    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.044101 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.044042    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.044290 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.044155    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.044290 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.044273    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnxp\" (UniqueName: \"kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.044887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.044861    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.046505 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.046483    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.052916 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.052889    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnxp\" (UniqueName: \"kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp\") pod \"maas-api-e2e-ait-448329fe-5644f586cc-jbbc4\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") " pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.159370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.159335    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:52.300712 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.300684    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:52.302965 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:18:52.302937    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913f3b7e_881e_4244_ae26_833ee0651e48.slice/crio-4bcc2fc1bc0dea07b43f8bccde1d5627b118d0b8b4772c23277ef456ad06c01d WatchSource:0}: Error finding container 4bcc2fc1bc0dea07b43f8bccde1d5627b118d0b8b4772c23277ef456ad06c01d: Status 404 returned error can't find the container with id 4bcc2fc1bc0dea07b43f8bccde1d5627b118d0b8b4772c23277ef456ad06c01d
Jul 02 20:18:52.686325 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.686299    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" event={"ID":"913f3b7e-881e-4244-ae26-833ee0651e48","Type":"ContainerStarted","Data":"4bcc2fc1bc0dea07b43f8bccde1d5627b118d0b8b4772c23277ef456ad06c01d"}
Jul 02 20:18:52.846970 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:52.846940    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:53.693508 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:53.693471    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" event={"ID":"913f3b7e-881e-4244-ae26-833ee0651e48","Type":"ContainerStarted","Data":"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"}
Jul 02 20:18:53.693944 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:53.693557    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:53.693944 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:53.693780    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:53.694782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:53.694754    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:18:53.711808 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:53.711764    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" podStartSLOduration=2.343012011 podStartE2EDuration="2.711748919s" totalImagesPullingTime="368.736908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:53.709771093 +0000 UTC m=+1506.965848512" watchObservedRunningTime="2026-07-02 20:18:53.711748919 +0000 UTC m=+1506.967826298"
Jul 02 20:18:57.230620 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.230582    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:57.231112 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.230818    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" podUID="913f3b7e-881e-4244-ae26-833ee0651e48" containerName="maas-api" containerID="cri-o://4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6" gracePeriod=30
Jul 02 20:18:57.237035 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.237012    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:57.491982 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.491927    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:57.596446 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.596399    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls\") pod \"913f3b7e-881e-4244-ae26-833ee0651e48\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") "
Jul 02 20:18:57.596700 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.596478    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdnxp\" (UniqueName: \"kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp\") pod \"913f3b7e-881e-4244-ae26-833ee0651e48\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") "
Jul 02 20:18:57.596700 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.596568    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca\") pod \"913f3b7e-881e-4244-ae26-833ee0651e48\" (UID: \"913f3b7e-881e-4244-ae26-833ee0651e48\") "
Jul 02 20:18:57.596943 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.596918    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "913f3b7e-881e-4244-ae26-833ee0651e48" (UID: "913f3b7e-881e-4244-ae26-833ee0651e48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:18:57.598488 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.598466    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "913f3b7e-881e-4244-ae26-833ee0651e48" (UID: "913f3b7e-881e-4244-ae26-833ee0651e48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:18:57.598574 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.598541    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp" (OuterVolumeSpecName: "kube-api-access-zdnxp") pod "913f3b7e-881e-4244-ae26-833ee0651e48" (UID: "913f3b7e-881e-4244-ae26-833ee0651e48"). InnerVolumeSpecName "kube-api-access-zdnxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:18:57.697826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.697793    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/913f3b7e-881e-4244-ae26-833ee0651e48-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:57.697826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.697823    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/913f3b7e-881e-4244-ae26-833ee0651e48-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:57.697826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.697834    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdnxp\" (UniqueName: \"kubernetes.io/projected/913f3b7e-881e-4244-ae26-833ee0651e48-kube-api-access-zdnxp\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:18:57.714258 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.714221    2546 generic.go:356] "Generic (PLEG): container finished" podID="913f3b7e-881e-4244-ae26-833ee0651e48" containerID="4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6" exitCode=0
Jul 02 20:18:57.714396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.714264    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"
Jul 02 20:18:57.714396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.714315    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" event={"ID":"913f3b7e-881e-4244-ae26-833ee0651e48","Type":"ContainerDied","Data":"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"}
Jul 02 20:18:57.714396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.714367    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4" event={"ID":"913f3b7e-881e-4244-ae26-833ee0651e48","Type":"ContainerDied","Data":"4bcc2fc1bc0dea07b43f8bccde1d5627b118d0b8b4772c23277ef456ad06c01d"}
Jul 02 20:18:57.714396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.714392    2546 scope.go:117] "RemoveContainer" containerID="4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"
Jul 02 20:18:57.727612 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.727593    2546 scope.go:117] "RemoveContainer" containerID="4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"
Jul 02 20:18:57.727885 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:18:57.727866    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6\": container with ID starting with 4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6 not found: ID does not exist" containerID="4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"
Jul 02 20:18:57.727947 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.727893    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6"} err="failed to get container status \"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6\": rpc error: code = NotFound desc = could not find container \"4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6\": container with ID starting with 4ee8ae8d146091436fd42efc615854c62b96adc6c00a4446f3d8b4ca60efe1d6 not found: ID does not exist"
Jul 02 20:18:57.738084 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.738044    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:57.743778 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:57.743723    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-448329fe-5644f586cc-jbbc4"]
Jul 02 20:18:59.203173 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:18:59.203141    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913f3b7e-881e-4244-ae26-833ee0651e48" path="/var/lib/kubelet/pods/913f3b7e-881e-4244-ae26-833ee0651e48/volumes"
Jul 02 20:19:03.257160 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:03.257126    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:19:03.257717 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:03.257326    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" podUID="9c8cf709-2ec3-4347-9423-1120a50e1575" containerName="istio-proxy" containerID="cri-o://8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf" gracePeriod=30
Jul 02 20:19:08.519072 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.518986    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:19:08.600306 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600270    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600491 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600346    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600491 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600373    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600491 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600400    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600491 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600466    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhkdc\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600533    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600574    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600613    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:08.600673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600636    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600661    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data\") pod \"9c8cf709-2ec3-4347-9423-1120a50e1575\" (UID: \"9c8cf709-2ec3-4347-9423-1120a50e1575\") "
Jul 02 20:19:08.600956 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600688    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:08.600956 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600920    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.600956 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.600935    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.601158 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.601044    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:08.601220 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.601152    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:08.601394 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.601365    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:19:08.602606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.602580    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:08.602764 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.602739    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc" (OuterVolumeSpecName: "kube-api-access-lhkdc") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "kube-api-access-lhkdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:08.602885 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.602863    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:19:08.602984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.602967    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c8cf709-2ec3-4347-9423-1120a50e1575" (UID: "9c8cf709-2ec3-4347-9423-1120a50e1575"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:08.701455 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701416    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8cf709-2ec3-4347-9423-1120a50e1575-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701455 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701451    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701455 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701461    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701470    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701477    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701485    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhkdc\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-kube-api-access-lhkdc\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.701705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.701494    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8cf709-2ec3-4347-9423-1120a50e1575-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:08.771127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.771001    2546 generic.go:356] "Generic (PLEG): container finished" podID="9c8cf709-2ec3-4347-9423-1120a50e1575" containerID="8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf" exitCode=0
Jul 02 20:19:08.771127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.771051    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"
Jul 02 20:19:08.771127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.771087    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" event={"ID":"9c8cf709-2ec3-4347-9423-1120a50e1575","Type":"ContainerDied","Data":"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"}
Jul 02 20:19:08.771381 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.771146    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr" event={"ID":"9c8cf709-2ec3-4347-9423-1120a50e1575","Type":"ContainerDied","Data":"93653d65ae750e658afbaa614a7d9afc72cc875561656ea6f5c3254e91e27fbe"}
Jul 02 20:19:08.771381 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.771171    2546 scope.go:117] "RemoveContainer" containerID="8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"
Jul 02 20:19:08.781186 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.781168    2546 scope.go:117] "RemoveContainer" containerID="8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"
Jul 02 20:19:08.781471 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:19:08.781452    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf\": container with ID starting with 8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf not found: ID does not exist" containerID="8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"
Jul 02 20:19:08.781610 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.781477    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf"} err="failed to get container status \"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf\": rpc error: code = NotFound desc = could not find container \"8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf\": container with ID starting with 8b883f20fa68b368427681453a32d179fddb304860006242d7e224d2af3acadf not found: ID does not exist"
Jul 02 20:19:08.791512 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.791481    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:19:08.797379 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:08.797351    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-448329fe-openshift-default-cb6878f57-457fr"]
Jul 02 20:19:09.203440 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.203406    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8cf709-2ec3-4347-9423-1120a50e1575" path="/var/lib/kubelet/pods/9c8cf709-2ec3-4347-9423-1120a50e1575/volumes"
Jul 02 20:19:09.471716 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.471632    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:09.472325 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472303    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8cf709-2ec3-4347-9423-1120a50e1575" containerName="istio-proxy"
Jul 02 20:19:09.472380 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472330    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8cf709-2ec3-4347-9423-1120a50e1575" containerName="istio-proxy"
Jul 02 20:19:09.472380 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472344    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913f3b7e-881e-4244-ae26-833ee0651e48" containerName="maas-api"
Jul 02 20:19:09.472380 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472353    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="913f3b7e-881e-4244-ae26-833ee0651e48" containerName="maas-api"
Jul 02 20:19:09.472483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472458    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="913f3b7e-881e-4244-ae26-833ee0651e48" containerName="maas-api"
Jul 02 20:19:09.472483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.472475    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8cf709-2ec3-4347-9423-1120a50e1575" containerName="istio-proxy"
Jul 02 20:19:09.477537 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.477511    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.479824 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.479802    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-002af921-openshift-default-dockercfg-nzt9n\""
Jul 02 20:19:09.486393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.486369    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:09.609284 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609244    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609297    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609362    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2bz\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609398    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609422    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609447    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609554    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609578    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.609693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.609600    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.710974 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.710932    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.710974 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.710984    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711012    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2bz\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711049    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711101    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711133    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711182    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711209    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711238    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711628    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711652    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711755    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.711874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.711766    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.712082 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.712040    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.713478 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.713448    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.713643 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.713627    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.718733 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.718708    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2bz\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.718826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.718717    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token\") pod \"e2e-derive-002af921-openshift-default-5b77b74795-zks2g\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") " pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.790304 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.790196    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:09.941882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.941827    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:09.944223 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:19:09.944184    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c637ea0_70e2_4d1e_bc08_582e75487a8a.slice/crio-793b8b27f20b936da001e20e0eb1ae91fb4da6c92a2841d5c47ba1d1d4a0f2fc WatchSource:0}: Error finding container 793b8b27f20b936da001e20e0eb1ae91fb4da6c92a2841d5c47ba1d1d4a0f2fc: Status 404 returned error can't find the container with id 793b8b27f20b936da001e20e0eb1ae91fb4da6c92a2841d5c47ba1d1d4a0f2fc
Jul 02 20:19:09.946563 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.946523    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:19:09.946641 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.946617    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:19:09.946682 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:09.946662    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:19:10.758679 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.758644    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:10.762407 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.762380    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.764648 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.764619    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-002af921-serving-cert\""
Jul 02 20:19:10.772127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.772098    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:10.785559 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.785524    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" event={"ID":"4c637ea0-70e2-4d1e-bc08-582e75487a8a","Type":"ContainerStarted","Data":"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"}
Jul 02 20:19:10.785755 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.785594    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" event={"ID":"4c637ea0-70e2-4d1e-bc08-582e75487a8a","Type":"ContainerStarted","Data":"793b8b27f20b936da001e20e0eb1ae91fb4da6c92a2841d5c47ba1d1d4a0f2fc"}
Jul 02 20:19:10.790789 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.790757    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:10.812806 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.812749    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" podStartSLOduration=1.8127326259999998 podStartE2EDuration="1.812732626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:10.810425428 +0000 UTC m=+1524.066502829" watchObservedRunningTime="2026-07-02 20:19:10.812732626 +0000 UTC m=+1524.068810097"
Jul 02 20:19:10.822233 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.822204    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hlm\" (UniqueName: \"kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.822233 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.822237    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.822454 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.822380    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.923883 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.923841    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.924151 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.924025    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.924231 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.924148    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hlm\" (UniqueName: \"kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.924730 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.924703    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.926744 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.926721    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:10.932951 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:10.932915    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hlm\" (UniqueName: \"kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm\") pod \"maas-api-e2e-derive-002af921-6f6dfd69f4-w67df\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") " pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:11.074632 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.074598    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:11.227030 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.226873    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:11.230457 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:19:11.230420    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bef46f_3ad6_40bb_b7a2_87d0487833b6.slice/crio-a6de5ec4566d6d0113454d1e47170ae5132f528a7058644590ac629f22a02a1d WatchSource:0}: Error finding container a6de5ec4566d6d0113454d1e47170ae5132f528a7058644590ac629f22a02a1d: Status 404 returned error can't find the container with id a6de5ec4566d6d0113454d1e47170ae5132f528a7058644590ac629f22a02a1d
Jul 02 20:19:11.792493 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.792444    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" event={"ID":"62bef46f-3ad6-40bb-b7a2-87d0487833b6","Type":"ContainerStarted","Data":"4bf2300a01998755d71e594ef47640d75f2668b889e5c8846b7ecd3a21cdb586"}
Jul 02 20:19:11.792921 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.792544    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" event={"ID":"62bef46f-3ad6-40bb-b7a2-87d0487833b6","Type":"ContainerStarted","Data":"a6de5ec4566d6d0113454d1e47170ae5132f528a7058644590ac629f22a02a1d"}
Jul 02 20:19:11.792921 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.792605    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:11.796259 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.796233    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:11.822081 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:11.821949    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" podStartSLOduration=1.482281434 podStartE2EDuration="1.821931763s" totalImagesPullingTime="339.650329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:11.819412615 +0000 UTC m=+1525.075490019" watchObservedRunningTime="2026-07-02 20:19:11.821931763 +0000 UTC m=+1525.078009141"
Jul 02 20:19:12.797466 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:12.797433    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:12.798520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:12.798501    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:15.436364 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.436314    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:15.643320 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.643270    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:15.643567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.643528    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" podUID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" containerName="maas-api" containerID="cri-o://4bf2300a01998755d71e594ef47640d75f2668b889e5c8846b7ecd3a21cdb586" gracePeriod=30
Jul 02 20:19:15.815069 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.815018    2546 generic.go:356] "Generic (PLEG): container finished" podID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" containerID="4bf2300a01998755d71e594ef47640d75f2668b889e5c8846b7ecd3a21cdb586" exitCode=0
Jul 02 20:19:15.815218 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.815089    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" event={"ID":"62bef46f-3ad6-40bb-b7a2-87d0487833b6","Type":"ContainerDied","Data":"4bf2300a01998755d71e594ef47640d75f2668b889e5c8846b7ecd3a21cdb586"}
Jul 02 20:19:15.815290 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.815274    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" podUID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" containerName="istio-proxy" containerID="cri-o://b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e" gracePeriod=30
Jul 02 20:19:15.962621 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:15.962593    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:16.078100 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.078038    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls\") pod \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") "
Jul 02 20:19:16.078282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.078140    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4hlm\" (UniqueName: \"kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm\") pod \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") "
Jul 02 20:19:16.078282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.078201    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca\") pod \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\" (UID: \"62bef46f-3ad6-40bb-b7a2-87d0487833b6\") "
Jul 02 20:19:16.078527 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.078499    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62bef46f-3ad6-40bb-b7a2-87d0487833b6" (UID: "62bef46f-3ad6-40bb-b7a2-87d0487833b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:19:16.080240 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.080211    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62bef46f-3ad6-40bb-b7a2-87d0487833b6" (UID: "62bef46f-3ad6-40bb-b7a2-87d0487833b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:19:16.080336 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.080315    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm" (OuterVolumeSpecName: "kube-api-access-p4hlm") pod "62bef46f-3ad6-40bb-b7a2-87d0487833b6" (UID: "62bef46f-3ad6-40bb-b7a2-87d0487833b6"). InnerVolumeSpecName "kube-api-access-p4hlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:16.179389 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.179337    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bef46f-3ad6-40bb-b7a2-87d0487833b6-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:16.179389 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.179381    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bef46f-3ad6-40bb-b7a2-87d0487833b6-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:16.179389 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.179391    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4hlm\" (UniqueName: \"kubernetes.io/projected/62bef46f-3ad6-40bb-b7a2-87d0487833b6-kube-api-access-p4hlm\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:16.822660 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.822628    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"
Jul 02 20:19:16.823110 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.822662    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df" event={"ID":"62bef46f-3ad6-40bb-b7a2-87d0487833b6","Type":"ContainerDied","Data":"a6de5ec4566d6d0113454d1e47170ae5132f528a7058644590ac629f22a02a1d"}
Jul 02 20:19:16.823110 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.822726    2546 scope.go:117] "RemoveContainer" containerID="4bf2300a01998755d71e594ef47640d75f2668b889e5c8846b7ecd3a21cdb586"
Jul 02 20:19:16.853114 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.853073    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:16.855600 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:16.855564    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-002af921-6f6dfd69f4-w67df"]
Jul 02 20:19:17.210685 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:17.210649    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" path="/var/lib/kubelet/pods/62bef46f-3ad6-40bb-b7a2-87d0487833b6/volumes"
Jul 02 20:19:21.083984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.083956    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:21.230125 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230025    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230125 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230085    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230155    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230195    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230218    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230296    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230553 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230410    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:21.230553 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230472    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:19:21.230553 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230517    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl2bz\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230619    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:21.230720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230644    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230673    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy\") pod \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\" (UID: \"4c637ea0-70e2-4d1e-bc08-582e75487a8a\") "
Jul 02 20:19:21.230958 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.230932    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:21.231049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.231025    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.231049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.231042    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.231184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.231071    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.231184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.231076    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:21.231184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.231085    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.232637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.232612    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:21.232755 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.232740    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz" (OuterVolumeSpecName: "kube-api-access-kl2bz") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "kube-api-access-kl2bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:21.232822 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.232781    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:19:21.232870 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.232848    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c637ea0-70e2-4d1e-bc08-582e75487a8a" (UID: "4c637ea0-70e2-4d1e-bc08-582e75487a8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:19:21.332530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.332485    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.332530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.332519    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.332530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.332528    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.332530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.332536    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl2bz\" (UniqueName: \"kubernetes.io/projected/4c637ea0-70e2-4d1e-bc08-582e75487a8a-kube-api-access-kl2bz\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.332807 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.332547    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c637ea0-70e2-4d1e-bc08-582e75487a8a-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:19:21.852203 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.852167    2546 generic.go:356] "Generic (PLEG): container finished" podID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" containerID="b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e" exitCode=0
Jul 02 20:19:21.852395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.852224    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"
Jul 02 20:19:21.852395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.852257    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" event={"ID":"4c637ea0-70e2-4d1e-bc08-582e75487a8a","Type":"ContainerDied","Data":"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"}
Jul 02 20:19:21.852395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.852315    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g" event={"ID":"4c637ea0-70e2-4d1e-bc08-582e75487a8a","Type":"ContainerDied","Data":"793b8b27f20b936da001e20e0eb1ae91fb4da6c92a2841d5c47ba1d1d4a0f2fc"}
Jul 02 20:19:21.852395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.852348    2546 scope.go:117] "RemoveContainer" containerID="b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"
Jul 02 20:19:21.864858 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.864839    2546 scope.go:117] "RemoveContainer" containerID="b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"
Jul 02 20:19:21.865226 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:19:21.865202    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e\": container with ID starting with b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e not found: ID does not exist" containerID="b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"
Jul 02 20:19:21.865314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.865240    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e"} err="failed to get container status \"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e\": rpc error: code = NotFound desc = could not find container \"b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e\": container with ID starting with b2a8564375bdd89b23ab3b43705c23133981da5068055298672e6dc120a4c35e not found: ID does not exist"
Jul 02 20:19:21.878210 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.878177    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:21.881307 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:21.881282    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-002af921-openshift-default-5b77b74795-zks2g"]
Jul 02 20:19:23.203720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:19:23.203678    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" path="/var/lib/kubelet/pods/4c637ea0-70e2-4d1e-bc08-582e75487a8a/volumes"
Jul 02 20:20:56.382310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382280    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:20:56.382782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382711    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" containerName="maas-api"
Jul 02 20:20:56.382782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382724    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" containerName="maas-api"
Jul 02 20:20:56.382782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382741    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" containerName="istio-proxy"
Jul 02 20:20:56.382782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382748    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" containerName="istio-proxy"
Jul 02 20:20:56.382913 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382831    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c637ea0-70e2-4d1e-bc08-582e75487a8a" containerName="istio-proxy"
Jul 02 20:20:56.382913 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.382841    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bef46f-3ad6-40bb-b7a2-87d0487833b6" containerName="maas-api"
Jul 02 20:20:56.385804 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.385789    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.388185 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.388160    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e4cd2f77-openshift-default-dockercfg-ml6qc\""
Jul 02 20:20:56.402157 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402134    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402267 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402166    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402267 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402187    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402267 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402233    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402270    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402313    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402370 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402351    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hh9w\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402461 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402374    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.402461 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.402409    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.406934 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.406909    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:20:56.503235 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503193    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503429 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503315    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503429 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503343    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503429 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503360    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503429 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503385    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503473    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503525    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503553    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hh9w\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503609 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503583    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503814 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503682    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503814 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503734    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.503814 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.503777    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.504075 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.504040    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.504164 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.504094    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.505954 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.505937    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.506101 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.506086    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.511349 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.511318    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.511970 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.511948    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hh9w\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w\") pod \"e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") " pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.696765 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.696671    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:56.839461 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.839402    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:20:56.842539 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:20:56.842498    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc59f4d2_c41b_42f7_8c9b_e1d23b522485.slice/crio-b5bdea209b6be19d5ea9d4b445fd7bba67a494711eb9cb1d1bbf9dae3dbeade7 WatchSource:0}: Error finding container b5bdea209b6be19d5ea9d4b445fd7bba67a494711eb9cb1d1bbf9dae3dbeade7: Status 404 returned error can't find the container with id b5bdea209b6be19d5ea9d4b445fd7bba67a494711eb9cb1d1bbf9dae3dbeade7
Jul 02 20:20:56.844782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.844746    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:20:56.844903 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.844828    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:20:56.844903 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:56.844876    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:20:57.339449 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:57.339404    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerStarted","Data":"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"}
Jul 02 20:20:57.339627 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:57.339481    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerStarted","Data":"b5bdea209b6be19d5ea9d4b445fd7bba67a494711eb9cb1d1bbf9dae3dbeade7"}
Jul 02 20:20:57.361254 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:57.361202    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podStartSLOduration=1.361186626 podStartE2EDuration="1.361186626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:57.358424844 +0000 UTC m=+1630.614502254" watchObservedRunningTime="2026-07-02 20:20:57.361186626 +0000 UTC m=+1630.617264004"
Jul 02 20:20:57.697925 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:57.697832    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:57.702933 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:57.702908    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:58.344644 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:58.344613    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:58.345647 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:58.345626    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:20:59.450352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.450317    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:20:59.454201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.454180    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.457442 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.457425    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-e4cd2f77-serving-cert\""
Jul 02 20:20:59.466933 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.466912    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:20:59.531720 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.531685    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.531885 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.531744    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.531885 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.531807    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjn5\" (UniqueName: \"kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.632512 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.632476    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.632695 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.632559    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.632695 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.632584    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjn5\" (UniqueName: \"kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.632695 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:20:59.632626    2546 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-e4cd2f77-serving-cert: secret "maas-api-e2e-mt-e4cd2f77-serving-cert" not found
Jul 02 20:20:59.632695 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:20:59.632693    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls podName:97755fa3-5d73-4ffd-9ef3-6b1974c38165 nodeName:}" failed. No retries permitted until 2026-07-02 20:21:00.132669713 +0000 UTC m=+1633.388747082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls") pod "maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" (UID: "97755fa3-5d73-4ffd-9ef3-6b1974c38165") : secret "maas-api-e2e-mt-e4cd2f77-serving-cert" not found
Jul 02 20:20:59.633222 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.633202    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:20:59.643007 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:20:59.642982    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjn5\" (UniqueName: \"kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:00.138079 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:00.138034    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:00.140657 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:00.140633    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") pod \"maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") " pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:00.364619 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:00.364586    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:00.503443 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:00.503414    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:21:00.505649 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:21:00.505619    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97755fa3_5d73_4ffd_9ef3_6b1974c38165.slice/crio-52235c5bff3924bb1374c18aa5631384b43c2912d2732099496758f698341e60 WatchSource:0}: Error finding container 52235c5bff3924bb1374c18aa5631384b43c2912d2732099496758f698341e60: Status 404 returned error can't find the container with id 52235c5bff3924bb1374c18aa5631384b43c2912d2732099496758f698341e60
Jul 02 20:21:01.361957 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:01.361918    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" event={"ID":"97755fa3-5d73-4ffd-9ef3-6b1974c38165","Type":"ContainerStarted","Data":"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"}
Jul 02 20:21:01.362172 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:01.361976    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" event={"ID":"97755fa3-5d73-4ffd-9ef3-6b1974c38165","Type":"ContainerStarted","Data":"52235c5bff3924bb1374c18aa5631384b43c2912d2732099496758f698341e60"}
Jul 02 20:21:01.362172 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:01.362024    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:01.380349 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:01.380304    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" podStartSLOduration=1.930919528 podStartE2EDuration="2.38028753s" totalImagesPullingTime="449.368002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:21:01.378644459 +0000 UTC m=+1634.634721861" watchObservedRunningTime="2026-07-02 20:21:01.38028753 +0000 UTC m=+1634.636364908"
Jul 02 20:21:07.374390 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:07.374362    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:11.615302 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.615229    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:21:11.616033 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.615785    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" podUID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" containerName="maas-api" containerID="cri-o://d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50" gracePeriod=30
Jul 02 20:21:11.882811 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.882786    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:11.952668 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.952634    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca\") pod \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") "
Jul 02 20:21:11.952882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.952759    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwjn5\" (UniqueName: \"kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5\") pod \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") "
Jul 02 20:21:11.952882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.952807    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") pod \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\" (UID: \"97755fa3-5d73-4ffd-9ef3-6b1974c38165\") "
Jul 02 20:21:11.953072 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.953033    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97755fa3-5d73-4ffd-9ef3-6b1974c38165" (UID: "97755fa3-5d73-4ffd-9ef3-6b1974c38165"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:21:11.954938 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.954909    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97755fa3-5d73-4ffd-9ef3-6b1974c38165" (UID: "97755fa3-5d73-4ffd-9ef3-6b1974c38165"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:21:11.955090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:11.954935    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5" (OuterVolumeSpecName: "kube-api-access-gwjn5") pod "97755fa3-5d73-4ffd-9ef3-6b1974c38165" (UID: "97755fa3-5d73-4ffd-9ef3-6b1974c38165"). InnerVolumeSpecName "kube-api-access-gwjn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:21:12.053538 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.053496    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwjn5\" (UniqueName: \"kubernetes.io/projected/97755fa3-5d73-4ffd-9ef3-6b1974c38165-kube-api-access-gwjn5\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:12.053538 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.053527    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97755fa3-5d73-4ffd-9ef3-6b1974c38165-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:12.053538 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.053536    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97755fa3-5d73-4ffd-9ef3-6b1974c38165-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:12.418926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.418890    2546 generic.go:356] "Generic (PLEG): container finished" podID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" containerID="d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50" exitCode=0
Jul 02 20:21:12.419161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.418957    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"
Jul 02 20:21:12.419161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.418981    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" event={"ID":"97755fa3-5d73-4ffd-9ef3-6b1974c38165","Type":"ContainerDied","Data":"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"}
Jul 02 20:21:12.419161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.419055    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f" event={"ID":"97755fa3-5d73-4ffd-9ef3-6b1974c38165","Type":"ContainerDied","Data":"52235c5bff3924bb1374c18aa5631384b43c2912d2732099496758f698341e60"}
Jul 02 20:21:12.419161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.419098    2546 scope.go:117] "RemoveContainer" containerID="d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"
Jul 02 20:21:12.429991 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.429966    2546 scope.go:117] "RemoveContainer" containerID="d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"
Jul 02 20:21:12.430352 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:21:12.430332    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50\": container with ID starting with d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50 not found: ID does not exist" containerID="d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"
Jul 02 20:21:12.430423 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.430361    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50"} err="failed to get container status \"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50\": rpc error: code = NotFound desc = could not find container \"d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50\": container with ID starting with d4fb62e039fe2f132a20f59ee05f88785e7902e13fde58606dcf7d5a26095b50 not found: ID does not exist"
Jul 02 20:21:12.448516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.448485    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:21:12.453032 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:12.453010    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-e4cd2f77-698d58cfff-5kt5f"]
Jul 02 20:21:13.202900 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:13.202864    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" path="/var/lib/kubelet/pods/97755fa3-5d73-4ffd-9ef3-6b1974c38165/volumes"
Jul 02 20:21:13.416202 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:13.415893    2546 patch_prober.go:28] interesting pod/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:33916->10.134.0.59:15021: read: connection reset by peer" start-of-body=
Jul 02 20:21:13.416202 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:13.415975    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:33916->10.134.0.59:15021: read: connection reset by peer"
Jul 02 20:21:14.433196 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.433166    2546 generic.go:356] "Generic (PLEG): container finished" podID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerID="3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced" exitCode=0
Jul 02 20:21:14.433587 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.433241    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerDied","Data":"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"}
Jul 02 20:21:14.433678 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.433664    2546 scope.go:117] "RemoveContainer" containerID="3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"
Jul 02 20:21:14.434690 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.434663    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:14.434752 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.434733    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:14.434790 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:14.434765    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:15.444611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:15.444568    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerStarted","Data":"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"}
Jul 02 20:21:15.697703 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:15.697608    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:21:15.697888 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:15.697857    2546 patch_prober.go:28] interesting pod/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 02 20:21:15.697935 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:15.697905    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 02 20:21:16.697430 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:16.697384    2546 patch_prober.go:28] interesting pod/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 02 20:21:16.697849 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:16.697451    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 02 20:21:17.697647 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:17.697610    2546 patch_prober.go:28] interesting pod/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 02 20:21:17.698131 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:17.697669    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 02 20:21:17.705306 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:17.705274    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:21:17.705524 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:17.705502    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy" containerID="cri-o://c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928" gracePeriod=30
Jul 02 20:21:24.669679 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.669651    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:21:24.779534 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779445    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779534 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779488    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779534 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779508    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779538    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779580    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779613    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779694    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hh9w\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779741    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.779809 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779765    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:24.780133 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779828    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy\") pod \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\" (UID: \"bc59f4d2-c41b-42f7-8c9b-e1d23b522485\") "
Jul 02 20:21:24.780133 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.779938    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:24.780133 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780006    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:21:24.780133 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780034    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:24.780288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780274    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.780352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780296    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.780352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780310    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.780352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780323    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.780597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.780572    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:24.781864 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.781842    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:24.781974 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.781907    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:21:24.781974 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.781919    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:21:24.782165 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.781994    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w" (OuterVolumeSpecName: "kube-api-access-5hh9w") pod "bc59f4d2-c41b-42f7-8c9b-e1d23b522485" (UID: "bc59f4d2-c41b-42f7-8c9b-e1d23b522485"). InnerVolumeSpecName "kube-api-access-5hh9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:21:24.881365 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.881325    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.881365 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.881358    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hh9w\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-kube-api-access-5hh9w\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.881365 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.881372    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.881603 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.881384    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:24.881603 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:24.881394    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc59f4d2-c41b-42f7-8c9b-e1d23b522485-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:21:25.500094 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.499976    2546 generic.go:356] "Generic (PLEG): container finished" podID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerID="c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928" exitCode=0
Jul 02 20:21:25.500094 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.500030    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"
Jul 02 20:21:25.500094 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.500042    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerDied","Data":"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"}
Jul 02 20:21:25.500383 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.500105    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z" event={"ID":"bc59f4d2-c41b-42f7-8c9b-e1d23b522485","Type":"ContainerDied","Data":"b5bdea209b6be19d5ea9d4b445fd7bba67a494711eb9cb1d1bbf9dae3dbeade7"}
Jul 02 20:21:25.500383 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.500132    2546 scope.go:117] "RemoveContainer" containerID="c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"
Jul 02 20:21:25.509068 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.509040    2546 scope.go:117] "RemoveContainer" containerID="3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"
Jul 02 20:21:25.516938 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.516919    2546 scope.go:117] "RemoveContainer" containerID="c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"
Jul 02 20:21:25.517301 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:21:25.517272    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928\": container with ID starting with c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928 not found: ID does not exist" containerID="c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"
Jul 02 20:21:25.517393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.517310    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928"} err="failed to get container status \"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928\": rpc error: code = NotFound desc = could not find container \"c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928\": container with ID starting with c952d2211856a4b6e1b460e28e452b91175e00934f86e7429c5adaf3f8045928 not found: ID does not exist"
Jul 02 20:21:25.517393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.517332    2546 scope.go:117] "RemoveContainer" containerID="3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"
Jul 02 20:21:25.517677 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:21:25.517645    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced\": container with ID starting with 3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced not found: ID does not exist" containerID="3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"
Jul 02 20:21:25.517764 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.517687    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced"} err="failed to get container status \"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced\": rpc error: code = NotFound desc = could not find container \"3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced\": container with ID starting with 3da1a79c76d6e561cc0ac9d1deab965dedaccbaa7e0658388b6d55689a833ced not found: ID does not exist"
Jul 02 20:21:25.520036 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.520008    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:21:25.521883 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:25.521861    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e4cd2f77-openshift-default-6c947bb8ff-ncw9z"]
Jul 02 20:21:27.209361 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:27.209328    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" path="/var/lib/kubelet/pods/bc59f4d2-c41b-42f7-8c9b-e1d23b522485/volumes"
Jul 02 20:21:36.613684 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.613645    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:21:36.614317 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614297    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" containerName="maas-api"
Jul 02 20:21:36.614402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614320    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" containerName="maas-api"
Jul 02 20:21:36.614402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614344    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:36.614402 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614351    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:36.614516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614418    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="97755fa3-5d73-4ffd-9ef3-6b1974c38165" containerName="maas-api"
Jul 02 20:21:36.614516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614428    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:36.614516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.614435    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:36.618900 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.618880    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.621371 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.621346    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-28e92a3e-openshift-default-dockercfg-8gcxp\""
Jul 02 20:21:36.630265 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.630244    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:21:36.688453 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688405    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688602 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688457    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688602 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688536    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688602 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688583    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688602 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688599    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688775 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688630    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688775 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688722    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmpfs\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688775 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688751    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.688775 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.688768    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789437 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789389    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789437 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789438    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789462    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789509    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmpfs\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789542    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789565    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789603    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789625    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789997 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789704    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.789997 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789938    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.790085 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.789992    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.790306 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.790287    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.790358 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.790317    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.790394 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.790376    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.791643 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.791613    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.791843 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.791827    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.800987 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.800966    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.801483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.801461    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmpfs\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs\") pod \"e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") " pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:36.929912 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:36.929833    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:37.080909 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.080884    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:21:37.082102 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:21:37.082055    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a440d6f_ba74_4060_843e_afd067e733b0.slice/crio-e9cd0c626cd3e08eb5145dae4c5e1633c5ada43ed869c287223881b4864051ce WatchSource:0}: Error finding container e9cd0c626cd3e08eb5145dae4c5e1633c5ada43ed869c287223881b4864051ce: Status 404 returned error can't find the container with id e9cd0c626cd3e08eb5145dae4c5e1633c5ada43ed869c287223881b4864051ce
Jul 02 20:21:37.084283 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.084251    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:37.084338 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.084316    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:37.084424 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.084347    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:37.563089 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.563045    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerStarted","Data":"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"}
Jul 02 20:21:37.563280 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.563112    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerStarted","Data":"e9cd0c626cd3e08eb5145dae4c5e1633c5ada43ed869c287223881b4864051ce"}
Jul 02 20:21:37.590793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.590732    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podStartSLOduration=1.590714408 podStartE2EDuration="1.590714408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:21:37.589989282 +0000 UTC m=+1670.846066661" watchObservedRunningTime="2026-07-02 20:21:37.590714408 +0000 UTC m=+1670.846791789"
Jul 02 20:21:37.930517 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:37.930470    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:38.935421 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:38.935390    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:39.573953 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.573924    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:39.574787 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.574769    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:39.803939 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.803906    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:21:39.804351 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.804337    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:39.804403 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.804353    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc59f4d2-c41b-42f7-8c9b-e1d23b522485" containerName="istio-proxy"
Jul 02 20:21:39.807575 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.807557    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.811108 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.811087    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-28e92a3e-serving-cert\""
Jul 02 20:21:39.811337 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.811314    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.811470 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.811344    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.811470 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.811439    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2b2\" (UniqueName: \"kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.817913 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.817888    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:21:39.912268 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.912170    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.912268 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.912221    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.912570 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.912308    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2b2\" (UniqueName: \"kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.912570 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:21:39.912345    2546 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-28e92a3e-serving-cert: secret "maas-api-e2e-mt-28e92a3e-serving-cert" not found
Jul 02 20:21:39.912570 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:21:39.912449    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls podName:2fe910ef-3575-481a-87fa-d5e91a2523ba nodeName:}" failed. No retries permitted until 2026-07-02 20:21:40.412425023 +0000 UTC m=+1673.668502391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls") pod "maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" (UID: "2fe910ef-3575-481a-87fa-d5e91a2523ba") : secret "maas-api-e2e-mt-28e92a3e-serving-cert" not found
Jul 02 20:21:39.913144 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.913122    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:39.922734 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:39.922688    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2b2\" (UniqueName: \"kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:40.417042 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:40.417008    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:40.419417 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:40.419384    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") pod \"maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") " pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:40.419558 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:40.419530    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:40.561857 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:40.561826    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:21:40.562581 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:21:40.562559    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe910ef_3575_481a_87fa_d5e91a2523ba.slice/crio-5356b60524d0e936f3621391653c18b1340fcf0acd1b925f133a080ce69b7987 WatchSource:0}: Error finding container 5356b60524d0e936f3621391653c18b1340fcf0acd1b925f133a080ce69b7987: Status 404 returned error can't find the container with id 5356b60524d0e936f3621391653c18b1340fcf0acd1b925f133a080ce69b7987
Jul 02 20:21:40.580530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:40.580498    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" event={"ID":"2fe910ef-3575-481a-87fa-d5e91a2523ba","Type":"ContainerStarted","Data":"5356b60524d0e936f3621391653c18b1340fcf0acd1b925f133a080ce69b7987"}
Jul 02 20:21:41.587121 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:41.587088    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" event={"ID":"2fe910ef-3575-481a-87fa-d5e91a2523ba","Type":"ContainerStarted","Data":"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"}
Jul 02 20:21:41.587515 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:41.587308    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:41.604642 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:41.604566    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" podStartSLOduration=2.2601964199999998 podStartE2EDuration="2.604550656s" totalImagesPullingTime="344.354236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:21:41.603611793 +0000 UTC m=+1674.859689174" watchObservedRunningTime="2026-07-02 20:21:41.604550656 +0000 UTC m=+1674.860628034"
Jul 02 20:21:47.597540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:47.597514    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:21:52.643352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.643266    2546 generic.go:356] "Generic (PLEG): container finished" podID="4a440d6f-ba74-4060-843e-afd067e733b0" containerID="e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa" exitCode=0
Jul 02 20:21:52.643804 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.643340    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerDied","Data":"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"}
Jul 02 20:21:52.643804 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.643765    2546 scope.go:117] "RemoveContainer" containerID="e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"
Jul 02 20:21:52.644828 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.644795    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:52.644947 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.644919    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:52.644986 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:52.644974    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:21:53.655255 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:53.655210    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerStarted","Data":"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"}
Jul 02 20:21:53.931186 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:53.931076    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:53.932278 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:53.932241    2546 patch_prober.go:28] interesting pod/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 02 20:21:53.932434 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:53.932302    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 02 20:21:54.574919 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:54.574884    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:54.930929 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:54.930820    2546 patch_prober.go:28] interesting pod/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 02 20:21:54.930929 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:54.930889    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 02 20:21:55.930781 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:55.930741    2546 patch_prober.go:28] interesting pod/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 02 20:21:55.931105 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:55.931049    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 02 20:21:56.930964 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:56.930914    2546 patch_prober.go:28] interesting pod/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 02 20:21:56.931211 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:56.931010    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 02 20:21:57.934525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:57.934495    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:21:57.935430 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:21:57.935411    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:22:27.505565 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.505474    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:22:27.506130 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.505716    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerName="maas-api" containerID="cri-o://5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce" gracePeriod=30
Jul 02 20:22:27.592441 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.592389    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.62:8443/health\": dial tcp 10.134.0.62:8443: connect: connection refused"
Jul 02 20:22:27.753701 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.753677    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:22:27.833612 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.833575    2546 generic.go:356] "Generic (PLEG): container finished" podID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerID="5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce" exitCode=0
Jul 02 20:22:27.833781 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.833634    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"
Jul 02 20:22:27.833781 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.833645    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" event={"ID":"2fe910ef-3575-481a-87fa-d5e91a2523ba","Type":"ContainerDied","Data":"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"}
Jul 02 20:22:27.833781 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.833687    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv" event={"ID":"2fe910ef-3575-481a-87fa-d5e91a2523ba","Type":"ContainerDied","Data":"5356b60524d0e936f3621391653c18b1340fcf0acd1b925f133a080ce69b7987"}
Jul 02 20:22:27.833781 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.833708    2546 scope.go:117] "RemoveContainer" containerID="5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"
Jul 02 20:22:27.842264 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.842188    2546 scope.go:117] "RemoveContainer" containerID="5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"
Jul 02 20:22:27.842461 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:22:27.842439    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce\": container with ID starting with 5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce not found: ID does not exist" containerID="5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"
Jul 02 20:22:27.842515 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.842469    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce"} err="failed to get container status \"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce\": rpc error: code = NotFound desc = could not find container \"5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce\": container with ID starting with 5bbc91c4a46a12f4fea17c0720b81da9fed64aff293782b8a36032de01a386ce not found: ID does not exist"
Jul 02 20:22:27.891664 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.891630    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") pod \"2fe910ef-3575-481a-87fa-d5e91a2523ba\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") "
Jul 02 20:22:27.891826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.891675    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr2b2\" (UniqueName: \"kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2\") pod \"2fe910ef-3575-481a-87fa-d5e91a2523ba\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") "
Jul 02 20:22:27.891826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.891713    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca\") pod \"2fe910ef-3575-481a-87fa-d5e91a2523ba\" (UID: \"2fe910ef-3575-481a-87fa-d5e91a2523ba\") "
Jul 02 20:22:27.892247 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.892209    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fe910ef-3575-481a-87fa-d5e91a2523ba" (UID: "2fe910ef-3575-481a-87fa-d5e91a2523ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:22:27.894345 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.894321    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fe910ef-3575-481a-87fa-d5e91a2523ba" (UID: "2fe910ef-3575-481a-87fa-d5e91a2523ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:22:27.894463 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.894339    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2" (OuterVolumeSpecName: "kube-api-access-vr2b2") pod "2fe910ef-3575-481a-87fa-d5e91a2523ba" (UID: "2fe910ef-3575-481a-87fa-d5e91a2523ba"). InnerVolumeSpecName "kube-api-access-vr2b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:22:27.992836 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.992804    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fe910ef-3575-481a-87fa-d5e91a2523ba-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:22:27.992836 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.992835    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr2b2\" (UniqueName: \"kubernetes.io/projected/2fe910ef-3575-481a-87fa-d5e91a2523ba-kube-api-access-vr2b2\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:22:27.993079 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:27.992848    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe910ef-3575-481a-87fa-d5e91a2523ba-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:22:28.155567 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:28.155538    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:22:28.160669 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:28.160645    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-28e92a3e-747fc7dc64-74htv"]
Jul 02 20:22:29.203540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:22:29.203506    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" path="/var/lib/kubelet/pods/2fe910ef-3575-481a-87fa-d5e91a2523ba/volumes"
Jul 02 20:23:27.523040 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:27.523002    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:23:27.523555 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:27.523310    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" containerID="cri-o://d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de" gracePeriod=30
Jul 02 20:23:27.937089 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:27.937026    2546 patch_prober.go:28] interesting pod/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 20:23:27.937251 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:27.937103    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 20:23:32.827029 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.826991    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:23:32.907962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.907921    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.907973    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908005    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908033    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908083    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908112    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908171 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908148    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908180    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908248    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmpfs\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs\") pod \"4a440d6f-ba74-4060-843e-afd067e733b0\" (UID: \"4a440d6f-ba74-4060-843e-afd067e733b0\") "
Jul 02 20:23:32.908483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908276    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:23:32.908483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908399    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:23:32.908693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908550    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:23:32.908793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908769    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:23:32.908793 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908779    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:32.908910 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908811    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:32.908910 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.908827    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a440d6f-ba74-4060-843e-afd067e733b0-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:32.909732 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.909699    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:23:32.910427 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.910397    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:23:32.910555 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.910504    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs" (OuterVolumeSpecName: "kube-api-access-zmpfs") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "kube-api-access-zmpfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:23:32.910669 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.910650    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:23:32.910732 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:32.910679    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a440d6f-ba74-4060-843e-afd067e733b0" (UID: "4a440d6f-ba74-4060-843e-afd067e733b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:23:33.009499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009449    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.009499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009485    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.009499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009494    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a440d6f-ba74-4060-843e-afd067e733b0-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.009499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009505    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmpfs\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-kube-api-access-zmpfs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.009499 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009513    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a440d6f-ba74-4060-843e-afd067e733b0-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.009852 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.009521    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a440d6f-ba74-4060-843e-afd067e733b0-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:23:33.161686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.161651    2546 generic.go:356] "Generic (PLEG): container finished" podID="4a440d6f-ba74-4060-843e-afd067e733b0" containerID="d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de" exitCode=0
Jul 02 20:23:33.161887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.161698    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"
Jul 02 20:23:33.161887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.161728    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerDied","Data":"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"}
Jul 02 20:23:33.161887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.161808    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h" event={"ID":"4a440d6f-ba74-4060-843e-afd067e733b0","Type":"ContainerDied","Data":"e9cd0c626cd3e08eb5145dae4c5e1633c5ada43ed869c287223881b4864051ce"}
Jul 02 20:23:33.161887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.161833    2546 scope.go:117] "RemoveContainer" containerID="d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"
Jul 02 20:23:33.171926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.171908    2546 scope.go:117] "RemoveContainer" containerID="e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"
Jul 02 20:23:33.183867 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.183850    2546 scope.go:117] "RemoveContainer" containerID="d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"
Jul 02 20:23:33.184235 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:23:33.184211    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de\": container with ID starting with d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de not found: ID does not exist" containerID="d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"
Jul 02 20:23:33.184300 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.184244    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de"} err="failed to get container status \"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de\": rpc error: code = NotFound desc = could not find container \"d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de\": container with ID starting with d7b9114b2f2dbac4aeffdaa33ef7f1f0e12dcee85cd90fa96e8648fa1d7651de not found: ID does not exist"
Jul 02 20:23:33.184300 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.184275    2546 scope.go:117] "RemoveContainer" containerID="e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"
Jul 02 20:23:33.184389 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.184364    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:23:33.184552 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:23:33.184534    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa\": container with ID starting with e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa not found: ID does not exist" containerID="e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"
Jul 02 20:23:33.184594 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.184560    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa"} err="failed to get container status \"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa\": rpc error: code = NotFound desc = could not find container \"e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa\": container with ID starting with e0c5c2c4b6e45fe5f928770831024f26c2836de89a982138b3f000088040eafa not found: ID does not exist"
Jul 02 20:23:33.189813 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.189787    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-28e92a3e-openshift-default-7ddc655cc5-8tc5h"]
Jul 02 20:23:33.203541 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:33.203513    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" path="/var/lib/kubelet/pods/4a440d6f-ba74-4060-843e-afd067e733b0/volumes"
Jul 02 20:23:47.241789 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:47.241756    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:23:47.248831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:23:47.248809    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:24:22.862100 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862025    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862432    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerName="maas-api"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862445    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerName="maas-api"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862470    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862477    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862487    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862492    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862565    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862575    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a440d6f-ba74-4060-843e-afd067e733b0" containerName="istio-proxy"
Jul 02 20:24:22.862606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.862581    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fe910ef-3575-481a-87fa-d5e91a2523ba" containerName="maas-api"
Jul 02 20:24:22.865779 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.865764    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.868686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.868665    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-669041-openshift-default-dockercfg-frg69\""
Jul 02 20:24:22.882025 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.881986    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:24:22.964033 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964001    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964234 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964073    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964234 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964130    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964234 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964153    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964234 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964217    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj5h5\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964459 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964315    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964459 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964352    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964459 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964400    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:22.964569 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:22.964467    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.065606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065567    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.065810 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065619    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.065810 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065662    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.065934 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065836    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.065934 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065896    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066029 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065931    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066029 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066029 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.065970    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj5h5\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066219 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066034    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066219 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066138    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066219 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066163    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066370    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066396 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066388    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.066715 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.066689    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.068357 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.068331    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.068646 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.068624    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.074590 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.074570    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.074590 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.074579    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj5h5\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5\") pod \"e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") " pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.176514 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.176404    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:23.323887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.323855    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:24:23.330427 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:24:23.330394    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9ba046_6075_4117_9cf8_5d03fe2c511b.slice/crio-078253a82c4f9ed01ab37ce47c47bc6cf60e45f5bea4369fb3d7d3f2a934df2a WatchSource:0}: Error finding container 078253a82c4f9ed01ab37ce47c47bc6cf60e45f5bea4369fb3d7d3f2a934df2a: Status 404 returned error can't find the container with id 078253a82c4f9ed01ab37ce47c47bc6cf60e45f5bea4369fb3d7d3f2a934df2a
Jul 02 20:24:23.332631 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.332592    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:23.332740 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.332677    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:23.332740 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.332716    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:23.421007 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.420965    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerStarted","Data":"f5a75bd78a19ef62534e5674aae62764eaf9322a8a1afe8c23de9b0661d40faf"}
Jul 02 20:24:23.421205 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.421035    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerStarted","Data":"078253a82c4f9ed01ab37ce47c47bc6cf60e45f5bea4369fb3d7d3f2a934df2a"}
Jul 02 20:24:23.444030 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:23.443909    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podStartSLOduration=1.443890782 podStartE2EDuration="1.443890782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:23.442479185 +0000 UTC m=+1836.698556594" watchObservedRunningTime="2026-07-02 20:24:23.443890782 +0000 UTC m=+1836.699968160"
Jul 02 20:24:24.176924 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:24.176883    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:24.181870 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:24.181840    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:24.427727 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:24.427642    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:24.428589 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:24.428562    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:25.650693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.650660    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:24:25.654477 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.654445    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.658141 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.658118    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-669041-serving-cert\""
Jul 02 20:24:25.667591 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.667564    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:24:25.691543 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.691497    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.691754 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.691632    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5qgp\" (UniqueName: \"kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.691754 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.691669    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.792536 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.792469    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.792698 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.792568    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5qgp\" (UniqueName: \"kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.792698 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.792593    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.792698 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:24:25.792628    2546 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-669041-serving-cert: secret "maas-api-e2e-inf-a-669041-serving-cert" not found
Jul 02 20:24:25.792698 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:24:25.792691    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls podName:7c36688a-2fc3-46d1-85e2-4b61dcac7133 nodeName:}" failed. No retries permitted until 2026-07-02 20:24:26.292672972 +0000 UTC m=+1839.548750333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls") pod "maas-api-e2e-inf-a-669041-655b4449f-mhbtg" (UID: "7c36688a-2fc3-46d1-85e2-4b61dcac7133") : secret "maas-api-e2e-inf-a-669041-serving-cert" not found
Jul 02 20:24:25.793283 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.793265    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:25.802183 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:25.802158    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5qgp\" (UniqueName: \"kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:26.298048 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:26.298009    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:26.300560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:26.300524    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") pod \"maas-api-e2e-inf-a-669041-655b4449f-mhbtg\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") " pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:26.565904 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:26.565794    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:26.718739 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:26.718713    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:24:26.720538 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:24:26.720508    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c36688a_2fc3_46d1_85e2_4b61dcac7133.slice/crio-a9d5f35e6adf3c3a1656d4c6647b58994eee1a8d41081c8eeba0ab917cfabfe3 WatchSource:0}: Error finding container a9d5f35e6adf3c3a1656d4c6647b58994eee1a8d41081c8eeba0ab917cfabfe3: Status 404 returned error can't find the container with id a9d5f35e6adf3c3a1656d4c6647b58994eee1a8d41081c8eeba0ab917cfabfe3
Jul 02 20:24:26.721876 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:26.721859    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:24:27.443596 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:27.443558    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" event={"ID":"7c36688a-2fc3-46d1-85e2-4b61dcac7133","Type":"ContainerStarted","Data":"a9d5f35e6adf3c3a1656d4c6647b58994eee1a8d41081c8eeba0ab917cfabfe3"}
Jul 02 20:24:28.450412 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:28.450374    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" event={"ID":"7c36688a-2fc3-46d1-85e2-4b61dcac7133","Type":"ContainerStarted","Data":"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"}
Jul 02 20:24:28.450851 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:28.450484    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:28.469956 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:28.469900    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" podStartSLOduration=2.782366667 podStartE2EDuration="3.469885274s" totalImagesPullingTime="687.518607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:28.468353258 +0000 UTC m=+1841.724430666" watchObservedRunningTime="2026-07-02 20:24:28.469885274 +0000 UTC m=+1841.725962670"
Jul 02 20:24:30.614637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.614603    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:24:30.618412 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.618391    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.620904 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.620879    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-761cb8-openshift-default-dockercfg-xqdg4\""
Jul 02 20:24:30.637372 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.637340    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:24:30.744647 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.744647 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744652    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.744892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744690    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.744892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744734    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.744892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744761    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.744892 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744832    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.745035 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744923    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjkf\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.745035 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744941    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.745035 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.744959    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.845929 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.845886    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.845929 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.845927    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.845952    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.845984    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846025    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846055    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846116    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846225 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846167    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846542 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846279    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjkf\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846542 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846373    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846542 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846506    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846710 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846552    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846710 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846667    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.846799 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.846779    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.848539 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.848520    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.848852 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.848830    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.855667 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.855641    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjkf\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.855789 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.855734    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token\") pod \"e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") " pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:30.928552 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:30.928435    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:31.076530 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.076500    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:24:31.078347 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:24:31.078321    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf081a74e_e004_444a_8b2c_8106be995441.slice/crio-8d79a8b494c068337e335736506b49f6a2a2b8a4dd663e0d3d5762d5ee4895a0 WatchSource:0}: Error finding container 8d79a8b494c068337e335736506b49f6a2a2b8a4dd663e0d3d5762d5ee4895a0: Status 404 returned error can't find the container with id 8d79a8b494c068337e335736506b49f6a2a2b8a4dd663e0d3d5762d5ee4895a0
Jul 02 20:24:31.080782 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.080741    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:31.080870 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.080850    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:31.080916 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.080900    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:31.467890 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.467849    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerStarted","Data":"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"}
Jul 02 20:24:31.468134 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.467913    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerStarted","Data":"8d79a8b494c068337e335736506b49f6a2a2b8a4dd663e0d3d5762d5ee4895a0"}
Jul 02 20:24:31.497146 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.497089    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podStartSLOduration=1.497050864 podStartE2EDuration="1.497050864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:31.494372966 +0000 UTC m=+1844.750450365" watchObservedRunningTime="2026-07-02 20:24:31.497050864 +0000 UTC m=+1844.753128244"
Jul 02 20:24:31.928604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:31.928563    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:32.941699 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:32.941655    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:33.478418 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:33.478388    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:33.479606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:33.479587    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:34.461231 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:34.461204    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:24:39.770149 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:39.768641    2546 patch_prober.go:28] interesting pod/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": read tcp 10.134.0.2:34252->10.134.0.63:15021: read: connection reset by peer" start-of-body=
Jul 02 20:24:39.770149 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:39.768749    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": read tcp 10.134.0.2:34252->10.134.0.63:15021: read: connection reset by peer"
Jul 02 20:24:40.516385 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.516352    2546 generic.go:356] "Generic (PLEG): container finished" podID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerID="f5a75bd78a19ef62534e5674aae62764eaf9322a8a1afe8c23de9b0661d40faf" exitCode=0
Jul 02 20:24:40.516569 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.516408    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerDied","Data":"f5a75bd78a19ef62534e5674aae62764eaf9322a8a1afe8c23de9b0661d40faf"}
Jul 02 20:24:40.516792 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.516780    2546 scope.go:117] "RemoveContainer" containerID="f5a75bd78a19ef62534e5674aae62764eaf9322a8a1afe8c23de9b0661d40faf"
Jul 02 20:24:40.517765 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.517737    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:40.517818 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.517805    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:40.517895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:40.517841    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:41.526294 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:41.526265    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerStarted","Data":"7d37f5fec62171e74597ce2284f5ceb3ddea3e7df78fdc161f7668a39e25b291"}
Jul 02 20:24:42.177379 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:42.177346    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:42.177672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:42.177648    2546 patch_prober.go:28] interesting pod/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 02 20:24:42.177774 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:42.177707    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 02 20:24:43.176824 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:43.176783    2546 patch_prober.go:28] interesting pod/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 02 20:24:43.177345 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:43.176843    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 02 20:24:44.177149 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:44.177108    2546 patch_prober.go:28] interesting pod/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 02 20:24:44.177532 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:44.177190    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 02 20:24:45.176982 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.176893    2546 patch_prober.go:28] interesting pod/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 02 20:24:45.176982 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.176953    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 02 20:24:45.557721 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.557620    2546 generic.go:356] "Generic (PLEG): container finished" podID="f081a74e-e004-444a-8b2c-8106be995441" containerID="c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69" exitCode=0
Jul 02 20:24:45.557721 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.557661    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerDied","Data":"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"}
Jul 02 20:24:45.558244 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.558222    2546 scope.go:117] "RemoveContainer" containerID="c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"
Jul 02 20:24:45.559413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.559382    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:45.559492 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.559471    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:45.559536 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:45.559515    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:24:46.181266 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.181236    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:46.181638 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.181502    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:46.182310 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.182291    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:24:46.565446 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.565338    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerStarted","Data":"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"}
Jul 02 20:24:46.930442 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.930396    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:46.930664 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.930541    2546 patch_prober.go:28] interesting pod/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 02 20:24:46.930664 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:46.930589    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 02 20:24:47.929595 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:47.929545    2546 patch_prober.go:28] interesting pod/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 02 20:24:47.930122 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:47.929627    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 02 20:24:48.478816 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:48.478776    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:48.943513 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:48.943477    2546 patch_prober.go:28] interesting pod/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 02 20:24:48.944129 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:48.944092    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 02 20:24:49.929773 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:49.929733    2546 patch_prober.go:28] interesting pod/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 02 20:24:49.930109 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:49.930052    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 02 20:24:50.933249 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:50.933215    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:24:50.934331 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:24:50.934307    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:25:38.977968 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:38.977845    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:25:38.978581 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:38.978147    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" podUID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" containerName="maas-api" containerID="cri-o://f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4" gracePeriod=30
Jul 02 20:25:39.438508 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.438483    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:25:39.553888 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.553792    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") pod \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") "
Jul 02 20:25:39.553888 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.553859    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5qgp\" (UniqueName: \"kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp\") pod \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") "
Jul 02 20:25:39.553888 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.553893    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca\") pod \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\" (UID: \"7c36688a-2fc3-46d1-85e2-4b61dcac7133\") "
Jul 02 20:25:39.554286 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.554260    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c36688a-2fc3-46d1-85e2-4b61dcac7133" (UID: "7c36688a-2fc3-46d1-85e2-4b61dcac7133"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:25:39.556027 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.555995    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c36688a-2fc3-46d1-85e2-4b61dcac7133" (UID: "7c36688a-2fc3-46d1-85e2-4b61dcac7133"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:25:39.556169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.556023    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp" (OuterVolumeSpecName: "kube-api-access-n5qgp") pod "7c36688a-2fc3-46d1-85e2-4b61dcac7133" (UID: "7c36688a-2fc3-46d1-85e2-4b61dcac7133"). InnerVolumeSpecName "kube-api-access-n5qgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:25:39.654674 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.654634    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c36688a-2fc3-46d1-85e2-4b61dcac7133-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:25:39.654674 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.654668    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5qgp\" (UniqueName: \"kubernetes.io/projected/7c36688a-2fc3-46d1-85e2-4b61dcac7133-kube-api-access-n5qgp\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:25:39.654674 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.654677    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c36688a-2fc3-46d1-85e2-4b61dcac7133-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:25:39.844373 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.844341    2546 generic.go:356] "Generic (PLEG): container finished" podID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" containerID="f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4" exitCode=0
Jul 02 20:25:39.844556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.844385    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"
Jul 02 20:25:39.844556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.844397    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" event={"ID":"7c36688a-2fc3-46d1-85e2-4b61dcac7133","Type":"ContainerDied","Data":"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"}
Jul 02 20:25:39.844556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.844437    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg" event={"ID":"7c36688a-2fc3-46d1-85e2-4b61dcac7133","Type":"ContainerDied","Data":"a9d5f35e6adf3c3a1656d4c6647b58994eee1a8d41081c8eeba0ab917cfabfe3"}
Jul 02 20:25:39.844556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.844460    2546 scope.go:117] "RemoveContainer" containerID="f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"
Jul 02 20:25:39.853597 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.853580    2546 scope.go:117] "RemoveContainer" containerID="f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"
Jul 02 20:25:39.853864 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:25:39.853845    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4\": container with ID starting with f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4 not found: ID does not exist" containerID="f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"
Jul 02 20:25:39.853931 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.853880    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4"} err="failed to get container status \"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4\": rpc error: code = NotFound desc = could not find container \"f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4\": container with ID starting with f7d6d9d5bb8d0a4093c1ec9cb7c0c02f565830b3540aba36c6d748aa26e1a7e4 not found: ID does not exist"
Jul 02 20:25:39.865937 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.865912    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:25:39.870198 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:39.870173    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-669041-655b4449f-mhbtg"]
Jul 02 20:25:41.202938 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:25:41.202900    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" path="/var/lib/kubelet/pods/7c36688a-2fc3-46d1-85e2-4b61dcac7133/volumes"
Jul 02 20:26:20.946981 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:20.946944    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:26:20.947519 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:20.947202    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy" containerID="cri-o://7d37f5fec62171e74597ce2284f5ceb3ddea3e7df78fdc161f7668a39e25b291" gracePeriod=30
Jul 02 20:26:26.102505 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.102467    2546 generic.go:356] "Generic (PLEG): container finished" podID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerID="7d37f5fec62171e74597ce2284f5ceb3ddea3e7df78fdc161f7668a39e25b291" exitCode=0
Jul 02 20:26:26.102953 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.102539    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerDied","Data":"7d37f5fec62171e74597ce2284f5ceb3ddea3e7df78fdc161f7668a39e25b291"}
Jul 02 20:26:26.102953 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.102615    2546 scope.go:117] "RemoveContainer" containerID="f5a75bd78a19ef62534e5674aae62764eaf9322a8a1afe8c23de9b0661d40faf"
Jul 02 20:26:26.213637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.213566    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:26:26.310127 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310089    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310159    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310206    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj5h5\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310223    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310249    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310332 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310265    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310337    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310392    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310421    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:26.310604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310432    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs\") pod \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\" (UID: \"ea9ba046-6075-4117-9cf8-5d03fe2c511b\") "
Jul 02 20:26:26.310826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310664    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:26.310826 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310726    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:26:26.310936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310875    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:26.310936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310913    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.310936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310930    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.311109 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.310944    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.311343 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.311309    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:26.312464 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.312419    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:26.312644 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.312625    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5" (OuterVolumeSpecName: "kube-api-access-cj5h5") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "kube-api-access-cj5h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:26:26.312713 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.312631    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:26:26.312713 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.312650    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea9ba046-6075-4117-9cf8-5d03fe2c511b" (UID: "ea9ba046-6075-4117-9cf8-5d03fe2c511b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:26:26.411741 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411700    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.411741 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411734    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj5h5\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-kube-api-access-cj5h5\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.411741 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411747    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.411980 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411757    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.411980 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411765    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9ba046-6075-4117-9cf8-5d03fe2c511b-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:26.411980 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:26.411772    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9ba046-6075-4117-9cf8-5d03fe2c511b-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:27.109224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.109189    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"
Jul 02 20:26:27.109708 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.109223    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc" event={"ID":"ea9ba046-6075-4117-9cf8-5d03fe2c511b","Type":"ContainerDied","Data":"078253a82c4f9ed01ab37ce47c47bc6cf60e45f5bea4369fb3d7d3f2a934df2a"}
Jul 02 20:26:27.109708 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.109295    2546 scope.go:117] "RemoveContainer" containerID="7d37f5fec62171e74597ce2284f5ceb3ddea3e7df78fdc161f7668a39e25b291"
Jul 02 20:26:27.132822 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.132793    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:26:27.138642 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.138616    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-669041-openshift-default-7b5fc8bb4f-cmngc"]
Jul 02 20:26:27.203114 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:27.203083    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" path="/var/lib/kubelet/pods/ea9ba046-6075-4117-9cf8-5d03fe2c511b/volumes"
Jul 02 20:26:28.658874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:28.658835    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:26:28.659441 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:28.659076    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy" containerID="cri-o://ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48" gracePeriod=30
Jul 02 20:26:29.657049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657014    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:26:29.657475 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657459    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.657520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657477    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.657520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657486    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" containerName="maas-api"
Jul 02 20:26:29.657520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657492    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" containerName="maas-api"
Jul 02 20:26:29.657520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657508    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.657520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657513    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.657672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657596    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c36688a-2fc3-46d1-85e2-4b61dcac7133" containerName="maas-api"
Jul 02 20:26:29.657672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657607    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.657672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.657615    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9ba046-6075-4117-9cf8-5d03fe2c511b" containerName="istio-proxy"
Jul 02 20:26:29.662160 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.662141    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.665828 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.665805    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c51599-openshift-default-dockercfg-w75b6\""
Jul 02 20:26:29.732540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.732505    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:26:29.742895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.742858    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.742895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.742897    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.742935    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.742989    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.743022    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn522\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.743075    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.743115    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.743142    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.743544 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.743224    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844321 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844286    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844342    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844370    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844403    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844446    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844491    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn522\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844540 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844536    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844869 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844565    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844869 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844590    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.844869 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844798    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.845017 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.844914    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.845113 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.845090    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.845180 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.845128    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.845228 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.845185    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.847391 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.847366    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.847573 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.847555    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.855664 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.855642    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.855962 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.855945    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn522\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522\") pod \"e2e-api-a-c51599-openshift-default-75c74549bc-p27hr\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") " pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:29.973021 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:29.972914    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:30.125532 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:30.125503    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:26:30.127108 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:26:30.127077    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78930781_8e4b_480f_9eb0_936801c68067.slice/crio-7aa14bba609cab0dc15c80bc33c572d4035dfa995cee8b480da4332015adb00d WatchSource:0}: Error finding container 7aa14bba609cab0dc15c80bc33c572d4035dfa995cee8b480da4332015adb00d: Status 404 returned error can't find the container with id 7aa14bba609cab0dc15c80bc33c572d4035dfa995cee8b480da4332015adb00d
Jul 02 20:26:30.129345 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:30.129308    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:30.129432 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:30.129396    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:30.129476 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:30.129441    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:31.135117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:31.135086    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerStarted","Data":"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"}
Jul 02 20:26:31.135519 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:31.135137    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerStarted","Data":"7aa14bba609cab0dc15c80bc33c572d4035dfa995cee8b480da4332015adb00d"}
Jul 02 20:26:31.167177 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:31.167126    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podStartSLOduration=2.167108935 podStartE2EDuration="2.167108935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:31.164458587 +0000 UTC m=+1964.420536001" watchObservedRunningTime="2026-07-02 20:26:31.167108935 +0000 UTC m=+1964.423186383"
Jul 02 20:26:31.973262 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:31.973217    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:31.978447 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:31.978421    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:32.140611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:32.140572    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:32.141697 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:32.141677    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:33.914292 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.914259    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:26:33.986174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986082    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986118    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986159    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986185    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986242    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986331    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986358    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckjkf\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986414    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986351    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:33.986479 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986449    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs\") pod \"f081a74e-e004-444a-8b2c-8106be995441\" (UID: \"f081a74e-e004-444a-8b2c-8106be995441\") "
Jul 02 20:26:33.986830 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986605    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:26:33.986830 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986642    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:33.986830 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986785    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:33.986984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986888    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:33.986984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986906    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:33.986984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986920    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:33.986984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.986934    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081a74e-e004-444a-8b2c-8106be995441-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:33.987207 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.987046    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data" (OuterVolumeSpecName: "istio-data") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:33.988557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.988527    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:26:33.988557 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.988549    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token" (OuterVolumeSpecName: "istio-token") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:26:33.988741 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.988531    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:26:33.988879 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:33.988859    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf" (OuterVolumeSpecName: "kube-api-access-ckjkf") pod "f081a74e-e004-444a-8b2c-8106be995441" (UID: "f081a74e-e004-444a-8b2c-8106be995441"). InnerVolumeSpecName "kube-api-access-ckjkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:26:34.087954 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.087916    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081a74e-e004-444a-8b2c-8106be995441-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:34.087954 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.087947    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:34.087954 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.087958    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckjkf\" (UniqueName: \"kubernetes.io/projected/f081a74e-e004-444a-8b2c-8106be995441-kube-api-access-ckjkf\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:34.088249 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.087966    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:34.088249 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.087975    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081a74e-e004-444a-8b2c-8106be995441-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:26:34.153318 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.153276    2546 generic.go:356] "Generic (PLEG): container finished" podID="f081a74e-e004-444a-8b2c-8106be995441" containerID="ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48" exitCode=0
Jul 02 20:26:34.153528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.153335    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"
Jul 02 20:26:34.153528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.153360    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerDied","Data":"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"}
Jul 02 20:26:34.153528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.153445    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58" event={"ID":"f081a74e-e004-444a-8b2c-8106be995441","Type":"ContainerDied","Data":"8d79a8b494c068337e335736506b49f6a2a2b8a4dd663e0d3d5762d5ee4895a0"}
Jul 02 20:26:34.153528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.153468    2546 scope.go:117] "RemoveContainer" containerID="ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"
Jul 02 20:26:34.163726 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.163710    2546 scope.go:117] "RemoveContainer" containerID="c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"
Jul 02 20:26:34.172087 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.172069    2546 scope.go:117] "RemoveContainer" containerID="ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"
Jul 02 20:26:34.172351 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:26:34.172331    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48\": container with ID starting with ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48 not found: ID does not exist" containerID="ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"
Jul 02 20:26:34.172426 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.172365    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48"} err="failed to get container status \"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48\": rpc error: code = NotFound desc = could not find container \"ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48\": container with ID starting with ff242dfbf55eadda1ffca9211aaad33449c5ed4b6c9df059e1614a2495eeed48 not found: ID does not exist"
Jul 02 20:26:34.172426 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.172391    2546 scope.go:117] "RemoveContainer" containerID="c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"
Jul 02 20:26:34.172651 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:26:34.172628    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69\": container with ID starting with c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69 not found: ID does not exist" containerID="c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"
Jul 02 20:26:34.172690 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.172656    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69"} err="failed to get container status \"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69\": rpc error: code = NotFound desc = could not find container \"c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69\": container with ID starting with c8bcd52635bb25be4360d766f40c45d2270dffdd63f5352155f8a22f8d215c69 not found: ID does not exist"
Jul 02 20:26:34.184936 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.184911    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:26:34.191364 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:34.191342    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-761cb8-openshift-default-6696cc857c-ffm58"]
Jul 02 20:26:35.203603 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:35.203572    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f081a74e-e004-444a-8b2c-8106be995441" path="/var/lib/kubelet/pods/f081a74e-e004-444a-8b2c-8106be995441/volumes"
Jul 02 20:26:38.552625 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.552593    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:26:38.553004 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.552994    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.553076 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.553006    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.553076 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.553025    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.553076 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.553031    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.553875 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.553833    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.553994 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.553896    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f081a74e-e004-444a-8b2c-8106be995441" containerName="istio-proxy"
Jul 02 20:26:38.562184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.562158    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.568031 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.568001    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3d76cb-openshift-default-dockercfg-6t4sx\""
Jul 02 20:26:38.615243 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.615208    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:26:38.734448 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734396    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734481    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734523    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734596    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734672 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734649    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734690    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734749    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgrt9\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734780    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.734920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.734812    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.836204 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.836163    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgrt9\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.836861 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.836839    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.837829 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.837798    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838083 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838044    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838272    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838438 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838424    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838570 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838556    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838679 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838652    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838838 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838815    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838907 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838752    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838907 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838595    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838907 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.837731    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.838907 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838658    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.839157 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.838960    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.841364 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.841342    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.849291 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.849250    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.852723 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.852663    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgrt9\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.856282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.856226    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token\") pod \"e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") " pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:38.874047 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:38.874007    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:39.053114 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.051980    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:26:39.061190 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:26:39.061159    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8bff00_7317_4e5c_9d3b_f9c7ce4d29fb.slice/crio-d5cd0767588b3fcd8864608beccbf3534d067870cf9407e49b8dd238293422ae WatchSource:0}: Error finding container d5cd0767588b3fcd8864608beccbf3534d067870cf9407e49b8dd238293422ae: Status 404 returned error can't find the container with id d5cd0767588b3fcd8864608beccbf3534d067870cf9407e49b8dd238293422ae
Jul 02 20:26:39.063337 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.063305    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:39.063413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.063378    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:39.063413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.063408    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:39.182625 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.182582    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerStarted","Data":"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"}
Jul 02 20:26:39.182776 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.182652    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerStarted","Data":"d5cd0767588b3fcd8864608beccbf3534d067870cf9407e49b8dd238293422ae"}
Jul 02 20:26:39.209865 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.209815    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podStartSLOduration=1.209799267 podStartE2EDuration="1.209799267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:39.207321363 +0000 UTC m=+1972.463398742" watchObservedRunningTime="2026-07-02 20:26:39.209799267 +0000 UTC m=+1972.465876645"
Jul 02 20:26:39.875155 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:39.875116    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:40.880354 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:40.880322    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:41.193506 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:41.193410    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:41.194517 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:41.194497    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:46.221503 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.221470    2546 generic.go:356] "Generic (PLEG): container finished" podID="78930781-8e4b-480f-9eb0-936801c68067" containerID="76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b" exitCode=0
Jul 02 20:26:46.221943 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.221545    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerDied","Data":"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"}
Jul 02 20:26:46.222018 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.221998    2546 scope.go:117] "RemoveContainer" containerID="76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"
Jul 02 20:26:46.223135 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.223099    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:46.223240 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.223174    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:46.223240 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:46.223211    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:47.140927 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:47.140887    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:47.228795 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:47.228762    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerStarted","Data":"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"}
Jul 02 20:26:47.973910 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:47.973869    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:47.974911 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:47.974884    2546 patch_prober.go:28] interesting pod/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 02 20:26:47.975079 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:47.974948    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 02 20:26:48.973612 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:48.973573    2546 patch_prober.go:28] interesting pod/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 02 20:26:48.974009 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:48.973630    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 02 20:26:49.974209 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:49.974162    2546 patch_prober.go:28] interesting pod/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 02 20:26:49.974748 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:49.974235    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 02 20:26:50.974274 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:50.974214    2546 patch_prober.go:28] interesting pod/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 02 20:26:50.974914 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:50.974880    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 02 20:26:51.977343 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:51.977306    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:51.977761 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:51.977574    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:51.978216 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:51.978197    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:26:56.656352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:56.655369    2546 patch_prober.go:28] interesting pod/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": read tcp 10.134.0.2:55520->10.134.0.67:15021: read: connection reset by peer" start-of-body=
Jul 02 20:26:56.656352 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:56.655454    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": read tcp 10.134.0.2:55520->10.134.0.67:15021: read: connection reset by peer"
Jul 02 20:26:57.295152 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.295119    2546 generic.go:356] "Generic (PLEG): container finished" podID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerID="ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e" exitCode=0
Jul 02 20:26:57.295354 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.295195    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerDied","Data":"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"}
Jul 02 20:26:57.295629 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.295616    2546 scope.go:117] "RemoveContainer" containerID="ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"
Jul 02 20:26:57.296640 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.296610    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:57.296922 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.296694    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:57.296922 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:57.296739    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:26:58.301922 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:58.301886    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerStarted","Data":"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"}
Jul 02 20:26:58.874415 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:58.874386    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:26:58.874639 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:58.874609    2546 patch_prober.go:28] interesting pod/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 02 20:26:58.874686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:58.874669    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 02 20:26:59.874941 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:59.874902    2546 patch_prober.go:28] interesting pod/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 02 20:26:59.875367 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:26:59.874970    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 02 20:27:00.804824 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:00.804781    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:27:00.805088 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:00.805031    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy" containerID="cri-o://cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87" gracePeriod=30
Jul 02 20:27:00.875397 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:00.875359    2546 patch_prober.go:28] interesting pod/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 02 20:27:00.875832 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:00.875414    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 02 20:27:01.875119 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:01.875053    2546 patch_prober.go:28] interesting pod/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 02 20:27:01.875303 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:01.875142    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 02 20:27:02.878625 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:02.878587    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:27:02.879015 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:02.878939    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:27:02.879558 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:02.879538    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:27:06.073569 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.073547    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:27:06.127351 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127322    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127351 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127357    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127546 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127386    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn522\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127546 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127475    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127639 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127589    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127640    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127693 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127688    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127713    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127731    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:06.127800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127740    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket\") pod \"78930781-8e4b-480f-9eb0-936801c68067\" (UID: \"78930781-8e4b-480f-9eb0-936801c68067\") "
Jul 02 20:27:06.127800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127766    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:27:06.128014 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.127867    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:06.128184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.128139    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.128184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.128162    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.128184 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.128175    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78930781-8e4b-480f-9eb0-936801c68067-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.128408 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.128379    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:06.128703 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.128681    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data" (OuterVolumeSpecName: "istio-data") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:06.129654 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.129635    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:06.130100 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.130078    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522" (OuterVolumeSpecName: "kube-api-access-kn522") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "kube-api-access-kn522". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:27:06.130179 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.130141    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:27:06.130179 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.130150    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token" (OuterVolumeSpecName: "istio-token") pod "78930781-8e4b-480f-9eb0-936801c68067" (UID: "78930781-8e4b-480f-9eb0-936801c68067"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:27:06.229215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229179    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.229215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229211    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn522\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-kube-api-access-kn522\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.229215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229220    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78930781-8e4b-480f-9eb0-936801c68067-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.229215 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229228    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78930781-8e4b-480f-9eb0-936801c68067-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.229490 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229236    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.229490 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.229243    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78930781-8e4b-480f-9eb0-936801c68067-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:06.347357 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.347241    2546 generic.go:356] "Generic (PLEG): container finished" podID="78930781-8e4b-480f-9eb0-936801c68067" containerID="cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87" exitCode=0
Jul 02 20:27:06.347357 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.347298    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"
Jul 02 20:27:06.347357 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.347338    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerDied","Data":"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"}
Jul 02 20:27:06.347606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.347392    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr" event={"ID":"78930781-8e4b-480f-9eb0-936801c68067","Type":"ContainerDied","Data":"7aa14bba609cab0dc15c80bc33c572d4035dfa995cee8b480da4332015adb00d"}
Jul 02 20:27:06.347606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.347414    2546 scope.go:117] "RemoveContainer" containerID="cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"
Jul 02 20:27:06.356926 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.356907    2546 scope.go:117] "RemoveContainer" containerID="76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"
Jul 02 20:27:06.364897 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.364881    2546 scope.go:117] "RemoveContainer" containerID="cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"
Jul 02 20:27:06.365174 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:27:06.365157    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87\": container with ID starting with cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87 not found: ID does not exist" containerID="cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"
Jul 02 20:27:06.365247 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.365181    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87"} err="failed to get container status \"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87\": rpc error: code = NotFound desc = could not find container \"cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87\": container with ID starting with cd835f8f93f45990d32d36758a8240f742ec7cd4591275c57edebeb0d15b5a87 not found: ID does not exist"
Jul 02 20:27:06.365247 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.365198    2546 scope.go:117] "RemoveContainer" containerID="76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"
Jul 02 20:27:06.365444 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:27:06.365417    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b\": container with ID starting with 76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b not found: ID does not exist" containerID="76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"
Jul 02 20:27:06.365480 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.365447    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b"} err="failed to get container status \"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b\": rpc error: code = NotFound desc = could not find container \"76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b\": container with ID starting with 76f06499ff9d5b016c9e91b33610afabaa6792bdbb162a681c13f5f7b909568b not found: ID does not exist"
Jul 02 20:27:06.377551 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.377526    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:27:06.384178 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:06.384155    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c51599-openshift-default-75c74549bc-p27hr"]
Jul 02 20:27:07.203034 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:07.203004    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78930781-8e4b-480f-9eb0-936801c68067" path="/var/lib/kubelet/pods/78930781-8e4b-480f-9eb0-936801c68067/volumes"
Jul 02 20:27:09.281259 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:09.281219    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:27:09.281676 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:09.281450    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy" containerID="cri-o://361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db" gracePeriod=30
Jul 02 20:27:14.542860 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.542806    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:27:14.606924 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.606897    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.606947    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.606978    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgrt9\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607037    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607117 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607084    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607348 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607171    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607348 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607195    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607348 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607225    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607348 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607254    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket\") pod \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\" (UID: \"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb\") "
Jul 02 20:27:14.607568 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607365    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:14.607568 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607552    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:14.607671 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607635    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:14.607729 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607671    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:27:14.607729 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607680    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.607846 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.607722    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.608347 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.608306    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:14.609619 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.609585    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:27:14.609619 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.609594    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:27:14.609755 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.609715    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9" (OuterVolumeSpecName: "kube-api-access-tgrt9") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "kube-api-access-tgrt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:27:14.609755 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.609740    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" (UID: "cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:27:14.708544 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708494    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708544 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708542    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708544 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708551    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708559    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708571    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708577    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:14.708800 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:14.708585    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgrt9\" (UniqueName: \"kubernetes.io/projected/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb-kube-api-access-tgrt9\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:27:15.395957 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.395921    2546 generic.go:356] "Generic (PLEG): container finished" podID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerID="361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db" exitCode=0
Jul 02 20:27:15.396169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.395962    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerDied","Data":"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"}
Jul 02 20:27:15.396169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.395977    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"
Jul 02 20:27:15.396169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.396023    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99" event={"ID":"cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb","Type":"ContainerDied","Data":"d5cd0767588b3fcd8864608beccbf3534d067870cf9407e49b8dd238293422ae"}
Jul 02 20:27:15.396169 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.396046    2546 scope.go:117] "RemoveContainer" containerID="361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"
Jul 02 20:27:15.405604 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.405354    2546 scope.go:117] "RemoveContainer" containerID="ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"
Jul 02 20:27:15.413474 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.413456    2546 scope.go:117] "RemoveContainer" containerID="361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"
Jul 02 20:27:15.413744 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:27:15.413726    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db\": container with ID starting with 361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db not found: ID does not exist" containerID="361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"
Jul 02 20:27:15.413787 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.413754    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db"} err="failed to get container status \"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db\": rpc error: code = NotFound desc = could not find container \"361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db\": container with ID starting with 361dc5d3c1553038be1dc54830f115fd12751401116181dca40fbb5ef0d2b9db not found: ID does not exist"
Jul 02 20:27:15.413787 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.413773    2546 scope.go:117] "RemoveContainer" containerID="ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"
Jul 02 20:27:15.414031 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:27:15.414013    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e\": container with ID starting with ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e not found: ID does not exist" containerID="ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"
Jul 02 20:27:15.414088 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.414037    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e"} err="failed to get container status \"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e\": rpc error: code = NotFound desc = could not find container \"ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e\": container with ID starting with ff2d53673621cd8b54bd7d8532e6ced7cd09a08c9200ee4d76e09c65f8fd7e7e not found: ID does not exist"
Jul 02 20:27:15.421122 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.421048    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:27:15.429483 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:15.429460    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3d76cb-openshift-default-7987fbf575-7sp99"]
Jul 02 20:27:16.403658 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.403624    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:27:16.404042 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404017    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404042 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404029    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404042 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404040    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404045    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404071    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404077    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404083    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404091    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404153    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404161    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404170    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.404227 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.404176    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="78930781-8e4b-480f-9eb0-936801c68067" containerName="istio-proxy"
Jul 02 20:27:16.408883 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.408859    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.423379 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.423354    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-cd8cf5-serving-cert\""
Jul 02 20:27:16.435631 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.435600    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:27:16.526436 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.526403    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.526612 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.526450    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.526713 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.526628    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzr7\" (UniqueName: \"kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.627391 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.627355    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzr7\" (UniqueName: \"kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.627584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.627497    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.627584 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.627534    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.628189 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.628165    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.629955 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.629934    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.649340 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.649307    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzr7\" (UniqueName: \"kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7\") pod \"maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") " pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.719564 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.719467    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:16.884795 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:27:16.884765    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2307fc97_6e53_41c0_9ea9_b167d05604ee.slice/crio-8957530973d50612213ffca6ead72599b0b0d6800a185b9bd34562fb6303f9e1 WatchSource:0}: Error finding container 8957530973d50612213ffca6ead72599b0b0d6800a185b9bd34562fb6303f9e1: Status 404 returned error can't find the container with id 8957530973d50612213ffca6ead72599b0b0d6800a185b9bd34562fb6303f9e1
Jul 02 20:27:16.886392 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:16.886371    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:27:17.211278 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:17.207963    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb" path="/var/lib/kubelet/pods/cc8bff00-7317-4e5c-9d3b-f9c7ce4d29fb/volumes"
Jul 02 20:27:17.408599 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:17.408560    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" event={"ID":"2307fc97-6e53-41c0-9ea9-b167d05604ee","Type":"ContainerStarted","Data":"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"}
Jul 02 20:27:17.409051 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:17.408627    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" event={"ID":"2307fc97-6e53-41c0-9ea9-b167d05604ee","Type":"ContainerStarted","Data":"8957530973d50612213ffca6ead72599b0b0d6800a185b9bd34562fb6303f9e1"}
Jul 02 20:27:17.409051 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:17.408709    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:17.449214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:17.449106    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" podStartSLOduration=1.155158643 podStartE2EDuration="1.449085782s" totalImagesPullingTime="293.927139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:27:17.448003495 +0000 UTC m=+2010.704080915" watchObservedRunningTime="2026-07-02 20:27:17.449085782 +0000 UTC m=+2010.705163163"
Jul 02 20:27:21.438832 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.438793    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:27:21.442434 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.442418    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.445625 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.445598    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fa5d1d-openshift-default-dockercfg-rtpkp\""
Jul 02 20:27:21.466287 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.466251    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:27:21.577673 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577622    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86x5j\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.577887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577699    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.577887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577732    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.577887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577773    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.577887 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577840    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.578150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577902    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.578150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.577984    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.578150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.578015    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.578150 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.578053    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679607 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679569    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679616    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679642    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86x5j\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679660    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679679    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679708    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.679831 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679796    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680182 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679848    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680182 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.679930    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.680185    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680282 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.680211    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680391 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.680286    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680391 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.680356    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.680686 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.680665    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.682013 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.681984    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.682314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.682284    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.692456 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.692387    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.692587 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.692515    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86x5j\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j\") pod \"e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") " pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.753606 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.753570    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:21.931158 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.931129    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:27:21.932392 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:27:21.932366    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf4f8dc_0a99_402e_a231_19b6904ecbd0.slice/crio-9d517be7adfd164b1de1589d7f7d882334809d7b726702073a8f4adbbcaca51b WatchSource:0}: Error finding container 9d517be7adfd164b1de1589d7f7d882334809d7b726702073a8f4adbbcaca51b: Status 404 returned error can't find the container with id 9d517be7adfd164b1de1589d7f7d882334809d7b726702073a8f4adbbcaca51b
Jul 02 20:27:21.934839 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.934796    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:21.934916 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.934881    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:21.934955 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:21.934912    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:22.437426 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.437387    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerStarted","Data":"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"}
Jul 02 20:27:22.437607 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.437466    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerStarted","Data":"9d517be7adfd164b1de1589d7f7d882334809d7b726702073a8f4adbbcaca51b"}
Jul 02 20:27:22.475542 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.475487    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podStartSLOduration=1.475470794 podStartE2EDuration="1.475470794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:27:22.474366833 +0000 UTC m=+2015.730444212" watchObservedRunningTime="2026-07-02 20:27:22.475470794 +0000 UTC m=+2015.731548245"
Jul 02 20:27:22.754520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.754437    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:22.756240 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.756217    2546 patch_prober.go:28] interesting pod/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 02 20:27:22.756309 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:22.756266    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 02 20:27:23.419560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:23.419531    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:27:23.758575 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:23.758484    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:24.449199 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:24.449165    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:24.450003 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:24.449984    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:36.511253 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.511216    2546 generic.go:356] "Generic (PLEG): container finished" podID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerID="dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929" exitCode=0
Jul 02 20:27:36.511730 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.511261    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerDied","Data":"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"}
Jul 02 20:27:36.511730 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.511683    2546 scope.go:117] "RemoveContainer" containerID="dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"
Jul 02 20:27:36.512707 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.512676    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:36.512777 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.512748    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:36.512813 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:36.512778    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:27:37.517937 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:37.517898    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerStarted","Data":"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"}
Jul 02 20:27:37.754401 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:37.754346    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:37.755760 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:37.755725    2546 patch_prober.go:28] interesting pod/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 02 20:27:37.755911 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:37.755778    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 02 20:27:38.754511 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:38.754473    2546 patch_prober.go:28] interesting pod/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 02 20:27:38.754939 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:38.754553    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 02 20:27:39.449680 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:39.449633    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:39.754425 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:39.754334    2546 patch_prober.go:28] interesting pod/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 02 20:27:39.754425 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:39.754414    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 02 20:27:40.754392 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:40.754351    2546 patch_prober.go:28] interesting pod/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 02 20:27:40.754611 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:40.754412    2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 02 20:27:41.758653 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:41.758619    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:27:41.759558 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:27:41.759539    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:28:47.270812 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:28:47.270786    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:28:47.279195 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:28:47.279174    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:32:08.774272 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.774239    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:32:08.777939 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.777916    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.781283 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.781251    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cd8cf5\"/\"kube-root-ca.crt\""
Jul 02 20:32:08.781394 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.781253    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cd8cf5\"/\"default-dockercfg-xrhbf\""
Jul 02 20:32:08.781394 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.781299    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cd8cf5\"/\"openshift-service-ca.crt\""
Jul 02 20:32:08.781394 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.781257    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cd8cf5\"/\"rate-test-model-cd8cf5-kserve-self-signed-certs\""
Jul 02 20:32:08.789714 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.789691    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:32:08.852997 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.852963    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.853201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.853009    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5jf\" (UniqueName: \"kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.853201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.853089    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.853201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.853121    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.853201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.853170    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.853201 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.853186    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954260 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954228    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954260 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954266    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954496 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954310    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954560 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954488    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954615    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954634    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954820 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954678    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5jf\" (UniqueName: \"kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954820 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954689    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.954820 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.954812    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.956908 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.956888    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.956992 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.956934    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:08.964532 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:08.964489    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5jf\" (UniqueName: \"kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf\") pod \"rate-test-model-cd8cf5-kserve-65886cffb7-4zl88\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") " pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:09.087578 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:09.087545    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:09.228288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:09.225307    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:32:09.228951 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:32:09.228915    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ab9739f_a96b_40bb_b885_b4f1f34212e6.slice/crio-f5ed271816cda716694b1d0427cabe36829b0d66473e77b47bb391e6bf54a499 WatchSource:0}: Error finding container f5ed271816cda716694b1d0427cabe36829b0d66473e77b47bb391e6bf54a499: Status 404 returned error can't find the container with id f5ed271816cda716694b1d0427cabe36829b0d66473e77b47bb391e6bf54a499
Jul 02 20:32:09.918489 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:09.918450    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" event={"ID":"1ab9739f-a96b-40bb-b885-b4f1f34212e6","Type":"ContainerStarted","Data":"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"}
Jul 02 20:32:09.918901 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:09.918503    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" event={"ID":"1ab9739f-a96b-40bb-b885-b4f1f34212e6","Type":"ContainerStarted","Data":"f5ed271816cda716694b1d0427cabe36829b0d66473e77b47bb391e6bf54a499"}
Jul 02 20:32:09.937799 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:09.937749    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" podStartSLOduration=1.9377327260000001 podStartE2EDuration="1.937732726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:09.936292158 +0000 UTC m=+2303.192369563" watchObservedRunningTime="2026-07-02 20:32:09.937732726 +0000 UTC m=+2303.193810103"
Jul 02 20:32:19.087876 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:19.087828    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:19.088398 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:19.087898    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:19.100285 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:19.100261    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:32:19.981409 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:32:19.981374    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:33:22.967970 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:22.967937    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:33:25.602947 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.602912    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:33:25.603395 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.603117    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" podUID="2307fc97-6e53-41c0-9ea9-b167d05604ee" containerName="maas-api" containerID="cri-o://22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b" gracePeriod=30
Jul 02 20:33:25.868290 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.868218    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:33:25.902762 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.902732    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtzr7\" (UniqueName: \"kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7\") pod \"2307fc97-6e53-41c0-9ea9-b167d05604ee\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") "
Jul 02 20:33:25.902950 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.902785    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca\") pod \"2307fc97-6e53-41c0-9ea9-b167d05604ee\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") "
Jul 02 20:33:25.902950 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.902808    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls\") pod \"2307fc97-6e53-41c0-9ea9-b167d05604ee\" (UID: \"2307fc97-6e53-41c0-9ea9-b167d05604ee\") "
Jul 02 20:33:25.903232 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.903204    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2307fc97-6e53-41c0-9ea9-b167d05604ee" (UID: "2307fc97-6e53-41c0-9ea9-b167d05604ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:33:25.904951 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.904919    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7" (OuterVolumeSpecName: "kube-api-access-vtzr7") pod "2307fc97-6e53-41c0-9ea9-b167d05604ee" (UID: "2307fc97-6e53-41c0-9ea9-b167d05604ee"). InnerVolumeSpecName "kube-api-access-vtzr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:33:25.905075 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:25.904979    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2307fc97-6e53-41c0-9ea9-b167d05604ee" (UID: "2307fc97-6e53-41c0-9ea9-b167d05604ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:33:26.003722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.003682    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtzr7\" (UniqueName: \"kubernetes.io/projected/2307fc97-6e53-41c0-9ea9-b167d05604ee-kube-api-access-vtzr7\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:26.003722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.003717    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2307fc97-6e53-41c0-9ea9-b167d05604ee-openshift-service-ca\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:26.003722 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.003727    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2307fc97-6e53-41c0-9ea9-b167d05604ee-maas-api-tls\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:26.309882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.309785    2546 generic.go:356] "Generic (PLEG): container finished" podID="2307fc97-6e53-41c0-9ea9-b167d05604ee" containerID="22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b" exitCode=0
Jul 02 20:33:26.309882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.309826    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"
Jul 02 20:33:26.309882 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.309863    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" event={"ID":"2307fc97-6e53-41c0-9ea9-b167d05604ee","Type":"ContainerDied","Data":"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"}
Jul 02 20:33:26.310161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.309913    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5" event={"ID":"2307fc97-6e53-41c0-9ea9-b167d05604ee","Type":"ContainerDied","Data":"8957530973d50612213ffca6ead72599b0b0d6800a185b9bd34562fb6303f9e1"}
Jul 02 20:33:26.310161 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.309936    2546 scope.go:117] "RemoveContainer" containerID="22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"
Jul 02 20:33:26.319600 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.319581    2546 scope.go:117] "RemoveContainer" containerID="22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"
Jul 02 20:33:26.319877 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:33:26.319858    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b\": container with ID starting with 22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b not found: ID does not exist" containerID="22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"
Jul 02 20:33:26.319939 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.319888    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b"} err="failed to get container status \"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b\": rpc error: code = NotFound desc = could not find container \"22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b\": container with ID starting with 22eeca484aa026d07ca34e40d8462bd0ec0bb6dfd23d23a5ee27fe3f4768aa5b not found: ID does not exist"
Jul 02 20:33:26.333688 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.333657    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:33:26.339427 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:26.339397    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-cd8cf5-67c89fdf68-b2hk5"]
Jul 02 20:33:27.203017 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:27.202983    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2307fc97-6e53-41c0-9ea9-b167d05604ee" path="/var/lib/kubelet/pods/2307fc97-6e53-41c0-9ea9-b167d05604ee/volumes"
Jul 02 20:33:37.990176 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:37.990113    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" podUID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" containerName="main" containerID="cri-o://345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318" gracePeriod=45
Jul 02 20:33:38.245885 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.245822    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:33:38.324624 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324586    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.324791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324646    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k5jf\" (UniqueName: \"kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.324791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324675    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.324791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324712    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.324791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324755    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.324791 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.324786    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home\") pod \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\" (UID: \"1ab9739f-a96b-40bb-b885-b4f1f34212e6\") "
Jul 02 20:33:38.325174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.325009    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:33:38.325174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.325026    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:33:38.325174 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.325151    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home" (OuterVolumeSpecName: "home") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:33:38.326861 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.326841    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm" (OuterVolumeSpecName: "dshm") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:33:38.326979 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.326963    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf" (OuterVolumeSpecName: "kube-api-access-4k5jf") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "kube-api-access-4k5jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:33:38.327032 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.326996    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ab9739f-a96b-40bb-b885-b4f1f34212e6" (UID: "1ab9739f-a96b-40bb-b885-b4f1f34212e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:33:38.374096 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.374039    2546 generic.go:356] "Generic (PLEG): container finished" podID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" containerID="345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318" exitCode=0
Jul 02 20:33:38.374288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.374105    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"
Jul 02 20:33:38.374288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.374125    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" event={"ID":"1ab9739f-a96b-40bb-b885-b4f1f34212e6","Type":"ContainerDied","Data":"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"}
Jul 02 20:33:38.374288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.374174    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88" event={"ID":"1ab9739f-a96b-40bb-b885-b4f1f34212e6","Type":"ContainerDied","Data":"f5ed271816cda716694b1d0427cabe36829b0d66473e77b47bb391e6bf54a499"}
Jul 02 20:33:38.374288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.374197    2546 scope.go:117] "RemoveContainer" containerID="345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"
Jul 02 20:33:38.383159 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.383140    2546 scope.go:117] "RemoveContainer" containerID="345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"
Jul 02 20:33:38.383451 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:33:38.383431    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318\": container with ID starting with 345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318 not found: ID does not exist" containerID="345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"
Jul 02 20:33:38.383518 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.383461    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318"} err="failed to get container status \"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318\": rpc error: code = NotFound desc = could not find container \"345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318\": container with ID starting with 345e600a95072e18324699fce4469034c8e24a7b0ed2aa0228aa04697ee6e318 not found: ID does not exist"
Jul 02 20:33:38.396688 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.396664    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:33:38.404314 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.404280    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-cd8cf5/rate-test-model-cd8cf5-kserve-65886cffb7-4zl88"]
Jul 02 20:33:38.426491 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426470    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-dshm\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:38.426605 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426493    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k5jf\" (UniqueName: \"kubernetes.io/projected/1ab9739f-a96b-40bb-b885-b4f1f34212e6-kube-api-access-4k5jf\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:38.426605 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426505    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tmp-dir\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:38.426605 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426516    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-model-cache\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:38.426605 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426523    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab9739f-a96b-40bb-b885-b4f1f34212e6-tls-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:38.426605 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:38.426530    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab9739f-a96b-40bb-b885-b4f1f34212e6-home\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:33:39.202982 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:39.202947    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" path="/var/lib/kubelet/pods/1ab9739f-a96b-40bb-b885-b4f1f34212e6/volumes"
Jul 02 20:33:47.300435 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:47.300409    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:33:47.309398 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:33:47.309374    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bz5w_6ca1b845-151c-48d2-9ee4-724d4ef0d624/ovn-acl-logging/0.log"
Jul 02 20:34:15.072904 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:15.072870    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:34:15.073434 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:15.073090    2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy" containerID="cri-o://af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307" gracePeriod=30
Jul 02 20:34:15.762610 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:15.762571    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c57dbf4d-pmp9f_c67c92bb-cd04-4048-8ba3-876cf727460c/authorino/0.log"
Jul 02 20:34:20.328659 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.328627    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:34:20.343224 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.343151    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gsxzv_9f9e3147-47d6-4efc-b46d-9991dedda550/manager/0.log"
Jul 02 20:34:20.429032 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.428998    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429089    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86x5j\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429159    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429190    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429208    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429250 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429239    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429278    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429314    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429352    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket\") pod \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\" (UID: \"ebf4f8dc-0a99-402e-a231-19b6904ecbd0\") "
Jul 02 20:34:20.429525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429489    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:20.429525 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429505    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:20.429776 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429594    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:34:20.429776 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429700    2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istiod-ca-cert\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.429776 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429719    2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.429776 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429731    2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-workload-certs\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.429984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.429817    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:20.430528 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.430496    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data" (OuterVolumeSpecName: "istio-data") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:20.431468 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.431442    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j" (OuterVolumeSpecName: "kube-api-access-86x5j") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "kube-api-access-86x5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:34:20.431662 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.431641    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token" (OuterVolumeSpecName: "istio-token") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:34:20.431796 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.431777    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:34:20.431855 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.431811    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ebf4f8dc-0a99-402e-a231-19b6904ecbd0" (UID: "ebf4f8dc-0a99-402e-a231-19b6904ecbd0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:20.458984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.458961    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-488ff_81a01346-8bf0-47b3-ad90-d727e9676844/manager/0.log"
Jul 02 20:34:20.531277 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531238    2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-envoy\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.531277 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531273    2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-podinfo\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.531277 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531285    2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-data\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.531518 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531299    2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-credential-socket\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.531518 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531311    2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-istio-token\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.531518 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.531321    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86x5j\" (UniqueName: \"kubernetes.io/projected/ebf4f8dc-0a99-402e-a231-19b6904ecbd0-kube-api-access-86x5j\") on node \"ip-10-0-142-141.ec2.internal\" DevicePath \"\""
Jul 02 20:34:20.581533 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.581495    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7676dfbcb7-vnncp_336185e1-7b0d-46a7-b0f6-823a658e66cb/maas-api/0.log"
Jul 02 20:34:20.588963 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.588922    2546 generic.go:356] "Generic (PLEG): container finished" podID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerID="af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307" exitCode=0
Jul 02 20:34:20.589214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.589003    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"
Jul 02 20:34:20.589214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.589008    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerDied","Data":"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"}
Jul 02 20:34:20.589214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.589146    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg" event={"ID":"ebf4f8dc-0a99-402e-a231-19b6904ecbd0","Type":"ContainerDied","Data":"9d517be7adfd164b1de1589d7f7d882334809d7b726702073a8f4adbbcaca51b"}
Jul 02 20:34:20.589214 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.589183    2546 scope.go:117] "RemoveContainer" containerID="af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"
Jul 02 20:34:20.598797 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.598780    2546 scope.go:117] "RemoveContainer" containerID="dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"
Jul 02 20:34:20.606987 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.606966    2546 scope.go:117] "RemoveContainer" containerID="af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"
Jul 02 20:34:20.607237 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:34:20.607217    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307\": container with ID starting with af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307 not found: ID does not exist" containerID="af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"
Jul 02 20:34:20.607319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.607244    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307"} err="failed to get container status \"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307\": rpc error: code = NotFound desc = could not find container \"af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307\": container with ID starting with af52dfa2fb02b0bcdfcfbc2cad49459b044078b26b014320a9dfa45cba90b307 not found: ID does not exist"
Jul 02 20:34:20.607319 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.607262    2546 scope.go:117] "RemoveContainer" containerID="dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"
Jul 02 20:34:20.607531 ip-10-0-142-141 kubenswrapper[2546]: E0702 20:34:20.607516    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929\": container with ID starting with dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929 not found: ID does not exist" containerID="dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"
Jul 02 20:34:20.607572 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.607535    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929"} err="failed to get container status \"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929\": rpc error: code = NotFound desc = could not find container \"dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929\": container with ID starting with dfd506bb8ccbfb272ee2a23fd0ad1e3a4d345b6a729a33f4c3dfdc57058b2929 not found: ID does not exist"
Jul 02 20:34:20.611895 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.611873    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:34:20.615734 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.615714    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fa5d1d-openshift-default-87d6586f5-l6zbg"]
Jul 02 20:34:20.936269 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:20.936193    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c7695b477-mvh7x_b77df281-611a-421c-b735-9f3df879b8e7/manager/0.log"
Jul 02 20:34:21.055709 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.055673    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zfrr6_28915fa1-8b6f-4950-a225-ca26b56f873f/server/0.log"
Jul 02 20:34:21.172343 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.172312    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zzgf6_7ca275ff-284f-4e11-bb0b-c95f6998d6dc/manager/0.log"
Jul 02 20:34:21.202823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.202741    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" path="/var/lib/kubelet/pods/ebf4f8dc-0a99-402e-a231-19b6904ecbd0/volumes"
Jul 02 20:34:21.426131 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.426105    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-59z6m_d9b096e1-8c37-48bc-9c58-743b750aa8e9/copy-manifests/0.log"
Jul 02 20:34:21.432986 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.432948    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-59z6m_d9b096e1-8c37-48bc-9c58-743b750aa8e9/manager/0.log"
Jul 02 20:34:21.661874 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:21.661846    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-fvg7v_425e1985-3f79-488a-8754-c7232610a9cd/postgres/0.log"
Jul 02 20:34:22.935206 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:22.935177    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c57dbf4d-pmp9f_c67c92bb-cd04-4048-8ba3-876cf727460c/authorino/0.log"
Jul 02 20:34:23.056355 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:23.056330    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9jr99_3379cfec-a1de-4ccf-82e6-0099cc5cdd82/manager/0.log"
Jul 02 20:34:23.405705 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:23.405672    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kr969_43aeca53-fa39-4d06-94f0-47a1e333d692/registry-server/0.log"
Jul 02 20:34:23.766755 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:23.766680    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9656w_6b779277-6776-4aea-8fe8-7035aed8e2f4/manager/0.log"
Jul 02 20:34:24.116239 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:24.116211    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zv5kb_f8b24f26-4aa4-466a-b0cc-626262ba06c6/istio-proxy/0.log"
Jul 02 20:34:24.358185 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:24.358145    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b994b5d7-2kb6m_81a4e755-440f-465f-9b48-62cdcaeb8699/kube-auth-proxy/0.log"
Jul 02 20:34:24.589563 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:24.589535    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/1.log"
Jul 02 20:34:24.706526 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:24.706497    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fvqcc_458cb335-97c6-478c-b753-d03290eca4af/payload-pre-processing/0.log"
Jul 02 20:34:24.834527 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:24.834499    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vxjlr_6f884b05-009b-4cd7-b404-114024f7838f/payload-processing/0.log"
Jul 02 20:34:25.395913 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:25.395887    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nvmks_373e2fb5-bc21-4dea-aa59-429a86c184c8/main/0.log"
Jul 02 20:34:25.743514 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:25.743428    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dr4xc_106d7737-ea92-4bd8-84f3-0f5be3145aa6/main/0.log"
Jul 02 20:34:32.939461 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:32.939432    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zv8fd_79350bbc-d62e-48f2-bd97-3cca633879c7/global-pull-secret-syncer/0.log"
Jul 02 20:34:33.025489 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:33.025458    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rr9zf_98f82ca6-1efd-475a-a5b0-b727d779a082/konnectivity-agent/0.log"
Jul 02 20:34:33.132735 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:33.132702    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-141.ec2.internal_1b28c92d26379581a95c2a602acb94d2/haproxy/0.log"
Jul 02 20:34:38.442012 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:38.441972    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c57dbf4d-pmp9f_c67c92bb-cd04-4048-8ba3-876cf727460c/authorino/0.log"
Jul 02 20:34:38.474417 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:38.474385    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9jr99_3379cfec-a1de-4ccf-82e6-0099cc5cdd82/manager/0.log"
Jul 02 20:34:38.627443 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:38.627413    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kr969_43aeca53-fa39-4d06-94f0-47a1e333d692/registry-server/0.log"
Jul 02 20:34:38.887420 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:38.887391    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9656w_6b779277-6776-4aea-8fe8-7035aed8e2f4/manager/0.log"
Jul 02 20:34:40.913535 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:40.913510    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68f7c6487b-k4rm5_1e348eb1-28d6-4c23-868f-5fb98450cef6/metrics-server/0.log"
Jul 02 20:34:41.074152 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.074122    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llnv7_4c701304-f392-4e83-b025-981ade3584d5/node-exporter/0.log"
Jul 02 20:34:41.099655 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.099631    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llnv7_4c701304-f392-4e83-b025-981ade3584d5/kube-rbac-proxy/0.log"
Jul 02 20:34:41.122637 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.122613    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llnv7_4c701304-f392-4e83-b025-981ade3584d5/init-textfile/0.log"
Jul 02 20:34:41.591520 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.591490    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lbtsz_8702ca10-5544-462b-96a2-325cc1ce99cd/prometheus-operator-admission-webhook/0.log"
Jul 02 20:34:41.700281 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.700255    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/thanos-query/0.log"
Jul 02 20:34:41.724575 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.724548    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/kube-rbac-proxy-web/0.log"
Jul 02 20:34:41.749618 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.749593    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/kube-rbac-proxy/0.log"
Jul 02 20:34:41.773766 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.773747    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/prom-label-proxy/0.log"
Jul 02 20:34:41.802038 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.802011    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/kube-rbac-proxy-rules/0.log"
Jul 02 20:34:41.828486 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:41.828458    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c87b5b56-9rdp7_9fa4b38e-c4e4-4cef-8ee0-39a1b5b57036/kube-rbac-proxy-metrics/0.log"
Jul 02 20:34:42.931666 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.931632    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"]
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932022    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" containerName="main"
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932033    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" containerName="main"
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932040    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932046    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932072    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2307fc97-6e53-41c0-9ea9-b167d05604ee" containerName="maas-api"
Jul 02 20:34:42.932090 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932080    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="2307fc97-6e53-41c0-9ea9-b167d05604ee" containerName="maas-api"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932098    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932104    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932160    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932170    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf4f8dc-0a99-402e-a231-19b6904ecbd0" containerName="istio-proxy"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932176    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab9739f-a96b-40bb-b885-b4f1f34212e6" containerName="main"
Jul 02 20:34:42.932288 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.932183    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="2307fc97-6e53-41c0-9ea9-b167d05604ee" containerName="maas-api"
Jul 02 20:34:42.935829 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.935805    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:42.938433 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.938410    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xgw55\"/\"default-dockercfg-v2l27\""
Jul 02 20:34:42.939381 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.939357    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgw55\"/\"kube-root-ca.crt\""
Jul 02 20:34:42.939496 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.939412    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgw55\"/\"openshift-service-ca.crt\""
Jul 02 20:34:42.947217 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:42.947196    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"]
Jul 02 20:34:43.035047 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.035008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-lib-modules\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.035047 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.035050    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-podres\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.035326 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.035096    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-sys\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.035326 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.035124    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-proc\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.035326 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.035142    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7nm\" (UniqueName: \"kubernetes.io/projected/b65f96c2-c57a-44be-8e04-20613feb0211-kube-api-access-8s7nm\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135563 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135528    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-lib-modules\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135563 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135567    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-podres\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135590    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-sys\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135628    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-proc\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135643    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7nm\" (UniqueName: \"kubernetes.io/projected/b65f96c2-c57a-44be-8e04-20613feb0211-kube-api-access-8s7nm\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135718    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-podres\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135720    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-sys\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135719    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-lib-modules\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.135823 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.135749    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b65f96c2-c57a-44be-8e04-20613feb0211-proc\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.143542 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.143517    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7nm\" (UniqueName: \"kubernetes.io/projected/b65f96c2-c57a-44be-8e04-20613feb0211-kube-api-access-8s7nm\") pod \"perf-node-gather-daemonset-65tfx\" (UID: \"b65f96c2-c57a-44be-8e04-20613feb0211\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.246281 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.246193    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.385231 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.385202    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"]
Jul 02 20:34:43.386968 ip-10-0-142-141 kubenswrapper[2546]: W0702 20:34:43.386940    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb65f96c2_c57a_44be_8e04_20613feb0211.slice/crio-6e6b446033f71e19670d8ca910940d7767a6ace3232fd0dae7515ae3f5161f8e WatchSource:0}: Error finding container 6e6b446033f71e19670d8ca910940d7767a6ace3232fd0dae7515ae3f5161f8e: Status 404 returned error can't find the container with id 6e6b446033f71e19670d8ca910940d7767a6ace3232fd0dae7515ae3f5161f8e
Jul 02 20:34:43.709481 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.709443    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx" event={"ID":"b65f96c2-c57a-44be-8e04-20613feb0211","Type":"ContainerStarted","Data":"ebfef2f337623b54a69e8e6d3fcf51dedb7297d4d2acd58d3c7718a7741e029e"}
Jul 02 20:34:43.709695 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.709501    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx" event={"ID":"b65f96c2-c57a-44be-8e04-20613feb0211","Type":"ContainerStarted","Data":"6e6b446033f71e19670d8ca910940d7767a6ace3232fd0dae7515ae3f5161f8e"}
Jul 02 20:34:43.709695 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.709528    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:43.729076 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:43.729016    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx" podStartSLOduration=1.729000288 podStartE2EDuration="1.729000288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:43.727253397 +0000 UTC m=+2456.983330766" watchObservedRunningTime="2026-07-02 20:34:43.729000288 +0000 UTC m=+2456.985077668"
Jul 02 20:34:44.120623 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:44.120595    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6749958675-krfhd_fe4068b0-f4e2-49cc-a082-4a741a9c4298/console/0.log"
Jul 02 20:34:45.924920 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:45.924885    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgtkb_aa0dafc2-29df-461d-b75d-ffd9520da4a3/dns/0.log"
Jul 02 20:34:45.948921 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:45.948895    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgtkb_aa0dafc2-29df-461d-b75d-ffd9520da4a3/kube-rbac-proxy/0.log"
Jul 02 20:34:46.030669 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:46.030633    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cv99p_1dfeb318-8903-4cdf-b1d3-13e3c0876c78/dns-node-resolver/0.log"
Jul 02 20:34:46.727984 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:46.727949    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5d4s7_87df8ef4-bcbd-43c9-9b21-5eb3ce5999d5/node-ca/0.log"
Jul 02 20:34:47.757556 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:47.757476    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zv5kb_f8b24f26-4aa4-466a-b0cc-626262ba06c6/istio-proxy/0.log"
Jul 02 20:34:47.973991 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:47.973961    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b994b5d7-2kb6m_81a4e755-440f-465f-9b48-62cdcaeb8699/kube-auth-proxy/0.log"
Jul 02 20:34:48.041569 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:48.041479    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/0.log"
Jul 02 20:34:48.070817 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:48.070792    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/1.log"
Jul 02 20:34:48.104941 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:48.104910    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fvqcc_458cb335-97c6-478c-b753-d03290eca4af/payload-pre-processing/0.log"
Jul 02 20:34:48.153393 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:48.153363    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vxjlr_6f884b05-009b-4cd7-b404-114024f7838f/payload-processing/0.log"
Jul 02 20:34:48.892457 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:48.892432    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2nct7_fc808a6e-33dc-4f4f-8bfd-8557f83e9b58/serve-healthcheck-canary/0.log"
Jul 02 20:34:49.459453 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:49.459409    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flkbp_9d3436d9-66ba-49a0-b23d-5001109859f5/kube-rbac-proxy/0.log"
Jul 02 20:34:49.486182 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:49.486151    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flkbp_9d3436d9-66ba-49a0-b23d-5001109859f5/exporter/0.log"
Jul 02 20:34:49.508971 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:49.508945    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flkbp_9d3436d9-66ba-49a0-b23d-5001109859f5/extractor/0.log"
Jul 02 20:34:49.724589 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:49.724499    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-65tfx"
Jul 02 20:34:51.984919 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:51.984894    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gsxzv_9f9e3147-47d6-4efc-b46d-9991dedda550/manager/0.log"
Jul 02 20:34:52.142797 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.142679    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-488ff_81a01346-8bf0-47b3-ad90-d727e9676844/manager/0.log"
Jul 02 20:34:52.178990 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.178952    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7676dfbcb7-vnncp_336185e1-7b0d-46a7-b0f6-823a658e66cb/maas-api/0.log"
Jul 02 20:34:52.345435 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.345401    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c7695b477-mvh7x_b77df281-611a-421c-b735-9f3df879b8e7/manager/0.log"
Jul 02 20:34:52.368946 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.368921    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zfrr6_28915fa1-8b6f-4950-a225-ca26b56f873f/server/0.log"
Jul 02 20:34:52.433617 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.433524    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zzgf6_7ca275ff-284f-4e11-bb0b-c95f6998d6dc/manager/0.log"
Jul 02 20:34:52.600548 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.600520    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-59z6m_d9b096e1-8c37-48bc-9c58-743b750aa8e9/manager/0.log"
Jul 02 20:34:52.627837 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.627810    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-59z6m_d9b096e1-8c37-48bc-9c58-743b750aa8e9/copy-manifests/0.log"
Jul 02 20:34:52.717436 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:52.717333    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-fvg7v_425e1985-3f79-488a-8754-c7232610a9cd/postgres/0.log"
Jul 02 20:34:53.254045 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.254016    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zv5kb_f8b24f26-4aa4-466a-b0cc-626262ba06c6/istio-proxy/0.log"
Jul 02 20:34:53.455020 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.454988    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b994b5d7-2kb6m_81a4e755-440f-465f-9b48-62cdcaeb8699/kube-auth-proxy/0.log"
Jul 02 20:34:53.490413 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.490386    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/0.log"
Jul 02 20:34:53.519767 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.519686    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/1.log"
Jul 02 20:34:53.541896 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.541871    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fvqcc_458cb335-97c6-478c-b753-d03290eca4af/payload-pre-processing/0.log"
Jul 02 20:34:53.576992 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:53.576959    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vxjlr_6f884b05-009b-4cd7-b404-114024f7838f/payload-processing/0.log"
Jul 02 20:34:54.141113 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:54.141087    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-p5xht_c33af0ce-1ea6-4378-811b-b019eae0f126/openshift-lws-operator/0.log"
Jul 02 20:34:54.820353 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:54.820270    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zv5kb_f8b24f26-4aa4-466a-b0cc-626262ba06c6/istio-proxy/0.log"
Jul 02 20:34:55.015049 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:55.015018    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b994b5d7-2kb6m_81a4e755-440f-465f-9b48-62cdcaeb8699/kube-auth-proxy/0.log"
Jul 02 20:34:55.055209 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:55.055174    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/0.log"
Jul 02 20:34:55.085167 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:55.085130    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82rts_3968ec40-f10c-4295-92dc-2ae56302b1a1/istio-proxy/1.log"
Jul 02 20:34:55.110603 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:55.110565    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fvqcc_458cb335-97c6-478c-b753-d03290eca4af/payload-pre-processing/0.log"
Jul 02 20:34:55.149034 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:55.148998    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vxjlr_6f884b05-009b-4cd7-b404-114024f7838f/payload-processing/0.log"
Jul 02 20:34:59.092516 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:59.092448    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-w5z6c_10e1b9c6-9d49-4ff1-990c-5672ed99f5a2/migrator/0.log"
Jul 02 20:34:59.115995 ip-10-0-142-141 kubenswrapper[2546]: I0702 20:34:59.115963    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-w5z6c_10e1b9c6-9d49-4ff1-990c-5672ed99f5a2/graceful-termination/0.log"