Jul 06 19:05:22.758940 ip-10-0-139-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:05:25.325339 ip-10-0-139-205 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:25.325339 ip-10-0-139-205 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:05:25.325339 ip-10-0-139-205 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:25.325339 ip-10-0-139-205 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:05:25.325339 ip-10-0-139-205 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:25.326078 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.325960    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:05:25.331304 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331289    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331306    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331311    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331315    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331318    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331321    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331324    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331326    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331329    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331332    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331335    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331339    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331343    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331347    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.331343 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331350    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331353    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331356    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331359    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331362    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331365    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331368    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331371    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331374    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331376    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331379    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331381    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331384    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331386    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331389    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331391    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331394    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331396    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331399    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331401    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.331658 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331404    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331407    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331409    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331412    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331414    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331418    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331421    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331423    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331426    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331429    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331431    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331434    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331437    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331439    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331442    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331445    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331447    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331450    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331453    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331455    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.332144 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331458    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331461    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331463    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331466    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331469    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331473    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331476    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331479    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331482    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331485    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331487    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331491    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331494    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331497    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331500    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331502    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331505    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331515    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331518    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331521    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.332622 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331523    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331525    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331528    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331531    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331533    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331535    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331539    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331542    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331545    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331547    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331550    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331552    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331555    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331558    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331560    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331563    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331565    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331568    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331570    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331573    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.333099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331575    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331577    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331580    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331583    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.331586    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332312    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332318    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332321    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332324    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332326    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332329    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332332    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332335    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332337    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332341    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332343    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332346    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332348    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332352    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332355    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.333585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332357    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332360    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332362    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332365    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332367    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332370    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332373    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332375    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332379    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332381    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332384    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332386    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332388    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332391    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332394    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332398    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332402    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332404    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.334149 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332407    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332410    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332413    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332415    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332418    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332425    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332428    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332431    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332433    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332436    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332438    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332441    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332444    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332447    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332450    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332453    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332455    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332458    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332461    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332464    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332467    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.334585 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332470    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332473    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332475    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332478    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332481    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332483    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332486    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332488    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332491    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332493    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332496    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332498    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332501    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332503    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332506    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332509    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332512    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332521    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332524    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332527    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.335102 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332530    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332532    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332540    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332544    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332547    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332550    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332552    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332555    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332557    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332560    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332562    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332565    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332568    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332570    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332573    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332575    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332578    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332580    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332582    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332585    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.335604 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332587    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332590    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332594    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332597    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332600    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.332982    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333004    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333007    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333011    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333014    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333017    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333020    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333022    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333025    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333027    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333030    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333032    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333035    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333038    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.336096 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333041    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333043    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333046    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333048    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333051    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333054    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333056    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333059    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333061    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333064    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333066    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333069    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333071    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333073    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333076    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333079    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333081    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333084    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333087    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333090    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.336535 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333093    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333095    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333098    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333114    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333117    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333121    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333124    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333127    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333130    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333133    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333135    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333138    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333140    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333143    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333145    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333147    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333150    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333152    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333155    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.337055 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333157    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333160    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333162    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333165    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333167    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333170    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333172    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333178    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333180    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333183    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333185    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333188    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333191    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333193    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333196    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333198    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333201    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333204    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333207    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333210    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.337500 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333213    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333215    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333218    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333220    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333223    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333226    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333229    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333231    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333234    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333236    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333239    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333242    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333244    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333246    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333249    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333251    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333254    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333256    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333258    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333262    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.337974 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333265    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333267    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333270    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333272    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333275    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333277    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333344    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333351    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333358    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333362    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333367    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333370    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333377    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333381    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333384    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333387    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333391    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333394    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333397    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333400    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333403    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333406    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333409    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333412    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:05:25.338492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333416    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333419    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333422    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333426    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333429    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333433    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333436    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333440    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333443    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333446    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333449    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333452    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333455    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333458    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333462    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333465    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333467    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333470    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333473    2553 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333476    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333483    2553 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333486    2553 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333489    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333492    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:05:25.339076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333495    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333498    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333501    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333504    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333507    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333509    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333512    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333515    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333519    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333522    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333525    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333527    2553 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333531    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333534    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333537    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333542    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333545    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333548    2553 flags.go:64] FLAG: --help="false"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333550    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333553    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333556    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333559    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333562    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:05:25.339636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333566    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333568    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333571    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333574    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333577    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333582    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333586    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333589    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333592    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333595    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333598    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333601    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333603    2553 flags.go:64] FLAG: --lock-file=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333606    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333609    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333613    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333618    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333621    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333623    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333626    2553 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333629    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333632    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333635    2553 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333638    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333643    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:05:25.340406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333646    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333650    2553 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333653    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333656    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333659    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333662    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333665    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333668    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333671    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333682    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333685    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333688    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333692    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333696    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333701    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333704    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333707    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333710    2553 flags.go:64] FLAG: --port="10250"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333713    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333716    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-046a13f9512faa68d"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333719    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333722    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333725    2553 flags.go:64] FLAG: --register-node="true"
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333727    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:05:25.341466 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333731    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333733    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333736    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333739    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333742    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333745    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333748    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333751    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333757    2553 flags.go:64] FLAG: --runonce="false"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333759    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333763    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333765    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333768    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333771    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333774    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333777    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333780    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333783    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333785    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333788    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333792    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333795    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333799    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333802    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333807    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:05:25.342420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333810    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333813    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333816    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333819    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333822    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333824    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333827    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333830    2553 flags.go:64] FLAG: --v="2"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333833    2553 flags.go:64] FLAG: --version="false"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333837    2553 flags.go:64] FLAG: --vmodule=""
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333841    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.333844    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333954    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333958    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333961    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333965    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333968    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333970    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333973    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333975    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333978    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333981    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.343293 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.333998    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334003    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334007    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334011    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334015    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334021    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334024    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334027    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334030    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334033    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334036    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334038    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334041    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334044    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334047    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334049    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334052    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334056    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334060    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.344238 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334065    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334068    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334071    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334074    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334077    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334079    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334083    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334086    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334088    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334091    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334094    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334096    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334099    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334101    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334104    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334107    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334110    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334112    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334116    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.344805 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334119    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334122    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334124    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334137    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334140    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334144    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334146    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334149    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334152    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334155    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334157    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334160    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334163    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334166    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334168    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334171    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334174    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334176    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334179    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334182    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.345507 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334185    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334188    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334191    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334193    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334196    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334198    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334201    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334203    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334206    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334208    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334211    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334214    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334216    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334219    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334222    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334225    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334228    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334231    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334233    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334236    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334238    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.346340 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334241    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334243    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334246    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334248    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334251    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334253    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334256    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334258    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334261    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.334263    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.334785    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.342255    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.342275    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.342936    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.342949    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:05:25.346924 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343051    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343059    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343064    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343069    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343072    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343076    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343080    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343085    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343088    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343093    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343097    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343102    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343105    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343110    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343114    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343119    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343123    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343127    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343132    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343136    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.347442 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343140    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343144    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343148    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343153    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343157    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343161    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343165    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343169    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343175    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343180    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343185    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343189    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343193    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343198    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343202    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343206    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343210    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343215    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343219    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.347939 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343223    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343228    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343232    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343236    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343240    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343245    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343251    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343257    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343262    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343266    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343271    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343276    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343280    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343284    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343288    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343292    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343296    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343300    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343304    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.348474 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343308    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343312    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343316    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343321    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343336    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343343    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343347    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343352    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343356    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343360    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343365    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343369    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343374    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343378    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343382    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343387    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343391    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343395    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343400    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343404    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.348966 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343408    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343412    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343416    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343421    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343425    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343429    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343433    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343438    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343442    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343446    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343451    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343457    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343463    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343468    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343472    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343477    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343482    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343487    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343492    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343497    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.349470 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343501    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.343509    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343691    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343699    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343704    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343709    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343714    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343719    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343725    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343729    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343736    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343742    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343747    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343751    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:25.350016 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343755    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343761    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343765    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343769    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343773    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343778    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343782    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343786    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343790    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343794    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343799    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343803    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343807    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343811    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343815    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343820    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343825    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343829    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343833    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343837    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343842    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:25.350354 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343846    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343850    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343854    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343858    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343863    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343867    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343872    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343876    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343880    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343884    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343888    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343892    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343896    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343901    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343904    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343909    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343913    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343917    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343921    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343925    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:25.350868 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343930    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343936    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343942    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343946    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343951    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343956    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343960    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343964    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343969    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343973    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343977    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.343981    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344002    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344007    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344012    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344017    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344022    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344026    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344030    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:25.351392 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344035    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344038    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344042    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344046    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344051    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344054    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344059    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344063    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344067    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344071    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344075    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344079    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344083    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344087    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344091    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344096    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344100    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344104    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344108    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344112    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:25.351902 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344116    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344120    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344125    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344129    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344133    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344138    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:25.344142    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.344150    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.344325    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.347084    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.348279    2553 server.go:1019] "Starting client certificate rotation"
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.348386    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:25.352605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.348417    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:25.353844 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.353776    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:25.355930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.355908    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:25.364240 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.364215    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:05:25.367805 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.367788    2553 log.go:25] "Validated CRI v1 image API"
Jul 06 19:05:25.368651 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.368636    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:05:25.370662 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.370641    2553 fs.go:135] Filesystem UUIDs: map[4abbd443-7cf3-4c26-8455-007e867e7aff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a4583579-ab67-48a3-906a-3369e28610ee:/dev/nvme0n1p4]
Jul 06 19:05:25.370738 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.370661    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:05:25.375656 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.375539    2553 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:25.375030313 +0000 UTC m=+1.335473000 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100365 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27e48790f1615201dc5950b2f59237 SystemUUID:ec27e487-90f1-6152-01dc-5950b2f59237 BootID:5959856c-1fc7-458f-84db-b23b3ae3dacf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:36:2f:ea:d6:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:36:2f:ea:d6:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:44:9b:3c:19:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:05:25.375656 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.375646    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:05:25.375821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.375751    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:05:25.378626 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.378597    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:05:25.378820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.378628    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:05:25.379740 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.379729    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:05:25.379782 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.379743    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:05:25.379782 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.379751    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:25.380343 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.380333    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:25.380817 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.380802    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:25.381776 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.381765    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:05:25.385835 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.385823    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:25.386011 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386002    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:05:25.386043 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386030    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:05:25.386071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386045    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:05:25.386071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386064    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:05:25.386120 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386094    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:05:25.386120 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386105    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:05:25.386537 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386525    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:25.386573 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.386543    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:25.388398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.388382    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:05:25.391443 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.391422    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:05:25.391522 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.391470    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:05:25.392429 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392418    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392435    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392442    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392452    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392461    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392466    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:05:25.392473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392474    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:05:25.392628 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392480    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:05:25.392628 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392491    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:05:25.392628 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392499    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:05:25.392628 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392508    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:05:25.392628 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.392513    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:05:25.393183 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.393168    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:05:25.393245 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.393237    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:05:25.396976 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.396951    2553 server.go:1268] "Started kubelet"
Jul 06 19:05:25.397109 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.397048    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:05:25.397286 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.397221    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:05:25.397374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.397310    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:05:25.397713 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.397695    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:05:25.397713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.397706    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:05:25.397862 ip-10-0-139-205 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:05:25.398336 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.398151    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:05:25.398544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.398469    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:05:25.399550 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.399536    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:05:25.402090 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.402070    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:05:25.403699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.403686    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:05:25.403766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.403698    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:25.403838 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.403805    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.404309 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404287    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:05:25.404381 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404365    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:05:25.404381 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404380    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:05:25.404544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404515    2553 factory.go:55] Registering systemd factory
Jul 06 19:05:25.404544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404530    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:05:25.404544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404537    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:05:25.404544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404547    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:05:25.404751 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404731    2553 factory.go:153] Registering CRI-O factory
Jul 06 19:05:25.404751 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404744    2553 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:05:25.404839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404790    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:05:25.404839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404818    2553 factory.go:103] Registering Raw factory
Jul 06 19:05:25.404839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.404833    2553 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:05:25.405205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.405191    2553 manager.go:349] Starting recovery of all containers
Jul 06 19:05:25.405666 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.404776    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e23ee459  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.396923481 +0000 UTC m=+1.357366171,LastTimestamp:2026-07-06 19:05:25.396923481 +0000 UTC m=+1.357366171,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.412980 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.412808    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:05:25.413533 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.413510    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:05:25.415632 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.415606    2553 manager.go:354] Recovery completed
Jul 06 19:05:25.421483 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.421470    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.423883 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.423866    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.423949 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.423900    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.423949 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.423911    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.424511 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.424496    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:05:25.424511 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.424508    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:05:25.424611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.424517    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.424611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.424522    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:25.425264 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.425251    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.425310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.425274    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.425310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.425283    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.426076 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.425973    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3da44b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423883444 +0000 UTC m=+1.384326131,LastTimestamp:2026-07-06 19:05:25.423883444 +0000 UTC m=+1.384326131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.426692 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.426681    2553 policy_none.go:49] "None policy: Start"
Jul 06 19:05:25.426726 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.426697    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:05:25.426726 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.426707    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:05:25.428752 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.428740    2553 policy_none.go:47] "Start"
Jul 06 19:05:25.437213 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.437142    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3da97f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423904752 +0000 UTC m=+1.384347438,LastTimestamp:2026-07-06 19:05:25.423904752 +0000 UTC m=+1.384347438,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.448684 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.448499    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3dac78b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423916939 +0000 UTC m=+1.384359628,LastTimestamp:2026-07-06 19:05:25.423916939 +0000 UTC m=+1.384359628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.459806 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.459738    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-205.ec2.internal.18bfc8c4e3da44b4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3da44b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423883444 +0000 UTC m=+1.384326131,LastTimestamp:2026-07-06 19:05:25.425262786 +0000 UTC m=+1.385705473,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.468692 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.468619    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-205.ec2.internal.18bfc8c4e3da97f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3da97f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423904752 +0000 UTC m=+1.384347438,LastTimestamp:2026-07-06 19:05:25.425278864 +0000 UTC m=+1.385721551,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.474661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.474645    2553 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:05:25.474775 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.474682    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:05:25.474775 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.474693    2553 server.go:87] "Starting device plugin registration server"
Jul 06 19:05:25.475034 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.475015    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:05:25.475132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.475035    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:05:25.475318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.475296    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:05:25.475412 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.475388    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:05:25.475412 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.475398    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:05:25.475917 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.475863    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:05:25.475979 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.475918    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.481345 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.481279    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-205.ec2.internal.18bfc8c4e3dac78b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e3dac78b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-205.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.423916939 +0000 UTC m=+1.384359628,LastTimestamp:2026-07-06 19:05:25.425287192 +0000 UTC m=+1.385729880,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.487373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.487351    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbmz5"
Jul 06 19:05:25.503891 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.494232    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-205.ec2.internal.18bfc8c4e705edd4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-205.ec2.internal,UID:ip-10-0-139-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-205.ec2.internal,},FirstTimestamp:2026-07-06 19:05:25.477076436 +0000 UTC m=+1.437519110,LastTimestamp:2026-07-06 19:05:25.477076436 +0000 UTC m=+1.437519110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-205.ec2.internal,}"
Jul 06 19:05:25.503891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.496855    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbmz5"
Jul 06 19:05:25.534702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.534661    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:05:25.535933 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.535906    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:05:25.536049 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.535941    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:05:25.536049 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.536020    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:05:25.536136 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.536069    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:05:25.548549 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.548523    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:25.575282 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.575257    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.576241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.576189    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.576241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.576218    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.576241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.576228    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.576377 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.576256    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.586543 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.586522    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.586612 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.586550    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-205.ec2.internal\": node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.598277 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.598251    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.637075 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.637044    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"]
Jul 06 19:05:25.637169 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.637123    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.639200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.639184    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.639275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.639216    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.639275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.639229    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.641736 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.641723    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.641853 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.641838    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.641891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.641870    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.642500 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642483    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.642500 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642496    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.642615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642512    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.642615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642517    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.642615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642522    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.642615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.642526    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.644889 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.644872    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.644972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.644899    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:25.646301 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.646286    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:25.646389 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.646312    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:25.646389 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.646326    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:25.669771 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.669742    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-205.ec2.internal\" not found" node="ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.674093 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.674076    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-205.ec2.internal\" not found" node="ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.698478 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.698451    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.705767 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.705745    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.705837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.705769    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.705837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.705801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd9d432a42d5b3ab5cf95848f892c920-config\") pod \"kube-apiserver-proxy-ip-10-0-139-205.ec2.internal\" (UID: \"fd9d432a42d5b3ab5cf95848f892c920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.799073 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.799044    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.806404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806381    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.806455 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806414    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.806455 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806432    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd9d432a42d5b3ab5cf95848f892c920-config\") pod \"kube-apiserver-proxy-ip-10-0-139-205.ec2.internal\" (UID: \"fd9d432a42d5b3ab5cf95848f892c920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.806519 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806474    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.806566 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806544    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd9d432a42d5b3ab5cf95848f892c920-config\") pod \"kube-apiserver-proxy-ip-10-0-139-205.ec2.internal\" (UID: \"fd9d432a42d5b3ab5cf95848f892c920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.806602 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.806586    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f07b611a98617965cd93e8b56f8a1fe6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal\" (UID: \"f07b611a98617965cd93e8b56f8a1fe6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.899859 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:25.899781    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:25.972234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.972198    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:25.977537 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:25.977149    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:26.000312 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.000282    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:26.100849 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.100821    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:26.201443 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.201379    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:26.302019 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.301978    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-205.ec2.internal\" not found"
Jul 06 19:05:26.347483 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.347450    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:05:26.347974 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.347630    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:26.374657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.374627    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:26.387292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.387262    2553 apiserver.go:52] "Watching apiserver"
Jul 06 19:05:26.398871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.398850    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:05:26.399757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.399723    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b2tnr","kube-system/konnectivity-agent-s7ckj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7","openshift-image-registry/node-ca-7zh59","openshift-multus/multus-hqpwn","openshift-network-diagnostics/network-check-target-k64tp","openshift-ovn-kubernetes/ovnkube-node-j2vk2","openshift-cluster-node-tuning-operator/tuned-p6zph","openshift-dns/node-resolver-gcbj4","openshift-multus/multus-additional-cni-plugins-kl9nh","openshift-multus/network-metrics-daemon-8pbpw","openshift-network-operator/iptables-alerter-pxtlx"]
Jul 06 19:05:26.402512 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.402491    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.404688 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.404664    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:26.404800 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.404670    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:26.404867 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.404674    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.406784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.406769    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.407356 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.407340    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:05:26.407476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.407460    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tb57k\""
Jul 06 19:05:26.409175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409160    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:26.409285 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.409224    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:26.409462 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409446    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409534 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409474    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-cni-binary-copy\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409534 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409496    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d0947be-97f3-47ba-82df-f223cb340477-agent-certs\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.409534 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409518    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blch7\" (UniqueName: \"kubernetes.io/projected/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-kube-api-access-blch7\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.409679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409542    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-cnibin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409564    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-os-release\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409587    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-socket-dir-parent\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409627    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-netns\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409649    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-bin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409679    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgz5l\" (UniqueName: \"kubernetes.io/projected/2270d9b9-7760-4bb6-be18-dd932afe88b0-kube-api-access-jgz5l\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409704    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-multus\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409726    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-hostroot\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409747    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-conf-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409770    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-daemon-config\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409792    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-etc-kubernetes\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409815    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d0947be-97f3-47ba-82df-f223cb340477-konnectivity-ca\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409851    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-system-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409875    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-k8s-cni-cncf-io\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409897    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-kubelet\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.409930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409927    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-multus-certs\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.410363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409948    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-host\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.410363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.409970    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-serviceca\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.410455 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410401    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:05:26.410597 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410583    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:05:26.410647 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410633    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.410713 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410697    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.410774 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410760    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:05:26.410825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410789    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:05:26.410873 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410847    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fgpct\""
Jul 06 19:05:26.410931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410882    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.411000 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.410937    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.411158 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.411144    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q6kbs\""
Jul 06 19:05:26.411340 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.411328    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.413691 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.413674    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.416176 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.416156    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.419087 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.419063    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.419188 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.419131    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:26.421433 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.421414    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.423590 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.423573    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.423670 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.423634    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:26.425822 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.425809    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.426163 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426142    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n9pt\""
Jul 06 19:05:26.426256 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426178    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:26.426256 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426204    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.426364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426259    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"
Jul 06 19:05:26.426364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426290    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.426468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426452    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:05:26.426524 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426456    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.426574 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426534    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:05:26.426699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426686    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.426763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426686    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5cx5\""
Jul 06 19:05:26.426763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.426714    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws5pk\""
Jul 06 19:05:26.427887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.427872    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.428159 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.428135    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal"]
Jul 06 19:05:26.428159 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.428156    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.428301 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.428216    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.428903 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.428884    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:05:26.429011 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.428921    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75b77\""
Jul 06 19:05:26.431152 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.431136    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:26.431235 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.431194    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.431432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.431415    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h2c44\""
Jul 06 19:05:26.431559 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.431546    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.434912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.434883    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:05:26.435234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435221    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjkqn\""
Jul 06 19:05:26.435327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435236    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:05:26.435327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435314    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:05:26.435464 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435318    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:05:26.435464 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435419    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:05:26.435464 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435433    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:05:26.435763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.435749    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:05:26.466459 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.466437    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mggc4"
Jul 06 19:05:26.475531 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.475508    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal"]
Jul 06 19:05:26.475639 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.475586    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:26.481135 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.481105    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mggc4"
Jul 06 19:05:26.500737 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.500684    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:25 +0000 UTC" deadline="2028-04-02 17:31:15.633504348 +0000 UTC"
Jul 06 19:05:26.500737 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.500733    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15262h25m49.132773933s"
Jul 06 19:05:26.505357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.505341    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:05:26.510148 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510130    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-hostroot\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510228 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510156    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-daemon-config\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510228 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510171    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-etc-kubernetes\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510228 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510191    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-system-cni-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510244    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-hostroot\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510269    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-etc-kubernetes\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510301    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510322    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510337    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovn-node-metrics-cert\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510355    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-conf\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510378    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-device-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510420    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-systemd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510453    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-log-socket\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510477    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-script-lib\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510519    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c488b3-de9c-459b-988f-b516c8a7994a-tmp-dir\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510542    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdlxc\" (UniqueName: \"kubernetes.io/projected/76c488b3-de9c-459b-988f-b516c8a7994a-kube-api-access-gdlxc\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.510584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d0947be-97f3-47ba-82df-f223cb340477-agent-certs\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510594    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510614    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-bin\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510653    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-run\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510675    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510702    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-netns\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510737    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-kubelet\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510739    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-daemon-config\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510778    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-netns\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510792    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-tmp\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510839    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-host\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-var-lib-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510872    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-host\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.510901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510888    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-k8s-cni-cncf-io\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510918    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-multus-certs\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510940    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510978    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-slash\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510999    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-multus-certs\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511000    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511046    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-kubernetes\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.510952    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-run-k8s-cni-cncf-io\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511098    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511127    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-cni-binary-copy\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511208    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blch7\" (UniqueName: \"kubernetes.io/projected/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-kube-api-access-blch7\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511231    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511247    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-netns\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511264    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-config\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511284    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-env-overrides\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.511548 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511319    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-cnibin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511328    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511377    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-cnibin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511386    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-os-release\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511416    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgz5l\" (UniqueName: \"kubernetes.io/projected/2270d9b9-7760-4bb6-be18-dd932afe88b0-kube-api-access-jgz5l\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-kubelet-config\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511483    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-ovn\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511495    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-os-release\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511505    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-iptables-alerter-script\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511539    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-multus\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511563    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-conf-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511586    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d0947be-97f3-47ba-82df-f223cb340477-konnectivity-ca\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511607    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-multus\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511619    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-conf-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511709    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511734    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-dbus\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.512307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511749    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-netd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511770    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-lib-modules\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-system-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511842    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-kubelet\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511867    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-modprobe-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511889    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-system-cni-dir\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511932    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-os-release\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511942    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-kubelet\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512008    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d0947be-97f3-47ba-82df-f223cb340477-konnectivity-ca\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.511979    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512064    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8d4f\" (UniqueName: \"kubernetes.io/projected/4857392f-fe41-4cc0-af20-448893046ff9-kube-api-access-f8d4f\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512101    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2270d9b9-7760-4bb6-be18-dd932afe88b0-cni-binary-copy\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512142    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-systemd-units\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512178    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lfvn\" (UniqueName: \"kubernetes.io/projected/92bc21fe-622d-410f-ac46-368a81c7b87d-kube-api-access-2lfvn\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512224    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-socket-dir-parent\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512259    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512305    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-systemd\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512318    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-multus-socket-dir-parent\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwng4\" (UniqueName: \"kubernetes.io/projected/c285a48f-9e8c-492d-8771-02d7dab6f38e-kube-api-access-bwng4\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512366    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-node-log\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512382    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-sys\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512397    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-tuned\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512411    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zk9p\" (UniqueName: \"kubernetes.io/projected/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-kube-api-access-4zk9p\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512426    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-serviceca\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512441    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rv6h\" (UniqueName: \"kubernetes.io/projected/1f6653cf-a249-419c-ab40-53e76be0e824-kube-api-access-6rv6h\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-host\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512471    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-cnibin\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512486    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-etc-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512500    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-var-lib-kubelet\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-host-slash\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512560    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-bin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512587    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512588    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2270d9b9-7760-4bb6-be18-dd932afe88b0-host-var-lib-cni-bin\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.513852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512634    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.514564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512652    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.514564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512698    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md599\" (UniqueName: \"kubernetes.io/projected/b788c658-2e7d-47e6-a637-21f0b01a78cb-kube-api-access-md599\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.514564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512731    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysconfig\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.514564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512761    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c488b3-de9c-459b-988f-b516c8a7994a-hosts-file\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.514564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.512831    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-serviceca\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.515207 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.515188    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d0947be-97f3-47ba-82df-f223cb340477-agent-certs\") pod \"konnectivity-agent-s7ckj\" (UID: \"2d0947be-97f3-47ba-82df-f223cb340477\") " pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.535839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.535818    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blch7\" (UniqueName: \"kubernetes.io/projected/19932c8f-4f2e-4d20-9e78-b5a05eeb0184-kube-api-access-blch7\") pod \"node-ca-7zh59\" (UID: \"19932c8f-4f2e-4d20-9e78-b5a05eeb0184\") " pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.540575 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.540557    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgz5l\" (UniqueName: \"kubernetes.io/projected/2270d9b9-7760-4bb6-be18-dd932afe88b0-kube-api-access-jgz5l\") pod \"multus-hqpwn\" (UID: \"2270d9b9-7760-4bb6-be18-dd932afe88b0\") " pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.547714 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.547688    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9d432a42d5b3ab5cf95848f892c920.slice/crio-11c63bdc9a327c5209fa6d4e235a55e2d27ae5b6d6f6c43bddcdc6f69360b932 WatchSource:0}: Error finding container 11c63bdc9a327c5209fa6d4e235a55e2d27ae5b6d6f6c43bddcdc6f69360b932: Status 404 returned error can't find the container with id 11c63bdc9a327c5209fa6d4e235a55e2d27ae5b6d6f6c43bddcdc6f69360b932
Jul 06 19:05:26.553635 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.553616    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:05:26.554682 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.554658    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07b611a98617965cd93e8b56f8a1fe6.slice/crio-44a6480f65f807b6b78f317c06a6d6b488727f0a0edd7cef5a3e9d48e5f21aed WatchSource:0}: Error finding container 44a6480f65f807b6b78f317c06a6d6b488727f0a0edd7cef5a3e9d48e5f21aed: Status 404 returned error can't find the container with id 44a6480f65f807b6b78f317c06a6d6b488727f0a0edd7cef5a3e9d48e5f21aed
Jul 06 19:05:26.608357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.608328    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:26.613501 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613483    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.613560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613510    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-bin\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613526    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-run\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.613560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613550    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:26.613652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613604    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-kubelet\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613611    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-bin\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613626    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613679    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-run\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613681    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-kubelet\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613690    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-tmp\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613760    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-var-lib-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.613781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-slash\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613862    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-var-lib-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-kubernetes\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613890    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613909    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-kubernetes\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613937    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613948    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-slash\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.613951    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-netns\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614013 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.614010    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614036    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-run-netns\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614017    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614072    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-config\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.614080    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.114062593 +0000 UTC m=+3.074505270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614108    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-env-overrides\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614132    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-kubelet-config\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614147    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-ovn\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614162    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-iptables-alerter-script\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614186    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614211    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614224    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-kubelet-config\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614234    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-dbus\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614229    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-ovn\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614286    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-dbus\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614318    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-netd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.614571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614344    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-lib-modules\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614385    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-modprobe-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614408    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-os-release\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614432    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614483    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8d4f\" (UniqueName: \"kubernetes.io/projected/4857392f-fe41-4cc0-af20-448893046ff9-kube-api-access-f8d4f\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614503    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614507    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-systemd-units\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614585    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lfvn\" (UniqueName: \"kubernetes.io/projected/92bc21fe-622d-410f-ac46-368a81c7b87d-kube-api-access-2lfvn\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614592    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-env-overrides\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614609    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614630    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-systemd\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614652    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwng4\" (UniqueName: \"kubernetes.io/projected/c285a48f-9e8c-492d-8771-02d7dab6f38e-kube-api-access-bwng4\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614689    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-config\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614692    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-node-log\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614685    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-cni-netd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614738    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-sys\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614763    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-tuned\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.615552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614776    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-systemd\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614782    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-iptables-alerter-script\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614792    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zk9p\" (UniqueName: \"kubernetes.io/projected/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-kube-api-access-4zk9p\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614795    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-node-log\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614837    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rv6h\" (UniqueName: \"kubernetes.io/projected/1f6653cf-a249-419c-ab40-53e76be0e824-kube-api-access-6rv6h\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614850    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-sys\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614850    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-lib-modules\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614936    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-os-release\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615008    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614864    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-host\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614740    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-systemd-units\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.614650    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-modprobe-d\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615009    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-host\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615054    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-cnibin\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615099    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-etc-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615124    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-var-lib-kubelet\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615129    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-cnibin\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616370 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615168    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-etc-openvswitch\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615191    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-var-lib-kubelet\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615197    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-host-slash\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615312    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615316    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615714    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-host-slash\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615818    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615845    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md599\" (UniqueName: \"kubernetes.io/projected/b788c658-2e7d-47e6-a637-21f0b01a78cb-kube-api-access-md599\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615869    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysconfig\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615894    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c488b3-de9c-459b-988f-b516c8a7994a-hosts-file\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615898    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615922    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-system-cni-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615946    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615952    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615968    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysconfig\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.616887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.615971    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616026    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovn-node-metrics-cert\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616027    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6653cf-a249-419c-ab40-53e76be0e824-system-cni-dir\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616051    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-conf\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.616068    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-device-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616097    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-systemd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.616117    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.116101089 +0000 UTC m=+3.076543763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616128    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-run-systemd\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616128    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616144    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-log-socket\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616172    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-script-lib\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616174    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4857392f-fe41-4cc0-af20-448893046ff9-device-dir\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616175    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c488b3-de9c-459b-988f-b516c8a7994a-hosts-file\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616193    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c488b3-de9c-459b-988f-b516c8a7994a-tmp-dir\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616200    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-sysctl-conf\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616216    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdlxc\" (UniqueName: \"kubernetes.io/projected/76c488b3-de9c-459b-988f-b516c8a7994a-kube-api-access-gdlxc\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.617382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616277    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6653cf-a249-419c-ab40-53e76be0e824-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.617843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616339    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b788c658-2e7d-47e6-a637-21f0b01a78cb-log-socket\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616478    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c488b3-de9c-459b-988f-b516c8a7994a-tmp-dir\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.617843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616510    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-tmp\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.617843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.616639    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovnkube-script-lib\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.617843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.617427    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c285a48f-9e8c-492d-8771-02d7dab6f38e-etc-tuned\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.618083 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.618067    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b788c658-2e7d-47e6-a637-21f0b01a78cb-ovn-node-metrics-cert\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.628437 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.628418    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:26.628437 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.628436    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:26.628538 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.628446    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:26.628538 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:26.628488    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.128477599 +0000 UTC m=+3.088920273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:26.632079 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.632060    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdlxc\" (UniqueName: \"kubernetes.io/projected/76c488b3-de9c-459b-988f-b516c8a7994a-kube-api-access-gdlxc\") pod \"node-resolver-gcbj4\" (UID: \"76c488b3-de9c-459b-988f-b516c8a7994a\") " pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.634311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.634286    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8d4f\" (UniqueName: \"kubernetes.io/projected/4857392f-fe41-4cc0-af20-448893046ff9-kube-api-access-f8d4f\") pod \"aws-ebs-csi-driver-node-msrh7\" (UID: \"4857392f-fe41-4cc0-af20-448893046ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.635120 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.635103    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zk9p\" (UniqueName: \"kubernetes.io/projected/654e2ddb-af1a-48e3-ad22-5bbfd27b78e2-kube-api-access-4zk9p\") pod \"iptables-alerter-pxtlx\" (UID: \"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2\") " pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.635958 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.635943    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rv6h\" (UniqueName: \"kubernetes.io/projected/1f6653cf-a249-419c-ab40-53e76be0e824-kube-api-access-6rv6h\") pod \"multus-additional-cni-plugins-kl9nh\" (UID: \"1f6653cf-a249-419c-ab40-53e76be0e824\") " pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.642282 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.642263    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:26.643193 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.643171    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lfvn\" (UniqueName: \"kubernetes.io/projected/92bc21fe-622d-410f-ac46-368a81c7b87d-kube-api-access-2lfvn\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:26.643317 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.643303    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwng4\" (UniqueName: \"kubernetes.io/projected/c285a48f-9e8c-492d-8771-02d7dab6f38e-kube-api-access-bwng4\") pod \"tuned-p6zph\" (UID: \"c285a48f-9e8c-492d-8771-02d7dab6f38e\") " pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.643614 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.643600    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md599\" (UniqueName: \"kubernetes.io/projected/b788c658-2e7d-47e6-a637-21f0b01a78cb-kube-api-access-md599\") pod \"ovnkube-node-j2vk2\" (UID: \"b788c658-2e7d-47e6-a637-21f0b01a78cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.734718 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.734629    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:26.742169 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.742142    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zh59"
Jul 06 19:05:26.745165 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.744996    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0947be_97f3_47ba_82df_f223cb340477.slice/crio-e7b9dc33c70bf5b6658339ac9458126e9279ba6fac38881f106162a909864e88 WatchSource:0}: Error finding container e7b9dc33c70bf5b6658339ac9458126e9279ba6fac38881f106162a909864e88: Status 404 returned error can't find the container with id e7b9dc33c70bf5b6658339ac9458126e9279ba6fac38881f106162a909864e88
Jul 06 19:05:26.751309 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.751283    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19932c8f_4f2e_4d20_9e78_b5a05eeb0184.slice/crio-ca41ca3f60a6849fd7b6153f129b85430a3e7d628c16945f824e111a37598820 WatchSource:0}: Error finding container ca41ca3f60a6849fd7b6153f129b85430a3e7d628c16945f824e111a37598820: Status 404 returned error can't find the container with id ca41ca3f60a6849fd7b6153f129b85430a3e7d628c16945f824e111a37598820
Jul 06 19:05:26.768961 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.768937    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqpwn"
Jul 06 19:05:26.779616 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.779593    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2270d9b9_7760_4bb6_be18_dd932afe88b0.slice/crio-5e6c28db2b868a8a806d96e00757106e7ad5523aa498562eb432ffe12df15d40 WatchSource:0}: Error finding container 5e6c28db2b868a8a806d96e00757106e7ad5523aa498562eb432ffe12df15d40: Status 404 returned error can't find the container with id 5e6c28db2b868a8a806d96e00757106e7ad5523aa498562eb432ffe12df15d40
Jul 06 19:05:26.780979 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.780950    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p6zph"
Jul 06 19:05:26.789088 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.789067    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc285a48f_9e8c_492d_8771_02d7dab6f38e.slice/crio-0dcb30e1d840305a9a1540d2054a54423f38a42d3eaef7d81a595526b6e690ce WatchSource:0}: Error finding container 0dcb30e1d840305a9a1540d2054a54423f38a42d3eaef7d81a595526b6e690ce: Status 404 returned error can't find the container with id 0dcb30e1d840305a9a1540d2054a54423f38a42d3eaef7d81a595526b6e690ce
Jul 06 19:05:26.799537 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.799515    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcbj4"
Jul 06 19:05:26.807739 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.807711    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c488b3_de9c_459b_988f_b516c8a7994a.slice/crio-9268ff5e5b935cf660f81f21d21f93c470e27300075645951405f7ef6e2674ca WatchSource:0}: Error finding container 9268ff5e5b935cf660f81f21d21f93c470e27300075645951405f7ef6e2674ca: Status 404 returned error can't find the container with id 9268ff5e5b935cf660f81f21d21f93c470e27300075645951405f7ef6e2674ca
Jul 06 19:05:26.812852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.812832    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kl9nh"
Jul 06 19:05:26.820841 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.820819    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6653cf_a249_419c_ab40_53e76be0e824.slice/crio-33f3e70c96f03124ac5c6078f21bd2ccb7846d3639875879c95a69a6de011d72 WatchSource:0}: Error finding container 33f3e70c96f03124ac5c6078f21bd2ccb7846d3639875879c95a69a6de011d72: Status 404 returned error can't find the container with id 33f3e70c96f03124ac5c6078f21bd2ccb7846d3639875879c95a69a6de011d72
Jul 06 19:05:26.830883 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.830864    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxtlx"
Jul 06 19:05:26.839707 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.839683    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654e2ddb_af1a_48e3_ad22_5bbfd27b78e2.slice/crio-0ea9d029a27adc48dccdd0416c54bdd9a80846bd2e83ed727fca42e535353bfc WatchSource:0}: Error finding container 0ea9d029a27adc48dccdd0416c54bdd9a80846bd2e83ed727fca42e535353bfc: Status 404 returned error can't find the container with id 0ea9d029a27adc48dccdd0416c54bdd9a80846bd2e83ed727fca42e535353bfc
Jul 06 19:05:26.853918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.853898    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7"
Jul 06 19:05:26.858830 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:26.858808    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:26.862253 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.862231    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4857392f_fe41_4cc0_af20_448893046ff9.slice/crio-7feb15edf302c9de6bf737c68ffff41df7ce059561ce741aa74e54befcfc375b WatchSource:0}: Error finding container 7feb15edf302c9de6bf737c68ffff41df7ce059561ce741aa74e54befcfc375b: Status 404 returned error can't find the container with id 7feb15edf302c9de6bf737c68ffff41df7ce059561ce741aa74e54befcfc375b
Jul 06 19:05:26.867447 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:05:26.867423    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb788c658_2e7d_47e6_a637_21f0b01a78cb.slice/crio-68e57826a672340f976ff23059b0c5d7a07f2946a065b01c391f77f142aa0841 WatchSource:0}: Error finding container 68e57826a672340f976ff23059b0c5d7a07f2946a065b01c391f77f142aa0841: Status 404 returned error can't find the container with id 68e57826a672340f976ff23059b0c5d7a07f2946a065b01c391f77f142aa0841
Jul 06 19:05:27.119842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.119762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:27.119842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.119835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:27.120089 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.119922    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:27.120089 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.119948    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:27.120089 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.120000    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.119969281 +0000 UTC m=+4.080411963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:27.120089 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.120060    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.12001073 +0000 UTC m=+4.080453406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:27.220658 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.220611    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:27.220856 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.220828    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:27.220856 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.220851    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:27.221109 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.220864    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:27.221109 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.220921    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.220901628 +0000 UTC m=+4.181344303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:27.233980 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.233954    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:27.484232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.484141    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:26 +0000 UTC" deadline="2028-03-02 03:20:08.857363901 +0000 UTC"
Jul 06 19:05:27.484232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.484183    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14504h14m41.373186226s"
Jul 06 19:05:27.537565 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.537064    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:27.537565 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:27.537200    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:27.571115 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.571056    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"68e57826a672340f976ff23059b0c5d7a07f2946a065b01c391f77f142aa0841"}
Jul 06 19:05:27.587398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.587352    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcbj4" event={"ID":"76c488b3-de9c-459b-988f-b516c8a7994a","Type":"ContainerStarted","Data":"9268ff5e5b935cf660f81f21d21f93c470e27300075645951405f7ef6e2674ca"}
Jul 06 19:05:27.607615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.607575    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p6zph" event={"ID":"c285a48f-9e8c-492d-8771-02d7dab6f38e","Type":"ContainerStarted","Data":"0dcb30e1d840305a9a1540d2054a54423f38a42d3eaef7d81a595526b6e690ce"}
Jul 06 19:05:27.636408 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.636366    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqpwn" event={"ID":"2270d9b9-7760-4bb6-be18-dd932afe88b0","Type":"ContainerStarted","Data":"5e6c28db2b868a8a806d96e00757106e7ad5523aa498562eb432ffe12df15d40"}
Jul 06 19:05:27.650155 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.650115    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zh59" event={"ID":"19932c8f-4f2e-4d20-9e78-b5a05eeb0184","Type":"ContainerStarted","Data":"ca41ca3f60a6849fd7b6153f129b85430a3e7d628c16945f824e111a37598820"}
Jul 06 19:05:27.657719 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.657683    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal" event={"ID":"f07b611a98617965cd93e8b56f8a1fe6","Type":"ContainerStarted","Data":"44a6480f65f807b6b78f317c06a6d6b488727f0a0edd7cef5a3e9d48e5f21aed"}
Jul 06 19:05:27.674302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.674262    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7" event={"ID":"4857392f-fe41-4cc0-af20-448893046ff9","Type":"ContainerStarted","Data":"7feb15edf302c9de6bf737c68ffff41df7ce059561ce741aa74e54befcfc375b"}
Jul 06 19:05:27.686295 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.686255    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxtlx" event={"ID":"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2","Type":"ContainerStarted","Data":"0ea9d029a27adc48dccdd0416c54bdd9a80846bd2e83ed727fca42e535353bfc"}
Jul 06 19:05:27.704526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.704487    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerStarted","Data":"33f3e70c96f03124ac5c6078f21bd2ccb7846d3639875879c95a69a6de011d72"}
Jul 06 19:05:27.721276 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.721205    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s7ckj" event={"ID":"2d0947be-97f3-47ba-82df-f223cb340477","Type":"ContainerStarted","Data":"e7b9dc33c70bf5b6658339ac9458126e9279ba6fac38881f106162a909864e88"}
Jul 06 19:05:27.746393 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:27.745477    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal" event={"ID":"fd9d432a42d5b3ab5cf95848f892c920","Type":"ContainerStarted","Data":"11c63bdc9a327c5209fa6d4e235a55e2d27ae5b6d6f6c43bddcdc6f69360b932"}
Jul 06 19:05:28.128914 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.128812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:28.128914 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.128898    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:28.129165 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.129045    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:28.129165 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.129108    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.129089234 +0000 UTC m=+6.089531910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:28.129554 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.129526    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:28.129687 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.129616    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.129598958 +0000 UTC m=+6.090041640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:28.232071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.232031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:28.232256 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.232228    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:28.232256 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.232248    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:28.232368 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.232261    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:28.232368 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.232319    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.232301078 +0000 UTC m=+6.192743756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:28.485167 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.485050    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:26 +0000 UTC" deadline="2028-01-05 07:12:46.708699889 +0000 UTC"
Jul 06 19:05:28.485167 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.485118    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13140h7m18.223586141s"
Jul 06 19:05:28.537139 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.536761    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:28.537139 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.536898    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:28.537139 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:28.537007    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:28.537139 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:28.537102    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:29.539040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:29.539009    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:29.539607 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:29.539128    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:30.148541 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:30.148489    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:30.148713 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:30.148569    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:30.148791 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.148735    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.148846 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.148801    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.148780368 +0000 UTC m=+10.109223060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.149253 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.149229    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.149366 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.149291    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.149274593 +0000 UTC m=+10.109717272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.250529 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:30.249814    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:30.250529 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.250046    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:30.250529 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.250071    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:30.250529 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.250085    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.250529 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.250153    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.250136218 +0000 UTC m=+10.210578895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.536472 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:30.536398    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:30.536472 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:30.536444    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:30.536667 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.536534    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:30.536667 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:30.536651    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:31.537047 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:31.537013    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:31.537498 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:31.537149    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:32.536772 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:32.536734    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:32.536965 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:32.536793    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:32.537061 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:32.536953    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:32.537118 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:32.537087    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:33.536849 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:33.536817    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:33.537081 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:33.536942    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:34.184657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:34.184612    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:34.185151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:34.184696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:34.185151 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.184754    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:34.185151 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.184805    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:34.185151 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.184837    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.184814637 +0000 UTC m=+18.145257327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:34.185151 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.184860    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.184849347 +0000 UTC m=+18.145292024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:34.285368 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:34.285332    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:34.285574 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.285514    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:34.285574 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.285536    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:34.285574 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.285548    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:34.285738 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.285613    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.285593954 +0000 UTC m=+18.246036629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:34.536978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:34.536888    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:34.536978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:34.536907    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:34.537204 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.537032    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:34.537429 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:34.537390    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:35.537412 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:35.537371    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:35.537871 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:35.537508    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:36.536633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:36.536596    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:36.536803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:36.536596    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:36.536803 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:36.536730    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:36.536889 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:36.536859    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:37.537027 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:37.536998    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:37.537421 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:37.537103    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:38.536578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:38.536529    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:38.536772 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:38.536531    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:38.536772 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:38.536686    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:38.536898 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:38.536774    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:39.536776 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:39.536686    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:39.537258 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:39.536815    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:40.536233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:40.536198    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:40.536398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:40.536200    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:40.536398 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:40.536331    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:40.536521 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:40.536428    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:41.536559 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:41.536521    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:41.536973 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:41.536652    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:42.245437 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:42.245347    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:42.245437 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:42.245435    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:42.245620 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.245493    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:42.245620 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.245565    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.245546008 +0000 UTC m=+34.205988683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:42.245620 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.245574    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:42.245716 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.245630    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.245612101 +0000 UTC m=+34.206054774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:42.346433 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:42.346395    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:42.346626 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.346563    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:42.346626 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.346589    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:42.346626 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.346599    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:42.346776 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.346655    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.346637364 +0000 UTC m=+34.307080037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:42.536904 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:42.536824    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:42.536904 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:42.536857    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:42.537315 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.536975    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:42.537315 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:42.537085    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:43.537063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:43.537027    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:43.537472 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:43.537157    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:44.536387 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:44.536351    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:44.536387 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:44.536380    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:44.536609 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:44.536484    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:44.536684 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:44.536644    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:45.537424 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:45.537386    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:45.537857 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:45.537503    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:46.536798 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:46.536609    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:46.536950 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:46.536611    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:46.536950 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:46.536901    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:46.537086 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:46.537002    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:46.789285 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:46.789193    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal" event={"ID":"fd9d432a42d5b3ab5cf95848f892c920","Type":"ContainerStarted","Data":"1b732ee65558890815544780278082246b3f65e1f59bae25e1da6677f6c126eb"}
Jul 06 19:05:46.807606 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:46.807557    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-205.ec2.internal" podStartSLOduration=20.807543366 podStartE2EDuration="20.807543366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:46.807076383 +0000 UTC m=+22.767519079" watchObservedRunningTime="2026-07-06 19:05:46.807543366 +0000 UTC m=+22.767986062"
Jul 06 19:05:47.536338 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.536313    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:47.536443 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:47.536424    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:47.792862 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.792688    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="7ac8552087de878a27a9fbf74a2a1d19853dc729ce266a083caa9120b5358696" exitCode=0
Jul 06 19:05:47.793810 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.792769    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"7ac8552087de878a27a9fbf74a2a1d19853dc729ce266a083caa9120b5358696"}
Jul 06 19:05:47.794482 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.794448    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s7ckj" event={"ID":"2d0947be-97f3-47ba-82df-f223cb340477","Type":"ContainerStarted","Data":"b9f313638edfe896635c9f4cad0d4ae15cafb179250809a6031d4f690bf6f2ac"}
Jul 06 19:05:47.796511 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.796481    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"ab4fc644f92dbdd7d722e4515e8944251723a5a5b8f4380aa7511803fce09aac"}
Jul 06 19:05:47.796605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.796534    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"7bea3f5943d14f80b9e09866950951fe29b85488aedb0a85ea81d961463c4194"}
Jul 06 19:05:47.796605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.796574    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"316d4e7b033d87525f23827e8db1c1b4153bb844edbd03806c307d30eb5b8438"}
Jul 06 19:05:47.797931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.797913    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcbj4" event={"ID":"76c488b3-de9c-459b-988f-b516c8a7994a","Type":"ContainerStarted","Data":"ac651c1d69490ec0e6b181e9e24153dd6ec93ced26e29a2af6bbaacaf7a13fb6"}
Jul 06 19:05:47.799383 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.799356    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p6zph" event={"ID":"c285a48f-9e8c-492d-8771-02d7dab6f38e","Type":"ContainerStarted","Data":"e26310bad5e5601bad757cbd21a2404483bec1d8c689be0432b153d7f8cc6924"}
Jul 06 19:05:47.800841 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.800822    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqpwn" event={"ID":"2270d9b9-7760-4bb6-be18-dd932afe88b0","Type":"ContainerStarted","Data":"fe19b4b5a90756f836f936c24d7d84c61dd27f933aab58eaf85910876886f11b"}
Jul 06 19:05:47.802350 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.802322    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zh59" event={"ID":"19932c8f-4f2e-4d20-9e78-b5a05eeb0184","Type":"ContainerStarted","Data":"c09c8ee16081bb567b7cf7033e0b09838c00d446c647f108e75af2f5d273cf29"}
Jul 06 19:05:47.803682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.803662    2553 generic.go:356] "Generic (PLEG): container finished" podID="f07b611a98617965cd93e8b56f8a1fe6" containerID="d7bf4f8a012c39950e54d58119acc528d8282e6ce0c799a51eba91128864af49" exitCode=0
Jul 06 19:05:47.803782 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.803735    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal" event={"ID":"f07b611a98617965cd93e8b56f8a1fe6","Type":"ContainerDied","Data":"d7bf4f8a012c39950e54d58119acc528d8282e6ce0c799a51eba91128864af49"}
Jul 06 19:05:47.804936 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.804920    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7" event={"ID":"4857392f-fe41-4cc0-af20-448893046ff9","Type":"ContainerStarted","Data":"23211b15bf84dd3d9a2bf5ce467220523427a3ffc923c7dacad9d5f74e3f1536"}
Jul 06 19:05:47.835231 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.835190    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s7ckj" podStartSLOduration=3.076815581 podStartE2EDuration="22.83517471s" totalImagesPullingTime="19.758359129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.834714829 +0000 UTC m=+23.795157522" watchObservedRunningTime="2026-07-06 19:05:47.83517471 +0000 UTC m=+23.795617405"
Jul 06 19:05:47.853804 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.853745    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p6zph" podStartSLOduration=3.13671964 podStartE2EDuration="22.853724293s" totalImagesPullingTime="19.717004653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.853272848 +0000 UTC m=+23.813715545" watchObservedRunningTime="2026-07-06 19:05:47.853724293 +0000 UTC m=+23.814166992"
Jul 06 19:05:47.871363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.871273    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gcbj4" podStartSLOduration=3.174449398 podStartE2EDuration="22.871252831s" totalImagesPullingTime="19.696803433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.870869497 +0000 UTC m=+23.831312193" watchObservedRunningTime="2026-07-06 19:05:47.871252831 +0000 UTC m=+23.831695527"
Jul 06 19:05:47.887032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.886966    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7zh59" podStartSLOduration=3.132968541 podStartE2EDuration="22.886952357s" totalImagesPullingTime="19.753983816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.886768124 +0000 UTC m=+23.847210821" watchObservedRunningTime="2026-07-06 19:05:47.886952357 +0000 UTC m=+23.847395053"
Jul 06 19:05:47.906832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:47.906788    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hqpwn" podStartSLOduration=3.147401697 podStartE2EDuration="22.906774066s" totalImagesPullingTime="19.759372369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.906643169 +0000 UTC m=+23.867085856" watchObservedRunningTime="2026-07-06 19:05:47.906774066 +0000 UTC m=+23.867216761"
Jul 06 19:05:48.537180 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.537145    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:48.537180 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.537178    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:48.537416 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:48.537277    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:48.537468 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:48.537409    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:48.810244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.810153    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxtlx" event={"ID":"654e2ddb-af1a-48e3-ad22-5bbfd27b78e2","Type":"ContainerStarted","Data":"e2a7d3ff557721763ea4c97c2327aba0f739d7c0a159568f389fb62147bbeb40"}
Jul 06 19:05:48.813710 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.813671    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"8f81a3dcb1ed8f548296f7603ace288a47a31989a6721438794add607ffa7a23"}
Jul 06 19:05:48.814284 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.814112    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"e9c781f3b0544848753f9d8904e85fa63e32e4b6b5c25eb5d8800bf374d6c1f1"}
Jul 06 19:05:48.814284 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.814223    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"dab502d954ff839da6f8f9511170e3fccc2c7c9d63de8c191e2acab5a89d4e86"}
Jul 06 19:05:48.829850 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:48.829799    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pxtlx" podStartSLOduration=8.852522024 podStartE2EDuration="23.82978383s" totalImagesPullingTime="14.977261806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:48.829445461 +0000 UTC m=+24.789888157" watchObservedRunningTime="2026-07-06 19:05:48.82978383 +0000 UTC m=+24.790226525"
Jul 06 19:05:49.023365 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.023336    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:05:49.264474 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.264386    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:49.264982 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.264960    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:49.487592 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.487491    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:49.023359975Z","UUID":"3ca9899d-383a-402a-addb-df58c015e32f","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:05:49.489035 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.489016    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:05:49.489151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.489056    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:05:49.536940 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.536867    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:49.537131 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:49.536965    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:49.817217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.817140    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal" event={"ID":"f07b611a98617965cd93e8b56f8a1fe6","Type":"ContainerStarted","Data":"b464b26c9905ea3049ed755b596090e417f526b00c920c40abdc63810cf43990"}
Jul 06 19:05:49.818798 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.818773    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7" event={"ID":"4857392f-fe41-4cc0-af20-448893046ff9","Type":"ContainerStarted","Data":"ce5b1ed1187f9c9ad91fa22b220d3b685707a4f4adaa9a5d4c068e771fcfb08e"}
Jul 06 19:05:49.819122 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.819107    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:49.819483 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.819467    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s7ckj"
Jul 06 19:05:49.864489 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:49.864427    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-205.ec2.internal" podStartSLOduration=23.864404497 podStartE2EDuration="23.864404497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:49.835482634 +0000 UTC m=+25.795925331" watchObservedRunningTime="2026-07-06 19:05:49.864404497 +0000 UTC m=+25.824847196"
Jul 06 19:05:50.536945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:50.536918    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:50.536945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:50.536955    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:50.537199 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:50.537081    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:50.537259 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:50.537226    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:50.823811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:50.823724    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"44e36a02b1c65364ca1dca331ce45f49570bade2313761e69ba1b80615e2f378"}
Jul 06 19:05:50.825631 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:50.825610    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7" event={"ID":"4857392f-fe41-4cc0-af20-448893046ff9","Type":"ContainerStarted","Data":"9e0cd5b4d01873884ff9977a4ef0e266b9eeed39b01e037daa64df80e90cb4fb"}
Jul 06 19:05:50.848102 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:50.848049    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msrh7" podStartSLOduration=2.924295354 podStartE2EDuration="24.848028985s" totalImagesPullingTime="21.923733631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.846330545 +0000 UTC m=+26.806773243" watchObservedRunningTime="2026-07-06 19:05:50.848028985 +0000 UTC m=+26.808471682"
Jul 06 19:05:51.536859 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:51.536816    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:51.537050 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:51.536930    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:52.537272 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:52.537175    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:52.537272 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:52.537230    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:52.537786 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:52.537319    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:52.537786 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:52.537448    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:53.537268 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.537074    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:53.537373 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:53.537352    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:53.835303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.835273    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" event={"ID":"b788c658-2e7d-47e6-a637-21f0b01a78cb","Type":"ContainerStarted","Data":"6b11449fe782f7cca0dda3a3ed9e52247276ff1d5eec4d6d6ff55d78e84fd95e"}
Jul 06 19:05:53.835516 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.835491    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:53.835688 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.835672    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:53.835778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.835720    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:53.852356 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.852312    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:53.853211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.853186    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:05:53.866619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:53.866572    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2" podStartSLOduration=7.543166521 podStartE2EDuration="27.866559162s" totalImagesPullingTime="20.323392641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:53.86487025 +0000 UTC m=+29.825312945" watchObservedRunningTime="2026-07-06 19:05:53.866559162 +0000 UTC m=+29.827001889"
Jul 06 19:05:54.536852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:54.536817    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:54.537092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:54.536824    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:54.537092 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:54.536914    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:54.537092 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:54.537055    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:54.840128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:54.840047    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="e965bf0f2b0ac852157e4ed35ee4dba8e43a5c24703f6839902cb0edb3ffbe6b" exitCode=0
Jul 06 19:05:54.842080 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:54.840185    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"e965bf0f2b0ac852157e4ed35ee4dba8e43a5c24703f6839902cb0edb3ffbe6b"}
Jul 06 19:05:55.539019 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:55.538907    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:55.539019 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:55.539010    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:55.850265 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:55.850217    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerStarted","Data":"9a6c33b469eb52627d765985476235df21bc170dca4048abfe52717f426fd715"}
Jul 06 19:05:56.022930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.022895    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2tnr"]
Jul 06 19:05:56.023128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.023048    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:56.023181 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:56.023135    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:56.025603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.025579    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pbpw"]
Jul 06 19:05:56.025726 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.025674    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:56.025774 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:56.025753    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:56.039430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.039401    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k64tp"]
Jul 06 19:05:56.039580 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.039496    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:56.039638 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:56.039575    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:56.854200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.854164    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="9a6c33b469eb52627d765985476235df21bc170dca4048abfe52717f426fd715" exitCode=0
Jul 06 19:05:56.854642 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:56.854227    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"9a6c33b469eb52627d765985476235df21bc170dca4048abfe52717f426fd715"}
Jul 06 19:05:57.540633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:57.540596    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:57.540839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:57.540699    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:57.540839 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:57.540710    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:57.540839 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:57.540817    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:57.541041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:57.540856    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:57.541041 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:57.540918    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:57.859103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:57.859023    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="908aa7a3900d3c75432399964a054ffa1343c901959f553848d5c7e36a8d3700" exitCode=0
Jul 06 19:05:57.859103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:57.859067    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"908aa7a3900d3c75432399964a054ffa1343c901959f553848d5c7e36a8d3700"}
Jul 06 19:05:58.259759 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:58.259724    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:58.259945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:58.259788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:58.259945 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.259905    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:58.259945 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.259918    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:58.260153 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.259968    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret podName:baa3ecdd-36fb-4ccb-8a59-f6e9031a26af nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.259954628 +0000 UTC m=+66.220397319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret") pod "global-pull-secret-syncer-b2tnr" (UID: "baa3ecdd-36fb-4ccb-8a59-f6e9031a26af") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:58.260153 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.259999    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.259977543 +0000 UTC m=+66.220420218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:58.360162 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:58.360128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:58.360393 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.360340    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:58.360393 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.360366    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:58.360393 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.360379    2553 projected.go:196] Error preparing data for projected volume kube-api-access-pcsvc for pod openshift-network-diagnostics/network-check-target-k64tp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:58.360559 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:58.360446    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc podName:2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.3604248 +0000 UTC m=+66.320867475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcsvc" (UniqueName: "kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc") pod "network-check-target-k64tp" (UID: "2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:59.536983 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.536792    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:05:59.537432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.536792    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:05:59.537432 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:59.537097    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2tnr" podUID="baa3ecdd-36fb-4ccb-8a59-f6e9031a26af"
Jul 06 19:05:59.537432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.536792    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:05:59.537432 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:59.537174    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k64tp" podUID="2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be"
Jul 06 19:05:59.537432 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:05:59.537292    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:05:59.804651 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.804579    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-205.ec2.internal" event="NodeReady"
Jul 06 19:05:59.804818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.804705    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:05:59.842212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.842174    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"]
Jul 06 19:05:59.845947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.845919    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:05:59.846946 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.846900    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:05:59.865146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.856131    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:05:59.865146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.856470    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dcvz6\""
Jul 06 19:05:59.865146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.856673    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:05:59.865146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.856906    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:05:59.865146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.857132    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:05:59.875383 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.875298    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"]
Jul 06 19:05:59.876142 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.876108    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.882330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.881650    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"]
Jul 06 19:05:59.882330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.881788    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:05:59.883059 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.882778    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:05:59.883593 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.883490    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:05:59.884752 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.884695    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:05:59.885930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.884970    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55x6z\""
Jul 06 19:05:59.886931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.886911    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 19:05:59.889696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.888486    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"]
Jul 06 19:05:59.889696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.888522    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rxvlr"]
Jul 06 19:05:59.889696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.888631    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.890580 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.890562    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:05:59.892016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.891972    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:05:59.892137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.892035    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:05:59.892205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.892152    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:05:59.892283 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.892225    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvz4b"]
Jul 06 19:05:59.892353 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.892280    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:05:59.892528 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.892510    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:05:59.895047 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895024    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:05:59.895149 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895078    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\""
Jul 06 19:05:59.895326 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895309    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:05:59.895326 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895320    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:05:59.895448 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895348    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"]
Jul 06 19:05:59.895448 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895375    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rxvlr"]
Jul 06 19:05:59.895448 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895402    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvz4b"]
Jul 06 19:05:59.895448 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895415    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:05:59.895448 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.895420    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"]
Jul 06 19:05:59.897954 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.897927    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:05:59.898426 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.898374    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qlc5\""
Jul 06 19:05:59.898502 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.898455    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:05:59.898627 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.898611    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:05:59.971377 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971346    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a39b77-0cdb-4fe0-8db5-399870c8fc73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971414    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971442    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d82b552b-ffc3-445e-a031-16f12723ce1e-config-volume\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971472    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fbr\" (UniqueName: \"kubernetes.io/projected/9840aefb-7455-420b-a2a0-a017cd09b531-kube-api-access-p9fbr\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971488    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971551    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b462-4351-4770-b7ee-88ee250900bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971576    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbm2t\" (UniqueName: \"kubernetes.io/projected/d82b552b-ffc3-445e-a031-16f12723ce1e-kube-api-access-tbm2t\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971600    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djsmk\" (UniqueName: \"kubernetes.io/projected/92f8eab0-7d31-41a8-8713-9423b9b05017-kube-api-access-djsmk\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971635    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkf5\" (UniqueName: \"kubernetes.io/projected/91a39b77-0cdb-4fe0-8db5-399870c8fc73-kube-api-access-ppkf5\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971656    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9840aefb-7455-420b-a2a0-a017cd09b531-tmp\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971690    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971748    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971786    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szq6\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971810    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:05:59.971868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971855    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82b552b-ffc3-445e-a031-16f12723ce1e-tmp-dir\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971883    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971911    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9840aefb-7455-420b-a2a0-a017cd09b531-klusterlet-config\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971936    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971957    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.971979    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f8eab0-7d31-41a8-8713-9423b9b05017-cert\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.972025    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:05:59.972442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:05:59.972055    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9ccb\" (UniqueName: \"kubernetes.io/projected/0859b462-4351-4770-b7ee-88ee250900bd-kube-api-access-v9ccb\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.072672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072582    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.072672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9840aefb-7455-420b-a2a0-a017cd09b531-klusterlet-config\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.072672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072733    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f8eab0-7d31-41a8-8713-9423b9b05017-cert\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072807    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072839    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9ccb\" (UniqueName: \"kubernetes.io/projected/0859b462-4351-4770-b7ee-88ee250900bd-kube-api-access-v9ccb\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072877    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a39b77-0cdb-4fe0-8db5-399870c8fc73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:06:00.072939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072930    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.072955    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d82b552b-ffc3-445e-a031-16f12723ce1e-config-volume\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.073015    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fbr\" (UniqueName: \"kubernetes.io/projected/9840aefb-7455-420b-a2a0-a017cd09b531-kube-api-access-p9fbr\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.073041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.073065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.073158    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.073173    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:00.073244 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.073238    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:00.573219658 +0000 UTC m=+36.533662338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:00.073718 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.073691    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.074207 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074134    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d82b552b-ffc3-445e-a031-16f12723ce1e-config-volume\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074342    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b462-4351-4770-b7ee-88ee250900bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbm2t\" (UniqueName: \"kubernetes.io/projected/d82b552b-ffc3-445e-a031-16f12723ce1e-kube-api-access-tbm2t\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074410    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djsmk\" (UniqueName: \"kubernetes.io/projected/92f8eab0-7d31-41a8-8713-9423b9b05017-kube-api-access-djsmk\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074448    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkf5\" (UniqueName: \"kubernetes.io/projected/91a39b77-0cdb-4fe0-8db5-399870c8fc73-kube-api-access-ppkf5\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9840aefb-7455-420b-a2a0-a017cd09b531-tmp\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074504    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074525    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074557    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7szq6\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074599    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074622    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.074689 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074646    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82b552b-ffc3-445e-a031-16f12723ce1e-tmp-dir\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.075356 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.074944    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82b552b-ffc3-445e-a031-16f12723ce1e-tmp-dir\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.075356 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.075017    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b462-4351-4770-b7ee-88ee250900bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.075356 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.075314    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.076075 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.076050    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9840aefb-7455-420b-a2a0-a017cd09b531-tmp\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.076510 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.076486    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:00.076587 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.076553    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:00.576534616 +0000 UTC m=+36.536977293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:00.076774 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.076748    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.078790 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.078369    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.078790 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.078520    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a39b77-0cdb-4fe0-8db5-399870c8fc73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:06:00.078790 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.078743    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-ca\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.079040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.078807    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.079040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.078893    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9840aefb-7455-420b-a2a0-a017cd09b531-klusterlet-config\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.079188 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.079151    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.079415 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.079293    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.079415 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.079358    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0859b462-4351-4770-b7ee-88ee250900bd-hub\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.079780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.079763    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f8eab0-7d31-41a8-8713-9423b9b05017-cert\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:06:00.083970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.083915    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.084687 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.084640    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fbr\" (UniqueName: \"kubernetes.io/projected/9840aefb-7455-420b-a2a0-a017cd09b531-kube-api-access-p9fbr\") pod \"klusterlet-addon-workmgr-d9d6c9cf9-b85df\" (UID: \"9840aefb-7455-420b-a2a0-a017cd09b531\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.086036 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.085963    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djsmk\" (UniqueName: \"kubernetes.io/projected/92f8eab0-7d31-41a8-8713-9423b9b05017-kube-api-access-djsmk\") pod \"ingress-canary-fvz4b\" (UID: \"92f8eab0-7d31-41a8-8713-9423b9b05017\") " pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:06:00.086572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.086547    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szq6\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.086663 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.086547    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9ccb\" (UniqueName: \"kubernetes.io/projected/0859b462-4351-4770-b7ee-88ee250900bd-kube-api-access-v9ccb\") pod \"cluster-proxy-proxy-agent-f648c84b7-wlb4r\" (UID: \"0859b462-4351-4770-b7ee-88ee250900bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.086832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.086806    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkf5\" (UniqueName: \"kubernetes.io/projected/91a39b77-0cdb-4fe0-8db5-399870c8fc73-kube-api-access-ppkf5\") pod \"managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9\" (UID: \"91a39b77-0cdb-4fe0-8db5-399870c8fc73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:06:00.087416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.087392    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbm2t\" (UniqueName: \"kubernetes.io/projected/d82b552b-ffc3-445e-a031-16f12723ce1e-kube-api-access-tbm2t\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.168574 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.168537    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:06:00.202403 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.202353    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:00.209747 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.209721    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:06:00.234357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.234044    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvz4b"
Jul 06 19:06:00.340122 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.340023    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"]
Jul 06 19:06:00.348576 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:00.348310    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a39b77_0cdb_4fe0_8db5_399870c8fc73.slice/crio-3a2cc2eb6027fe4645c369d2fa639521e534cacf36a8c8188f09ae7d194ddddf WatchSource:0}: Error finding container 3a2cc2eb6027fe4645c369d2fa639521e534cacf36a8c8188f09ae7d194ddddf: Status 404 returned error can't find the container with id 3a2cc2eb6027fe4645c369d2fa639521e534cacf36a8c8188f09ae7d194ddddf
Jul 06 19:06:00.370795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.370755    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"]
Jul 06 19:06:00.374253 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:00.374224    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9840aefb_7455_420b_a2a0_a017cd09b531.slice/crio-6f5b22b975273b681d783df35aa3298bb6c7de24761125fa4a1352693704abaa WatchSource:0}: Error finding container 6f5b22b975273b681d783df35aa3298bb6c7de24761125fa4a1352693704abaa: Status 404 returned error can't find the container with id 6f5b22b975273b681d783df35aa3298bb6c7de24761125fa4a1352693704abaa
Jul 06 19:06:00.394361 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.394331    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"]
Jul 06 19:06:00.396799 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:00.396770    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0859b462_4351_4770_b7ee_88ee250900bd.slice/crio-900ea7aa0277edd023898f1782b43044764d2dad3d3953c32c3b522f0a30470b WatchSource:0}: Error finding container 900ea7aa0277edd023898f1782b43044764d2dad3d3953c32c3b522f0a30470b: Status 404 returned error can't find the container with id 900ea7aa0277edd023898f1782b43044764d2dad3d3953c32c3b522f0a30470b
Jul 06 19:06:00.408299 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.408249    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvz4b"]
Jul 06 19:06:00.409647 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:00.409621    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f8eab0_7d31_41a8_8713_9423b9b05017.slice/crio-2149c9cca35e954a9aee8f5c16459d81604d494bce786272ca841ac508c94f6c WatchSource:0}: Error finding container 2149c9cca35e954a9aee8f5c16459d81604d494bce786272ca841ac508c94f6c: Status 404 returned error can't find the container with id 2149c9cca35e954a9aee8f5c16459d81604d494bce786272ca841ac508c94f6c
Jul 06 19:06:00.579682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.579641    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.579734    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.579809    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.579828    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.579858    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.579900    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.5798784 +0000 UTC m=+37.540321075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:00.580531 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:00.579921    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.579912417 +0000 UTC m=+37.540355096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:00.875674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.875580    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerStarted","Data":"6f5b22b975273b681d783df35aa3298bb6c7de24761125fa4a1352693704abaa"}
Jul 06 19:06:00.876826 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.876796    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvz4b" event={"ID":"92f8eab0-7d31-41a8-8713-9423b9b05017","Type":"ContainerStarted","Data":"2149c9cca35e954a9aee8f5c16459d81604d494bce786272ca841ac508c94f6c"}
Jul 06 19:06:00.878193 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.878159    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerStarted","Data":"900ea7aa0277edd023898f1782b43044764d2dad3d3953c32c3b522f0a30470b"}
Jul 06 19:06:00.879360 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:00.879336    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerStarted","Data":"3a2cc2eb6027fe4645c369d2fa639521e534cacf36a8c8188f09ae7d194ddddf"}
Jul 06 19:06:01.541529 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.541467    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:06:01.541718 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.541591    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:06:01.541846 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.541808    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:06:01.544549 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.544525    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:01.544672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.544533    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\""
Jul 06 19:06:01.545913 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.545886    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:01.546045 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.545940    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:01.546045 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.545956    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:01.546151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.545889    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\""
Jul 06 19:06:01.589226 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.589183    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:01.589287    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:01.589362    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:01.589414    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:01.589430    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:01.589451    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.589427448 +0000 UTC m=+39.549870129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:01.589629 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:01.589481    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.589464291 +0000 UTC m=+39.549906981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:02.892872 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:02.892827    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="ee309fee3b6b2cf1206be829475e8eee1745ba302d576a925514b2c636135b59" exitCode=0
Jul 06 19:06:02.893399 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:02.892889    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"ee309fee3b6b2cf1206be829475e8eee1745ba302d576a925514b2c636135b59"}
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:03.608056    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:03.608154    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:03.608335    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:03.608417    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.608396452 +0000 UTC m=+43.568839131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:03.608867    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:03.608886    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:03.608972 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:03.608934    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.608918131 +0000 UTC m=+43.569360819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:03.902063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:03.901684    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f6653cf-a249-419c-ab40-53e76be0e824" containerID="33934bdb1759089db6633d706525fbaf6214d3e70978033b2f6dfb698f8fc689" exitCode=0
Jul 06 19:06:03.902063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:03.901744    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerDied","Data":"33934bdb1759089db6633d706525fbaf6214d3e70978033b2f6dfb698f8fc689"}
Jul 06 19:06:07.642401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.642372    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.642455    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:07.642527    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:07.642546    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:07.642564    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:07.642613    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:15.642594186 +0000 UTC m=+51.603036879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:07.642780 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:07.642630    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:15.64262174 +0000 UTC m=+51.603064424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:07.912645 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.912546    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvz4b" event={"ID":"92f8eab0-7d31-41a8-8713-9423b9b05017","Type":"ContainerStarted","Data":"dc5b830af1904b4adf1306b91fba6c904af18d03309c056536d324150d181b03"}
Jul 06 19:06:07.914479 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.914449    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerStarted","Data":"9824cdd1e2b5fbde903deaa2fa3679bfc28c8a608cdeeb579486337e4cec3e99"}
Jul 06 19:06:07.914592 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.914491    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerStarted","Data":"18d3c4be0fa917b56a0fcada23034743c7fe949b83c173babb444a42911a75e3"}
Jul 06 19:06:07.918019 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.917978    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" event={"ID":"1f6653cf-a249-419c-ab40-53e76be0e824","Type":"ContainerStarted","Data":"9fb18b1fad545ee439cb0761b1d52cf1d9e94bec7e896a336511a5d2e7a1eec3"}
Jul 06 19:06:07.919462 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.919435    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerStarted","Data":"9e4df9a8a5c723ee193c410dc87b00d65192ab0df7f65f26ee551c5be2c9a1d8"}
Jul 06 19:06:07.931413 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.931372    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvz4b" podStartSLOduration=1.777734432 podStartE2EDuration="8.931360366s" totalImagesPullingTime="7.153625934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:07.930674007 +0000 UTC m=+43.891116703" watchObservedRunningTime="2026-07-06 19:06:07.931360366 +0000 UTC m=+43.891803085"
Jul 06 19:06:07.982842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.982780    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" podStartSLOduration=30.769235643000002 podStartE2EDuration="37.982758373s" totalImagesPullingTime="7.21352273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:07.956498264 +0000 UTC m=+43.916940954" watchObservedRunningTime="2026-07-06 19:06:07.982758373 +0000 UTC m=+43.943201072"
Jul 06 19:06:07.983202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:07.983174    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kl9nh" podStartSLOduration=11.146742482 podStartE2EDuration="42.983165677s" totalImagesPullingTime="31.836423195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:07.981998125 +0000 UTC m=+43.942440814" watchObservedRunningTime="2026-07-06 19:06:07.983165677 +0000 UTC m=+43.943608372"
Jul 06 19:06:08.924000 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:08.923950    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerStarted","Data":"9755e9be5e9b8e457b84b86bf0482a3667e8ca0f657f128e18afbb6d8bc51324"}
Jul 06 19:06:08.950305 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:08.950257    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" podStartSLOduration=31.76447272 podStartE2EDuration="38.950240069s" totalImagesPullingTime="7.185767349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:08.950085166 +0000 UTC m=+44.910527863" watchObservedRunningTime="2026-07-06 19:06:08.950240069 +0000 UTC m=+44.910682765"
Jul 06 19:06:15.709759 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:15.709717    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:15.709802    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:15.709903    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:15.709907    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:15.710032    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:15.710012    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:31.709975264 +0000 UTC m=+67.670417960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:15.710261 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:15.710128    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:31.710109289 +0000 UTC m=+67.670551979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:17.949857 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:17.949813    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerStarted","Data":"a76433bb0bbd42f9f78d73be8d6343266b62c2176c983e291d0bc0a5526f72dd"}
Jul 06 19:06:18.953874 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:18.953836    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:18.955427 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:18.955405    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:06:18.974822 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:18.974778    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" podStartSLOduration=31.490245996 podStartE2EDuration="48.974764001s" totalImagesPullingTime="17.484518005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:18.974078414 +0000 UTC m=+54.934521113" watchObservedRunningTime="2026-07-06 19:06:18.974764001 +0000 UTC m=+54.935206696"
Jul 06 19:06:25.865251 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:25.865223    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2vk2"
Jul 06 19:06:30.315572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.315523    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:06:30.316035 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.315616    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:06:30.318916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.318886    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:30.319039 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.319020    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:30.326503 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:30.326472    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:06:30.326573 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:30.326552    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:34.326531075 +0000 UTC m=+130.286973766 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : secret "metrics-daemon-secret" not found
Jul 06 19:06:30.329887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.329861    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/baa3ecdd-36fb-4ccb-8a59-f6e9031a26af-original-pull-secret\") pod \"global-pull-secret-syncer-b2tnr\" (UID: \"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af\") " pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:06:30.354054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.354019    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2tnr"
Jul 06 19:06:30.417014 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.416929    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:06:30.420263 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.420238    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:30.430856 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.430829    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:30.440828 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.440805    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcsvc\" (UniqueName: \"kubernetes.io/projected/2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be-kube-api-access-pcsvc\") pod \"network-check-target-k64tp\" (UID: \"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be\") " pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:06:30.484456 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.484421    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2tnr"]
Jul 06 19:06:30.487546 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:30.487516    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa3ecdd_36fb_4ccb_8a59_f6e9031a26af.slice/crio-3d2be366f6d5cc4b1bf93c9b52ac3ff60fc077b8e1c239ce7dcbe9a24bd66928 WatchSource:0}: Error finding container 3d2be366f6d5cc4b1bf93c9b52ac3ff60fc077b8e1c239ce7dcbe9a24bd66928: Status 404 returned error can't find the container with id 3d2be366f6d5cc4b1bf93c9b52ac3ff60fc077b8e1c239ce7dcbe9a24bd66928
Jul 06 19:06:30.670145 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.670059    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\""
Jul 06 19:06:30.677716 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.677680    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:06:30.808360 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.808329    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k64tp"]
Jul 06 19:06:30.812207 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:06:30.812171    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c36cfa5_707f_4ea9_b6e3_aecc87c7a4be.slice/crio-77652e7cf49a614fb8d15c91580e2b9ab5a00f5161c1dfe5f07844a766997acd WatchSource:0}: Error finding container 77652e7cf49a614fb8d15c91580e2b9ab5a00f5161c1dfe5f07844a766997acd: Status 404 returned error can't find the container with id 77652e7cf49a614fb8d15c91580e2b9ab5a00f5161c1dfe5f07844a766997acd
Jul 06 19:06:30.989600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.989561    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2tnr" event={"ID":"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af","Type":"ContainerStarted","Data":"3d2be366f6d5cc4b1bf93c9b52ac3ff60fc077b8e1c239ce7dcbe9a24bd66928"}
Jul 06 19:06:30.990566 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:30.990540    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k64tp" event={"ID":"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be","Type":"ContainerStarted","Data":"77652e7cf49a614fb8d15c91580e2b9ab5a00f5161c1dfe5f07844a766997acd"}
Jul 06 19:06:31.727227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:31.727181    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:31.727269    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:31.727433    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:31.727497    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:07:03.727477289 +0000 UTC m=+99.687919965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:31.727574    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:31.727586    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:06:31.727713 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:06:31.727619    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:03.727609035 +0000 UTC m=+99.688051916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:06:37.011622 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:37.011591    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2tnr" event={"ID":"baa3ecdd-36fb-4ccb-8a59-f6e9031a26af","Type":"ContainerStarted","Data":"f76b66df3af80bda7b3aad88d3efce885cf1aebac3b29bf16002b8969559b318"}
Jul 06 19:06:37.013004 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:37.012971    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k64tp" event={"ID":"2c36cfa5-707f-4ea9-b6e3-aecc87c7a4be","Type":"ContainerStarted","Data":"2df63371e27ec8b86d0bf8ad7bfa34ca7177ec29ffcf3ad5c0dbfada18dda7be"}
Jul 06 19:06:37.013134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:37.013119    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:06:37.031025 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:37.030950    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b2tnr" podStartSLOduration=65.045007705 podStartE2EDuration="1m11.030934901s" totalImagesPullingTime="5.985927196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.030145421 +0000 UTC m=+72.990588117" watchObservedRunningTime="2026-07-06 19:06:37.030934901 +0000 UTC m=+72.991377614"
Jul 06 19:06:37.050623 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:06:37.050575    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k64tp" podStartSLOduration=66.380379328 podStartE2EDuration="1m12.050558982s" totalImagesPullingTime="5.670179654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.049825167 +0000 UTC m=+73.010267857" watchObservedRunningTime="2026-07-06 19:06:37.050558982 +0000 UTC m=+73.011001677"
Jul 06 19:07:03.757227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:07:03.757189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:07:03.757250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:03.757363    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:03.757427    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:08:07.757411047 +0000 UTC m=+163.717853724 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:03.757366    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:03.757469    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:07:03.757752 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:03.757521    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:07.757510107 +0000 UTC m=+163.717952780 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:07:08.019878 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:07:08.019846    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k64tp"
Jul 06 19:07:34.387040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:07:34.387000    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:07:34.387537 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:34.387143    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:07:34.387537 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:07:34.387208    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.38719263 +0000 UTC m=+252.347635305 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : secret "metrics-daemon-secret" not found
Jul 06 19:08:02.894240 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:02.894198    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a"
Jul 06 19:08:02.928153 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:02.928111    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rxvlr" podUID="d82b552b-ffc3-445e-a031-16f12723ce1e"
Jul 06 19:08:03.256680 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:03.256652    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:08:03.256859 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:03.256652    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:08:04.561124 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:04.561067    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:08:07.834931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:07.834891    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:07.834956    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:07.835072    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:07.835093    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbcf4575c-8bkrt: secret "image-registry-tls" not found
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:07.835095    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:07.835152    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls podName:d82b552b-ffc3-445e-a031-16f12723ce1e nodeName:}" failed. No retries permitted until 2026-07-06 19:10:09.83513933 +0000 UTC m=+285.795582007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls") pod "dns-default-rxvlr" (UID: "d82b552b-ffc3-445e-a031-16f12723ce1e") : secret "dns-default-metrics-tls" not found
Jul 06 19:08:07.835316 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:08:07.835172    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls podName:7ae4b80e-7977-43c1-90df-2b7f703b137a nodeName:}" failed. No retries permitted until 2026-07-06 19:10:09.835162902 +0000 UTC m=+285.795605590 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls") pod "image-registry-6fbcf4575c-8bkrt" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a") : secret "image-registry-tls" not found
Jul 06 19:08:08.272755 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:08.272721    2553 generic.go:356] "Generic (PLEG): container finished" podID="91a39b77-0cdb-4fe0-8db5-399870c8fc73" containerID="9e4df9a8a5c723ee193c410dc87b00d65192ab0df7f65f26ee551c5be2c9a1d8" exitCode=255
Jul 06 19:08:08.272934 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:08.272796    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerDied","Data":"9e4df9a8a5c723ee193c410dc87b00d65192ab0df7f65f26ee551c5be2c9a1d8"}
Jul 06 19:08:08.273173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:08.273157    2553 scope.go:117] "RemoveContainer" containerID="9e4df9a8a5c723ee193c410dc87b00d65192ab0df7f65f26ee551c5be2c9a1d8"
Jul 06 19:08:09.277774 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:09.277738    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerStarted","Data":"104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d"}
Jul 06 19:08:16.536852 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:16.536749    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:08:18.304944 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:18.304848    2553 generic.go:356] "Generic (PLEG): container finished" podID="9840aefb-7455-420b-a2a0-a017cd09b531" containerID="a76433bb0bbd42f9f78d73be8d6343266b62c2176c983e291d0bc0a5526f72dd" exitCode=1
Jul 06 19:08:18.304944 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:18.304922    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerDied","Data":"a76433bb0bbd42f9f78d73be8d6343266b62c2176c983e291d0bc0a5526f72dd"}
Jul 06 19:08:18.305476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:18.305358    2553 scope.go:117] "RemoveContainer" containerID="a76433bb0bbd42f9f78d73be8d6343266b62c2176c983e291d0bc0a5526f72dd"
Jul 06 19:08:18.954341 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:18.954297    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:08:19.309771 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:19.309687    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerStarted","Data":"b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"}
Jul 06 19:08:19.310150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:19.309956    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:08:19.310639 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:08:19.310621    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:09:33.065192 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.065155    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tp5bw"]
Jul 06 19:09:33.068285 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.068257    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.071398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.071371    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:09:33.071536 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.071446    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:09:33.071781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.071763    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:09:33.072941 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.072926    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\""
Jul 06 19:09:33.073057 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.072944    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:09:33.086599 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.086571    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tp5bw"]
Jul 06 19:09:33.136634 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.136599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.136634 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.136637    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjtx\" (UniqueName: \"kubernetes.io/projected/6576a306-41cf-4782-a11b-72f386133e28-kube-api-access-6zjtx\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.136898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.136659    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.136898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.136793    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576a306-41cf-4782-a11b-72f386133e28-crio-socket\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.136898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.136847    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576a306-41cf-4782-a11b-72f386133e28-data-volume\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238058 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238022    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjtx\" (UniqueName: \"kubernetes.io/projected/6576a306-41cf-4782-a11b-72f386133e28-kube-api-access-6zjtx\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238234 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.238157    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.238234 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.238188    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.238434 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.238247    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.738225003 +0000 UTC m=+249.698667697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.238434 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.238266    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.738256857 +0000 UTC m=+249.698699532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.238434 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238415    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576a306-41cf-4782-a11b-72f386133e28-crio-socket\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238462    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576a306-41cf-4782-a11b-72f386133e28-data-volume\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238478    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576a306-41cf-4782-a11b-72f386133e28-crio-socket\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.238807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.238791    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576a306-41cf-4782-a11b-72f386133e28-data-volume\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.252797 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.252771    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjtx\" (UniqueName: \"kubernetes.io/projected/6576a306-41cf-4782-a11b-72f386133e28-kube-api-access-6zjtx\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.742233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.742197    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.742233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:33.742241    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:33.742477 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.742316    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.742477 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.742343    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:33.742477 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.742390    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.742371682 +0000 UTC m=+250.702814389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:33.742477 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:33.742454    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.742435355 +0000 UTC m=+250.702878032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.750071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:34.750024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:34.750071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:34.750073    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:34.750539 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:34.750150    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:34.750539 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:34.750174    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.750539 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:34.750228    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.750214488 +0000 UTC m=+252.710657163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:34.750539 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:34.750243    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.750236973 +0000 UTC m=+252.710679646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:34.993823 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:34.993788    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcbj4_76c488b3-de9c-459b-988f-b516c8a7994a/dns-node-resolver/0.log"
Jul 06 19:09:35.993394 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:35.993358    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zh59_19932c8f-4f2e-4d20-9e78-b5a05eeb0184/node-ca/0.log"
Jul 06 19:09:36.462911 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:36.462874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:09:36.463201 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.463102    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:09:36.463201 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.463174    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs podName:92bc21fe-622d-410f-ac46-368a81c7b87d nodeName:}" failed. No retries permitted until 2026-07-06 19:11:38.463158373 +0000 UTC m=+374.423601047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs") pod "network-metrics-daemon-8pbpw" (UID: "92bc21fe-622d-410f-ac46-368a81c7b87d") : secret "metrics-daemon-secret" not found
Jul 06 19:09:36.602341 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:36.602307    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvz4b_92f8eab0-7d31-41a8-8713-9423b9b05017/serve-healthcheck-canary/0.log"
Jul 06 19:09:36.765132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:36.765029    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:36.765132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:36.765087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:36.765336 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.765184    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:36.765336 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.765245    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:36.765336 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.765265    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.765249796 +0000 UTC m=+256.725692470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:36.765336 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:36.765291    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.765279256 +0000 UTC m=+256.725721929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:40.798044 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:40.797982    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:40.798474 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:40.798060    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:09:40.798474 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:40.798127    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.798110615 +0000 UTC m=+264.758553289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : configmap "kube-rbac-proxy" not found
Jul 06 19:09:40.798474 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:40.798063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:40.798474 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:40.798148    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:40.798474 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:40.798213    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.798198285 +0000 UTC m=+264.758640960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:48.865371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:48.865266    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:48.865371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:48.865324    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:48.865820 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:48.865504    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:48.865820 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:09:48.865584    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls podName:6576a306-41cf-4782-a11b-72f386133e28 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:04.865567417 +0000 UTC m=+280.826010091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tp5bw" (UID: "6576a306-41cf-4782-a11b-72f386133e28") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:09:48.865820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:48.865753    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576a306-41cf-4782-a11b-72f386133e28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:09:50.211414 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:09:50.211360    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" podUID="0859b462-4351-4770-b7ee-88ee250900bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:10:00.211156 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:00.211116    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" podUID="0859b462-4351-4770-b7ee-88ee250900bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:10:04.887468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:04.887421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:10:04.889715 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:04.889692    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576a306-41cf-4782-a11b-72f386133e28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tp5bw\" (UID: \"6576a306-41cf-4782-a11b-72f386133e28\") " pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:10:05.177546 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:05.177453    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tp5bw"
Jul 06 19:10:05.342977 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:05.342933    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tp5bw"]
Jul 06 19:10:05.346533 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:10:05.346503    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6576a306_41cf_4782_a11b_72f386133e28.slice/crio-f50083a941cff8888cf5f922c85d70f8b01b2ce16057427fec9a8fc0a5b66d10 WatchSource:0}: Error finding container f50083a941cff8888cf5f922c85d70f8b01b2ce16057427fec9a8fc0a5b66d10: Status 404 returned error can't find the container with id f50083a941cff8888cf5f922c85d70f8b01b2ce16057427fec9a8fc0a5b66d10
Jul 06 19:10:05.606826 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:05.606783    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tp5bw" event={"ID":"6576a306-41cf-4782-a11b-72f386133e28","Type":"ContainerStarted","Data":"f50083a941cff8888cf5f922c85d70f8b01b2ce16057427fec9a8fc0a5b66d10"}
Jul 06 19:10:06.257392 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:06.257343    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rxvlr" podUID="d82b552b-ffc3-445e-a031-16f12723ce1e"
Jul 06 19:10:06.257900 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:06.257450    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a"
Jul 06 19:10:06.610577 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:06.610504    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:06.610730 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:06.610504    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:09.628473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.628429    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tp5bw" event={"ID":"6576a306-41cf-4782-a11b-72f386133e28","Type":"ContainerStarted","Data":"e78dba30a05adb458b4f28759723687b397c6bf2d6df9e503666ed1eafe5f38b"}
Jul 06 19:10:09.630312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.630287    2553 generic.go:356] "Generic (PLEG): container finished" podID="91a39b77-0cdb-4fe0-8db5-399870c8fc73" containerID="104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d" exitCode=255
Jul 06 19:10:09.630452 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.630335    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerDied","Data":"104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d"}
Jul 06 19:10:09.630452 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.630388    2553 scope.go:117] "RemoveContainer" containerID="9e4df9a8a5c723ee193c410dc87b00d65192ab0df7f65f26ee551c5be2c9a1d8"
Jul 06 19:10:09.630723 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.630704    2553 scope.go:117] "RemoveContainer" containerID="104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d"
Jul 06 19:10:09.630885 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:09.630861    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9_open-cluster-management-agent-addon(91a39b77-0cdb-4fe0-8db5-399870c8fc73)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" podUID="91a39b77-0cdb-4fe0-8db5-399870c8fc73"
Jul 06 19:10:09.933211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.933169    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:09.933211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.933212    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:09.935597 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.935571    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d82b552b-ffc3-445e-a031-16f12723ce1e-metrics-tls\") pod \"dns-default-rxvlr\" (UID: \"d82b552b-ffc3-445e-a031-16f12723ce1e\") " pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:09.935717 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:09.935605    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"image-registry-6fbcf4575c-8bkrt\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") " pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:10.169665 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.169632    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9"
Jul 06 19:10:10.211331 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.211239    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" podUID="0859b462-4351-4770-b7ee-88ee250900bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:10:10.211331 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.211308    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r"
Jul 06 19:10:10.211821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.211784    2553 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9755e9be5e9b8e457b84b86bf0482a3667e8ca0f657f128e18afbb6d8bc51324"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 06 19:10:10.211922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.211843    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" podUID="0859b462-4351-4770-b7ee-88ee250900bd" containerName="service-proxy" containerID="cri-o://9755e9be5e9b8e457b84b86bf0482a3667e8ca0f657f128e18afbb6d8bc51324" gracePeriod=30
Jul 06 19:10:10.216189 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.215968    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55x6z\""
Jul 06 19:10:10.216189 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.216015    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\""
Jul 06 19:10:10.221598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.221576    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:10.221709 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.221664    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:10.381265 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.381233    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:10:10.384826 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:10:10.384797    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae4b80e_7977_43c1_90df_2b7f703b137a.slice/crio-b4bc57dc650d846e548c70835d49a401c4496b8de8e727d6eaa278494b55403f WatchSource:0}: Error finding container b4bc57dc650d846e548c70835d49a401c4496b8de8e727d6eaa278494b55403f: Status 404 returned error can't find the container with id b4bc57dc650d846e548c70835d49a401c4496b8de8e727d6eaa278494b55403f
Jul 06 19:10:10.401839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.401272    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rxvlr"]
Jul 06 19:10:10.406679 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:10:10.406648    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82b552b_ffc3_445e_a031_16f12723ce1e.slice/crio-b7044ac68373ae8905d595823a438fcf2408c17c0b25c9107eed2f4122f4333d WatchSource:0}: Error finding container b7044ac68373ae8905d595823a438fcf2408c17c0b25c9107eed2f4122f4333d: Status 404 returned error can't find the container with id b7044ac68373ae8905d595823a438fcf2408c17c0b25c9107eed2f4122f4333d
Jul 06 19:10:10.636576 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.636491    2553 generic.go:356] "Generic (PLEG): container finished" podID="0859b462-4351-4770-b7ee-88ee250900bd" containerID="9755e9be5e9b8e457b84b86bf0482a3667e8ca0f657f128e18afbb6d8bc51324" exitCode=2
Jul 06 19:10:10.636576 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.636551    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerDied","Data":"9755e9be5e9b8e457b84b86bf0482a3667e8ca0f657f128e18afbb6d8bc51324"}
Jul 06 19:10:10.637116 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.636609    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f648c84b7-wlb4r" event={"ID":"0859b462-4351-4770-b7ee-88ee250900bd","Type":"ContainerStarted","Data":"72ab6e0b16968e54503f1a068eb08f19687b8f5238e405394d012eaf53ecc94f"}
Jul 06 19:10:10.639366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.639333    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tp5bw" event={"ID":"6576a306-41cf-4782-a11b-72f386133e28","Type":"ContainerStarted","Data":"f3a4cb88113c33733a8e5d0fa38983d046c0771cdeb6c74220c41cb8d014a18d"}
Jul 06 19:10:10.641388 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.641263    2553 scope.go:117] "RemoveContainer" containerID="104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d"
Jul 06 19:10:10.641510 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:10.641440    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9_open-cluster-management-agent-addon(91a39b77-0cdb-4fe0-8db5-399870c8fc73)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" podUID="91a39b77-0cdb-4fe0-8db5-399870c8fc73"
Jul 06 19:10:10.642720 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.642693    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" event={"ID":"7ae4b80e-7977-43c1-90df-2b7f703b137a","Type":"ContainerStarted","Data":"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"}
Jul 06 19:10:10.642841 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.642748    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:10.642841 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.642771    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" event={"ID":"7ae4b80e-7977-43c1-90df-2b7f703b137a","Type":"ContainerStarted","Data":"b4bc57dc650d846e548c70835d49a401c4496b8de8e727d6eaa278494b55403f"}
Jul 06 19:10:10.644151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.644127    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rxvlr" event={"ID":"d82b552b-ffc3-445e-a031-16f12723ce1e","Type":"ContainerStarted","Data":"b7044ac68373ae8905d595823a438fcf2408c17c0b25c9107eed2f4122f4333d"}
Jul 06 19:10:10.746706 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:10.746648    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" podStartSLOduration=284.74662705 podStartE2EDuration="4m44.74662705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:10.746590883 +0000 UTC m=+286.707033580" watchObservedRunningTime="2026-07-06 19:10:10.74662705 +0000 UTC m=+286.707069742"
Jul 06 19:10:12.756718 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.756684    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pcqxn"]
Jul 06 19:10:12.760086 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.760056    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.763067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.763039    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:10:12.763067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.763054    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:10:12.763067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.763065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:10:12.763308 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.763157    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp86h\""
Jul 06 19:10:12.764244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.764202    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:10:12.764244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.764228    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:10:12.764422 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.764230    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:10:12.855979 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.855939    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-wtmp\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856043    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvl5h\" (UniqueName: \"kubernetes.io/projected/8d28d30a-8ee5-40f1-9169-4b90b03a945c-kube-api-access-mvl5h\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856067    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-root\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856082    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-textfile\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856228    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-metrics-client-ca\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.856409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.856299    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-sys\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957566 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957529    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvl5h\" (UniqueName: \"kubernetes.io/projected/8d28d30a-8ee5-40f1-9169-4b90b03a945c-kube-api-access-mvl5h\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957583    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-root\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957614    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-textfile\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957638    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957713    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-metrics-client-ca\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957715    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-root\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.957760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957753    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-sys\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957813    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.957857    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-wtmp\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.958012    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-sys\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.958033    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-wtmp\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.958061    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-textfile\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958103 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:12.958068    2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:10:12.958450 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:12.958175    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls podName:8d28d30a-8ee5-40f1-9169-4b90b03a945c nodeName:}" failed. No retries permitted until 2026-07-06 19:10:13.458152589 +0000 UTC m=+289.418595277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls") pod "node-exporter-pcqxn" (UID: "8d28d30a-8ee5-40f1-9169-4b90b03a945c") : secret "node-exporter-tls" not found
Jul 06 19:10:12.958598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.958574    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-metrics-client-ca\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.958674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.958592    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.960886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.960852    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:12.968847 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:12.968820    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvl5h\" (UniqueName: \"kubernetes.io/projected/8d28d30a-8ee5-40f1-9169-4b90b03a945c-kube-api-access-mvl5h\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:13.463122 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.463085    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:13.465480 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.465457    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d28d30a-8ee5-40f1-9169-4b90b03a945c-node-exporter-tls\") pod \"node-exporter-pcqxn\" (UID: \"8d28d30a-8ee5-40f1-9169-4b90b03a945c\") " pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:13.655964 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.655928    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tp5bw" event={"ID":"6576a306-41cf-4782-a11b-72f386133e28","Type":"ContainerStarted","Data":"badf52d46a59511a971b8b21b7db4af340a45f7e633f2eca33fc98639d4d9b9d"}
Jul 06 19:10:13.657653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.657623    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rxvlr" event={"ID":"d82b552b-ffc3-445e-a031-16f12723ce1e","Type":"ContainerStarted","Data":"ac186fa39f164755434666256e15c7fde9c108adb7dfde58d72046a824395ca1"}
Jul 06 19:10:13.657806 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.657665    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rxvlr" event={"ID":"d82b552b-ffc3-445e-a031-16f12723ce1e","Type":"ContainerStarted","Data":"a6bb8907484bc2cd861dc6ab8049d501e5a1b908294ae27f3fe5085e969f08a7"}
Jul 06 19:10:13.657806 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.657701    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:13.671739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.671714    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcqxn"
Jul 06 19:10:13.682670 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:10:13.682639    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d28d30a_8ee5_40f1_9169_4b90b03a945c.slice/crio-89d65373f1fad931e4e73cba10bfca3d16f5f534c6d965867ad86b7687bee0a8 WatchSource:0}: Error finding container 89d65373f1fad931e4e73cba10bfca3d16f5f534c6d965867ad86b7687bee0a8: Status 404 returned error can't find the container with id 89d65373f1fad931e4e73cba10bfca3d16f5f534c6d965867ad86b7687bee0a8
Jul 06 19:10:13.685617 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.685577    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tp5bw" podStartSLOduration=33.106914845 podStartE2EDuration="40.685563058s" totalImagesPullingTime="7.578648213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:13.685078124 +0000 UTC m=+289.645520822" watchObservedRunningTime="2026-07-06 19:10:13.685563058 +0000 UTC m=+289.646005754"
Jul 06 19:10:13.713865 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:13.713763    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rxvlr" podStartSLOduration=252.084709355 podStartE2EDuration="4m14.713746683s" totalImagesPullingTime="2.629037328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:13.712780608 +0000 UTC m=+289.673223306" watchObservedRunningTime="2026-07-06 19:10:13.713746683 +0000 UTC m=+289.674189401"
Jul 06 19:10:14.662758 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:14.662728    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcqxn" event={"ID":"8d28d30a-8ee5-40f1-9169-4b90b03a945c","Type":"ContainerStarted","Data":"89d65373f1fad931e4e73cba10bfca3d16f5f534c6d965867ad86b7687bee0a8"}
Jul 06 19:10:15.667429 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:15.667389    2553 generic.go:356] "Generic (PLEG): container finished" podID="8d28d30a-8ee5-40f1-9169-4b90b03a945c" containerID="3bf05d07816000b2f657a3b474de0b04666eee11ce883ce830b6c45650d912cd" exitCode=0
Jul 06 19:10:15.667936 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:15.667455    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcqxn" event={"ID":"8d28d30a-8ee5-40f1-9169-4b90b03a945c","Type":"ContainerDied","Data":"3bf05d07816000b2f657a3b474de0b04666eee11ce883ce830b6c45650d912cd"}
Jul 06 19:10:16.672684 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:16.672645    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcqxn" event={"ID":"8d28d30a-8ee5-40f1-9169-4b90b03a945c","Type":"ContainerStarted","Data":"ac0093f312a6f1ca4b42126a141c6f63ffc02f59cd0e1e3ade26eeff1fc121ee"}
Jul 06 19:10:16.673095 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:16.672698    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcqxn" event={"ID":"8d28d30a-8ee5-40f1-9169-4b90b03a945c","Type":"ContainerStarted","Data":"99301e8b4dfc58d35a9c5b1da0f61eed7348366e3f4c749e3392222745942070"}
Jul 06 19:10:16.726217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:16.726164    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pcqxn" podStartSLOduration=3.731902504 podStartE2EDuration="4.726146511s" totalImagesPullingTime="930.183471ms" totalInitContainerRuntime="64.060536ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:16.724419902 +0000 UTC m=+292.684862600" watchObservedRunningTime="2026-07-06 19:10:16.726146511 +0000 UTC m=+292.686589207"
Jul 06 19:10:18.680918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:18.680881    2553 generic.go:356] "Generic (PLEG): container finished" podID="9840aefb-7455-420b-a2a0-a017cd09b531" containerID="b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd" exitCode=1
Jul 06 19:10:18.681332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:18.680950    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerDied","Data":"b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"}
Jul 06 19:10:18.681332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:18.681028    2553 scope.go:117] "RemoveContainer" containerID="a76433bb0bbd42f9f78d73be8d6343266b62c2176c983e291d0bc0a5526f72dd"
Jul 06 19:10:18.681424 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:18.681397    2553 scope.go:117] "RemoveContainer" containerID="b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"
Jul 06 19:10:18.681615 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:18.681591    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d9d6c9cf9-b85df_open-cluster-management-agent-addon(9840aefb-7455-420b-a2a0-a017cd09b531)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" podUID="9840aefb-7455-420b-a2a0-a017cd09b531"
Jul 06 19:10:19.310811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:19.310758    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:10:19.537672 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:19.537626    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8pbpw" podUID="92bc21fe-622d-410f-ac46-368a81c7b87d"
Jul 06 19:10:19.685092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:19.685061    2553 scope.go:117] "RemoveContainer" containerID="b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"
Jul 06 19:10:19.685536 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:19.685255    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d9d6c9cf9-b85df_open-cluster-management-agent-addon(9840aefb-7455-420b-a2a0-a017cd09b531)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" podUID="9840aefb-7455-420b-a2a0-a017cd09b531"
Jul 06 19:10:20.202608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:20.202573    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:10:20.687931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:20.687907    2553 scope.go:117] "RemoveContainer" containerID="b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"
Jul 06 19:10:20.688323 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:20.688086    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d9d6c9cf9-b85df_open-cluster-management-agent-addon(9840aefb-7455-420b-a2a0-a017cd09b531)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" podUID="9840aefb-7455-420b-a2a0-a017cd09b531"
Jul 06 19:10:22.537275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:22.537245    2553 scope.go:117] "RemoveContainer" containerID="104bb33a99228b8117c5c9de0da12a2895d569a5f757fb7b461a89690436554d"
Jul 06 19:10:22.695892 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:22.695859    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575d6ddbd4-kfkl9" event={"ID":"91a39b77-0cdb-4fe0-8db5-399870c8fc73","Type":"ContainerStarted","Data":"ed2a40070b9f68ae5b4dcf6623fa02ae4ed315cde1360d4a8a5166e17ad248ef"}
Jul 06 19:10:23.665545 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:23.665513    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rxvlr"
Jul 06 19:10:25.427916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:25.427887    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:10:30.227200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:30.227158    2553 patch_prober.go:28] interesting pod/image-registry-6fbcf4575c-8bkrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:10:30.229644 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:30.227218    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:10:31.536565 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:31.536522    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:10:31.651909 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:31.651881    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:32.536501 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:32.536466    2553 scope.go:117] "RemoveContainer" containerID="b400c6c99ab171156f3b4a368520343a857276e2b05a39d0d768549d3e316bfd"
Jul 06 19:10:32.729052 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:32.729016    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df" event={"ID":"9840aefb-7455-420b-a2a0-a017cd09b531","Type":"ContainerStarted","Data":"d0e37ba1df94746a2e74264c330c86567b41dab52196e4fa0ee3519f30f7ed52"}
Jul 06 19:10:32.729482 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:32.729297    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:10:32.730788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:32.730766    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d9d6c9cf9-b85df"
Jul 06 19:10:32.875463 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:32.875378    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:10:53.300541 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:53.300509    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvz4b_92f8eab0-7d31-41a8-8713-9423b9b05017/serve-healthcheck-canary/0.log"
Jul 06 19:10:57.896465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:57.896405    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerName="registry" containerID="cri-o://9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7" gracePeriod=30
Jul 06 19:10:59.142406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.142382    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:59.202160 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202121    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202171    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202211    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202243    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202261    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202277    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7szq6\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202328    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates\") pod \"7ae4b80e-7977-43c1-90df-2b7f703b137a\" (UID: \"7ae4b80e-7977-43c1-90df-2b7f703b137a\") "
Jul 06 19:10:59.202715 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202584    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:10:59.202916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.202888    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:10:59.205000 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.204942    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:10:59.205000 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.204952    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:10:59.205199 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.205054    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:10:59.205199 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.205108    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6" (OuterVolumeSpecName: "kube-api-access-7szq6") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "kube-api-access-7szq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:10:59.205199 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.205130    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:10:59.211185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.211155    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ae4b80e-7977-43c1-90df-2b7f703b137a" (UID: "7ae4b80e-7977-43c1-90df-2b7f703b137a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303323    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-trusted-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303369    2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-image-registry-private-configuration\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303385    2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ae4b80e-7977-43c1-90df-2b7f703b137a-ca-trust-extracted\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303398    2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ae4b80e-7977-43c1-90df-2b7f703b137a-installation-pull-secrets\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303410    2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303423    2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-bound-sa-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303435    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7szq6\" (UniqueName: \"kubernetes.io/projected/7ae4b80e-7977-43c1-90df-2b7f703b137a-kube-api-access-7szq6\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.303439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.303447    2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ae4b80e-7977-43c1-90df-2b7f703b137a-registry-certificates\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:10:59.821573 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.821534    2553 generic.go:356] "Generic (PLEG): container finished" podID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerID="9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7" exitCode=0
Jul 06 19:10:59.821750 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.821596    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" event={"ID":"7ae4b80e-7977-43c1-90df-2b7f703b137a","Type":"ContainerDied","Data":"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"}
Jul 06 19:10:59.821750 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.821661    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt" event={"ID":"7ae4b80e-7977-43c1-90df-2b7f703b137a","Type":"ContainerDied","Data":"b4bc57dc650d846e548c70835d49a401c4496b8de8e727d6eaa278494b55403f"}
Jul 06 19:10:59.821750 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.821602    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbcf4575c-8bkrt"
Jul 06 19:10:59.821750 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.821689    2553 scope.go:117] "RemoveContainer" containerID="9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"
Jul 06 19:10:59.829405 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.829385    2553 scope.go:117] "RemoveContainer" containerID="9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"
Jul 06 19:10:59.829688 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:10:59.829664    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7\": container with ID starting with 9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7 not found: ID does not exist" containerID="9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"
Jul 06 19:10:59.829761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.829695    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7"} err="failed to get container status \"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7\": rpc error: code = NotFound desc = could not find container \"9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7\": container with ID starting with 9b8d277b2ea08c1859425889a8f182754ae78b74d5235a78b9fb91deabc14cf7 not found: ID does not exist"
Jul 06 19:10:59.847418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.847382    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:10:59.849646 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:10:59.849617    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fbcf4575c-8bkrt"]
Jul 06 19:11:01.541607 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:01.541574    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" path="/var/lib/kubelet/pods/7ae4b80e-7977-43c1-90df-2b7f703b137a/volumes"
Jul 06 19:11:38.497762 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:38.497697    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:11:38.500072 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:38.500048    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92bc21fe-622d-410f-ac46-368a81c7b87d-metrics-certs\") pod \"network-metrics-daemon-8pbpw\" (UID: \"92bc21fe-622d-410f-ac46-368a81c7b87d\") " pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:11:38.949698 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:38.949668    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\""
Jul 06 19:11:38.958051 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:38.958031    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pbpw"
Jul 06 19:11:39.130409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:39.130375    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pbpw"]
Jul 06 19:11:39.133674 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:11:39.133645    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bc21fe_622d_410f_ac46_368a81c7b87d.slice/crio-627ea65467429143ee636d67993c69decfde1f575d13c5b086c0452d4c9226bb WatchSource:0}: Error finding container 627ea65467429143ee636d67993c69decfde1f575d13c5b086c0452d4c9226bb: Status 404 returned error can't find the container with id 627ea65467429143ee636d67993c69decfde1f575d13c5b086c0452d4c9226bb
Jul 06 19:11:39.135571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:39.135556    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:11:39.953860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:39.953816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pbpw" event={"ID":"92bc21fe-622d-410f-ac46-368a81c7b87d","Type":"ContainerStarted","Data":"627ea65467429143ee636d67993c69decfde1f575d13c5b086c0452d4c9226bb"}
Jul 06 19:11:40.958694 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:40.958655    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pbpw" event={"ID":"92bc21fe-622d-410f-ac46-368a81c7b87d","Type":"ContainerStarted","Data":"1210ea9ecb012d9cdd094bd77589d7dcca95a2adafc864b1404c420c2d41be2d"}
Jul 06 19:11:40.959205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:40.958712    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pbpw" event={"ID":"92bc21fe-622d-410f-ac46-368a81c7b87d","Type":"ContainerStarted","Data":"ad36ab10ae2562092f213283f9f2fdff58e2d553db85abf74a0414b7d461e2d6"}
Jul 06 19:11:40.983938 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:11:40.983888    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8pbpw" podStartSLOduration=374.764526429 podStartE2EDuration="6m15.983873575s" totalImagesPullingTime="1.219347146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:40.983668655 +0000 UTC m=+376.944111353" watchObservedRunningTime="2026-07-06 19:11:40.983873575 +0000 UTC m=+376.944316271"
Jul 06 19:13:33.920834 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.920793    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"]
Jul 06 19:13:33.921330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.921030    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerName="registry"
Jul 06 19:13:33.921330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.921042    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerName="registry"
Jul 06 19:13:33.921330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.921096    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ae4b80e-7977-43c1-90df-2b7f703b137a" containerName="registry"
Jul 06 19:13:33.923925 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.923909    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:33.926739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.926712    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:13:33.926871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.926764    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5dtv\""
Jul 06 19:13:33.928168 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.928150    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:13:33.935188 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:33.935157    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"]
Jul 06 19:13:34.001236 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.001196    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zw7\" (UniqueName: \"kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.001236 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.001240    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.001454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.001276    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.102578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.102542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.102761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.102588    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zw7\" (UniqueName: \"kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.102761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.102610    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.102916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.102897    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.102967 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.102925    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.113819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.113785    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zw7\" (UniqueName: \"kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.233091 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.233049    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:34.370499 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:34.370478    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"]
Jul 06 19:13:34.373187 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:13:34.373144    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3da29a_4ea0_47e9_b859_2c15f3ba2dec.slice/crio-09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641 WatchSource:0}: Error finding container 09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641: Status 404 returned error can't find the container with id 09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641
Jul 06 19:13:35.317234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:35.317195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q" event={"ID":"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec","Type":"ContainerStarted","Data":"09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641"}
Jul 06 19:13:41.343643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:41.343608    2553 generic.go:356] "Generic (PLEG): container finished" podID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerID="a3567d20e889f4ca8ca129c1b707cf84bf9ab92261047ea449953d83a43cc8e6" exitCode=0
Jul 06 19:13:41.344061 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:41.343661    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q" event={"ID":"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec","Type":"ContainerDied","Data":"a3567d20e889f4ca8ca129c1b707cf84bf9ab92261047ea449953d83a43cc8e6"}
Jul 06 19:13:44.355292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:44.355197    2553 generic.go:356] "Generic (PLEG): container finished" podID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerID="73addba5fae1ca3d7921718a29fa1482631d2899f7caff2b9c00310916cc060e" exitCode=0
Jul 06 19:13:44.355728 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:44.355282    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q" event={"ID":"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec","Type":"ContainerDied","Data":"73addba5fae1ca3d7921718a29fa1482631d2899f7caff2b9c00310916cc060e"}
Jul 06 19:13:50.382451 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:50.382364    2553 generic.go:356] "Generic (PLEG): container finished" podID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerID="2c05f927c1890ee1703036ed7267ee351d1c0d399be5b04700c5ed8c4abb9186" exitCode=0
Jul 06 19:13:50.382800 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:50.382455    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q" event={"ID":"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec","Type":"ContainerDied","Data":"2c05f927c1890ee1703036ed7267ee351d1c0d399be5b04700c5ed8c4abb9186"}
Jul 06 19:13:51.507532 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.507506    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:51.643800 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.643711    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle\") pod \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") "
Jul 06 19:13:51.643800 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.643756    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7zw7\" (UniqueName: \"kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7\") pod \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") "
Jul 06 19:13:51.643800 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.643776    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util\") pod \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\" (UID: \"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec\") "
Jul 06 19:13:51.644408 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.644378    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle" (OuterVolumeSpecName: "bundle") pod "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" (UID: "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:13:51.645877 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.645848    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7" (OuterVolumeSpecName: "kube-api-access-c7zw7") pod "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" (UID: "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec"). InnerVolumeSpecName "kube-api-access-c7zw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:51.648574 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.648552    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util" (OuterVolumeSpecName: "util") pod "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" (UID: "2b3da29a-4ea0-47e9-b859-2c15f3ba2dec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:13:51.744784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.744745    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7zw7\" (UniqueName: \"kubernetes.io/projected/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-kube-api-access-c7zw7\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.744784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.744775    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:13:51.744784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:51.744785    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b3da29a-4ea0-47e9-b859-2c15f3ba2dec-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:13:52.390860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:52.390826    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q"
Jul 06 19:13:52.391038 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:52.390828    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754062h4q" event={"ID":"2b3da29a-4ea0-47e9-b859-2c15f3ba2dec","Type":"ContainerDied","Data":"09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641"}
Jul 06 19:13:52.391038 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:13:52.390944    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09a3f807e70c41e04f7d38cf31a90cb3b182120ebff2d5789cc5e98064f55641"
Jul 06 19:14:01.532785 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.532750    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"]
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533009    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="pull"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533021    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="pull"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533032    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="util"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533037    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="util"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533045    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="extract"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533051    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="extract"
Jul 06 19:14:01.533310 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.533087    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3da29a-4ea0-47e9-b859-2c15f3ba2dec" containerName="extract"
Jul 06 19:14:01.569437 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.569388    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.573928 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.573901    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"]
Jul 06 19:14:01.574264 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.574244    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5dtv\""
Jul 06 19:14:01.574461 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.574444    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:14:01.586544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.586510    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:14:01.712818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.712780    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.713028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.712829    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbc7w\" (UniqueName: \"kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.713028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.712930    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.813942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.813852    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.813942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.813906    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.813942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.813931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbc7w\" (UniqueName: \"kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.814275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.814256    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.814319 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.814280    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.825096 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.825069    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbc7w\" (UniqueName: \"kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:01.880060 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:01.880014    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:02.036062 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:02.036026    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"]
Jul 06 19:14:02.039029 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:14:02.038999    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf58dc53_bfd3_4018_84d7_b3bfc8986333.slice/crio-baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22 WatchSource:0}: Error finding container baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22: Status 404 returned error can't find the container with id baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22
Jul 06 19:14:02.425678 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:02.425582    2553 generic.go:356] "Generic (PLEG): container finished" podID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerID="9515f0b7f9bc45130e2005bbac149aad729c1c83aba561e718e3a6a67de20aa9" exitCode=0
Jul 06 19:14:02.425678 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:02.425659    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerDied","Data":"9515f0b7f9bc45130e2005bbac149aad729c1c83aba561e718e3a6a67de20aa9"}
Jul 06 19:14:02.425908 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:02.425694    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerStarted","Data":"baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22"}
Jul 06 19:14:04.396622 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.396587    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"]
Jul 06 19:14:04.403311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.403285    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.406253 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.406221    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:14:04.406394 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.406335    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:14:04.407814 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.407787    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nvdgj\""
Jul 06 19:14:04.409431 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.409400    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"]
Jul 06 19:14:04.432968 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.432935    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.433156 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.433032    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5t92\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-kube-api-access-d5t92\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.434613 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.434587    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerStarted","Data":"a609b5d5b03725ee6f50b42bf5f15aabc236df70ca9eb4122d854dc70ed2a150"}
Jul 06 19:14:04.533970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.533926    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.534200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.533977    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5t92\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-kube-api-access-d5t92\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.545034 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.544998    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.545172 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.545074    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5t92\" (UniqueName: \"kubernetes.io/projected/d4b182ea-1d3a-4ce4-b9df-1c033e493db5-kube-api-access-d5t92\") pod \"cert-manager-cainjector-559cdd8c87-hgl68\" (UID: \"d4b182ea-1d3a-4ce4-b9df-1c033e493db5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.713745 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.713694    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"
Jul 06 19:14:04.842433 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:04.842397    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgl68"]
Jul 06 19:14:04.845200 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:14:04.845174    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4b182ea_1d3a_4ce4_b9df_1c033e493db5.slice/crio-85422e6b3db7359ab821301fac574d0d9368a5cedd69edd32aa7590303a4489e WatchSource:0}: Error finding container 85422e6b3db7359ab821301fac574d0d9368a5cedd69edd32aa7590303a4489e: Status 404 returned error can't find the container with id 85422e6b3db7359ab821301fac574d0d9368a5cedd69edd32aa7590303a4489e
Jul 06 19:14:05.439546 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:05.439505    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68" event={"ID":"d4b182ea-1d3a-4ce4-b9df-1c033e493db5","Type":"ContainerStarted","Data":"85422e6b3db7359ab821301fac574d0d9368a5cedd69edd32aa7590303a4489e"}
Jul 06 19:14:05.441524 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:05.441493    2553 generic.go:356] "Generic (PLEG): container finished" podID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerID="a609b5d5b03725ee6f50b42bf5f15aabc236df70ca9eb4122d854dc70ed2a150" exitCode=0
Jul 06 19:14:05.441668 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:05.441552    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerDied","Data":"a609b5d5b03725ee6f50b42bf5f15aabc236df70ca9eb4122d854dc70ed2a150"}
Jul 06 19:14:06.450595 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:06.450031    2553 generic.go:356] "Generic (PLEG): container finished" podID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerID="0dd9b7d6c14dfdfebdc16355c142103fd2285b9539fa8a1cb2a5136bdb2c58f6" exitCode=0
Jul 06 19:14:06.450595 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:06.450524    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerDied","Data":"0dd9b7d6c14dfdfebdc16355c142103fd2285b9539fa8a1cb2a5136bdb2c58f6"}
Jul 06 19:14:07.455497 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.455458    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68" event={"ID":"d4b182ea-1d3a-4ce4-b9df-1c033e493db5","Type":"ContainerStarted","Data":"4e18fe046d6dff03e261139f040cc127a1166053cdae6b23a7fad7642f5d1330"}
Jul 06 19:14:07.478054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.477948    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgl68" podStartSLOduration=1.014727432 podStartE2EDuration="3.477932609s" totalImagesPullingTime="2.463205177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:07.477236854 +0000 UTC m=+523.437679552" watchObservedRunningTime="2026-07-06 19:14:07.477932609 +0000 UTC m=+523.438375304"
Jul 06 19:14:07.588477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.588446    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:07.659760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.659719    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util\") pod \"df58dc53-bfd3-4018-84d7-b3bfc8986333\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") "
Jul 06 19:14:07.659953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.659783    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle\") pod \"df58dc53-bfd3-4018-84d7-b3bfc8986333\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") "
Jul 06 19:14:07.659953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.659817    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbc7w\" (UniqueName: \"kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w\") pod \"df58dc53-bfd3-4018-84d7-b3bfc8986333\" (UID: \"df58dc53-bfd3-4018-84d7-b3bfc8986333\") "
Jul 06 19:14:07.660262 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.660226    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle" (OuterVolumeSpecName: "bundle") pod "df58dc53-bfd3-4018-84d7-b3bfc8986333" (UID: "df58dc53-bfd3-4018-84d7-b3bfc8986333"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:14:07.662033 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.662003    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w" (OuterVolumeSpecName: "kube-api-access-sbc7w") pod "df58dc53-bfd3-4018-84d7-b3bfc8986333" (UID: "df58dc53-bfd3-4018-84d7-b3bfc8986333"). InnerVolumeSpecName "kube-api-access-sbc7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:14:07.666782 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.666755    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util" (OuterVolumeSpecName: "util") pod "df58dc53-bfd3-4018-84d7-b3bfc8986333" (UID: "df58dc53-bfd3-4018-84d7-b3bfc8986333"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:14:07.760354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.760316    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:07.760354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.760348    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df58dc53-bfd3-4018-84d7-b3bfc8986333-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:07.760354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:07.760357    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbc7w\" (UniqueName: \"kubernetes.io/projected/df58dc53-bfd3-4018-84d7-b3bfc8986333-kube-api-access-sbc7w\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:08.460789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:08.460761    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t"
Jul 06 19:14:08.461249 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:08.460800    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65p7t" event={"ID":"df58dc53-bfd3-4018-84d7-b3bfc8986333","Type":"ContainerDied","Data":"baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22"}
Jul 06 19:14:08.461249 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:08.460852    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baaa10f1c9e8a0199b3a2f0ebc9464a72b0f9da498d75e8d8fb9b167c6b26d22"
Jul 06 19:14:23.046941 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.046864    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"]
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047155    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="util"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047169    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="util"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047177    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="extract"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047183    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="extract"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047198    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="pull"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047206    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="pull"
Jul 06 19:14:23.047416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.047250    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="df58dc53-bfd3-4018-84d7-b3bfc8986333" containerName="extract"
Jul 06 19:14:23.050085 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.050068    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.053044 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.053022    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z5dtv\""
Jul 06 19:14:23.053154 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.053024    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:14:23.054161 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.054145    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:14:23.061295 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.061270    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"]
Jul 06 19:14:23.068418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.068392    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.068549 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.068422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.068549 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.068452    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnb5\" (UniqueName: \"kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.169785 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.169748    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.169785 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.169788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.170030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.169824    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnb5\" (UniqueName: \"kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.170186 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.170168    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.170242 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.170222    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.185842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.185814    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnb5\" (UniqueName: \"kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.359312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.359217    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:23.489336 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.489306    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"]
Jul 06 19:14:23.491859 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:14:23.491831    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854b3565_478c_4c4e_9284_40405e6b5231.slice/crio-83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b WatchSource:0}: Error finding container 83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b: Status 404 returned error can't find the container with id 83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b
Jul 06 19:14:23.516376 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:23.516350    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr" event={"ID":"854b3565-478c-4c4e-9284-40405e6b5231","Type":"ContainerStarted","Data":"83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b"}
Jul 06 19:14:24.522354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:24.522270    2553 generic.go:356] "Generic (PLEG): container finished" podID="854b3565-478c-4c4e-9284-40405e6b5231" containerID="857f9d8d4bc5883933214917817b1322f5ed09c39d46833f2a98185e9b76f126" exitCode=0
Jul 06 19:14:24.522354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:24.522316    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr" event={"ID":"854b3565-478c-4c4e-9284-40405e6b5231","Type":"ContainerDied","Data":"857f9d8d4bc5883933214917817b1322f5ed09c39d46833f2a98185e9b76f126"}
Jul 06 19:14:26.539409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:26.539373    2553 generic.go:356] "Generic (PLEG): container finished" podID="854b3565-478c-4c4e-9284-40405e6b5231" containerID="557d449fd7b86f11e184b87f44d3a4d22d2c5d3773b876976037dcca8f77c66f" exitCode=0
Jul 06 19:14:26.539789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:26.539430    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr" event={"ID":"854b3565-478c-4c4e-9284-40405e6b5231","Type":"ContainerDied","Data":"557d449fd7b86f11e184b87f44d3a4d22d2c5d3773b876976037dcca8f77c66f"}
Jul 06 19:14:27.544106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:27.544075    2553 generic.go:356] "Generic (PLEG): container finished" podID="854b3565-478c-4c4e-9284-40405e6b5231" containerID="95ebbfd83f3bf2646806e3e9a2ab98779382d45c10d4b1a3553eebeab4df1d3a" exitCode=0
Jul 06 19:14:27.544593 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:27.544161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr" event={"ID":"854b3565-478c-4c4e-9284-40405e6b5231","Type":"ContainerDied","Data":"95ebbfd83f3bf2646806e3e9a2ab98779382d45c10d4b1a3553eebeab4df1d3a"}
Jul 06 19:14:28.667732 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.667707    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:28.709048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.709012    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util\") pod \"854b3565-478c-4c4e-9284-40405e6b5231\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") "
Jul 06 19:14:28.709232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.709059    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle\") pod \"854b3565-478c-4c4e-9284-40405e6b5231\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") "
Jul 06 19:14:28.709232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.709088    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wnb5\" (UniqueName: \"kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5\") pod \"854b3565-478c-4c4e-9284-40405e6b5231\" (UID: \"854b3565-478c-4c4e-9284-40405e6b5231\") "
Jul 06 19:14:28.709825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.709795    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle" (OuterVolumeSpecName: "bundle") pod "854b3565-478c-4c4e-9284-40405e6b5231" (UID: "854b3565-478c-4c4e-9284-40405e6b5231"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:14:28.711110 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.711082    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5" (OuterVolumeSpecName: "kube-api-access-8wnb5") pod "854b3565-478c-4c4e-9284-40405e6b5231" (UID: "854b3565-478c-4c4e-9284-40405e6b5231"). InnerVolumeSpecName "kube-api-access-8wnb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:14:28.714662 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.714638    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util" (OuterVolumeSpecName: "util") pod "854b3565-478c-4c4e-9284-40405e6b5231" (UID: "854b3565-478c-4c4e-9284-40405e6b5231"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:14:28.809962 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.809880    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:28.809962 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.809908    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/854b3565-478c-4c4e-9284-40405e6b5231-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:28.809962 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:28.809919    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wnb5\" (UniqueName: \"kubernetes.io/projected/854b3565-478c-4c4e-9284-40405e6b5231-kube-api-access-8wnb5\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:14:29.553616 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:29.553588    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr"
Jul 06 19:14:29.553751 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:29.553587    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflmshr" event={"ID":"854b3565-478c-4c4e-9284-40405e6b5231","Type":"ContainerDied","Data":"83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b"}
Jul 06 19:14:29.553751 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:29.553711    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83992173b4840552a108ccd9a771c67393a385a98eeb2886f63d6fe33407840b"
Jul 06 19:14:40.521076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521038    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"]
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521361    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="pull"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521380    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="pull"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521398    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="util"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521407    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="util"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521418    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="extract"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521426    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="extract"
Jul 06 19:14:40.521650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.521496    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="854b3565-478c-4c4e-9284-40405e6b5231" containerName="extract"
Jul 06 19:14:40.527014 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.526973    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.530679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.530653    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\""
Jul 06 19:14:40.531078 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.531061    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:14:40.531137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.531065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:14:40.531137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.531101    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:14:40.531609 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.531596    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:14:40.556201 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.556174    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"]
Jul 06 19:14:40.595008 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.594949    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.595173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.595015    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.595173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.595086    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.595173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.595122    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxbn\" (UniqueName: \"kubernetes.io/projected/0dc2bc70-f30d-49a8-8b3e-01df978dc814-kube-api-access-4nxbn\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.595278 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.595180    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696408    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696451    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696505    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696523    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxbn\" (UniqueName: \"kubernetes.io/projected/0dc2bc70-f30d-49a8-8b3e-01df978dc814-kube-api-access-4nxbn\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696543    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.696872 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.696854    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.698872 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.698841    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc2bc70-f30d-49a8-8b3e-01df978dc814-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.699041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.699004    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.699131 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.699113    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dc2bc70-f30d-49a8-8b3e-01df978dc814-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.709554 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.709527    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxbn\" (UniqueName: \"kubernetes.io/projected/0dc2bc70-f30d-49a8-8b3e-01df978dc814-kube-api-access-4nxbn\") pod \"opendatahub-operator-controller-manager-b48f9c585-2rxsl\" (UID: \"0dc2bc70-f30d-49a8-8b3e-01df978dc814\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.836188 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.836099    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:40.969622 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:40.969593    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"]
Jul 06 19:14:40.972171 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:14:40.972145    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc2bc70_f30d_49a8_8b3e_01df978dc814.slice/crio-c47e44a83709cd36eea43d6310f2360d057cecb45c20878e3ce9e61400bb95b5 WatchSource:0}: Error finding container c47e44a83709cd36eea43d6310f2360d057cecb45c20878e3ce9e61400bb95b5: Status 404 returned error can't find the container with id c47e44a83709cd36eea43d6310f2360d057cecb45c20878e3ce9e61400bb95b5
Jul 06 19:14:41.598949 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:41.598896    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerStarted","Data":"c47e44a83709cd36eea43d6310f2360d057cecb45c20878e3ce9e61400bb95b5"}
Jul 06 19:14:44.613314 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:44.613278    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerStarted","Data":"b94c50b6bf256ded3cf80a7035f6f500a54126a2d34ecf26c0d6a9df2b655b59"}
Jul 06 19:14:45.618023 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:45.617968    2553 generic.go:356] "Generic (PLEG): container finished" podID="0dc2bc70-f30d-49a8-8b3e-01df978dc814" containerID="b94c50b6bf256ded3cf80a7035f6f500a54126a2d34ecf26c0d6a9df2b655b59" exitCode=0
Jul 06 19:14:45.618420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:45.618050    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerDied","Data":"b94c50b6bf256ded3cf80a7035f6f500a54126a2d34ecf26c0d6a9df2b655b59"}
Jul 06 19:14:46.623794 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:46.623757    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerStarted","Data":"ac931d1570ca34e5aa552007533f4bedfbb2e3e6cd1355213624bbeefe763186"}
Jul 06 19:14:46.624296 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:46.623893    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:14:46.652608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:46.652143    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" podStartSLOduration=2.46853179 podStartE2EDuration="6.652122329s" totalImagesPullingTime="3.112109998s" totalInitContainerRuntime="1.071480541s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:46.650126176 +0000 UTC m=+562.610568875" watchObservedRunningTime="2026-07-06 19:14:46.652122329 +0000 UTC m=+562.612565030"
Jul 06 19:14:57.628778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:14:57.628747    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:15:01.134920 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.134883    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wp6vs"]
Jul 06 19:15:01.141799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.141771    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.146725 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.146696    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:15:01.147250 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.147230    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vgbgk\""
Jul 06 19:15:01.157851 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.157822    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wp6vs"]
Jul 06 19:15:01.226178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.226143    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"]
Jul 06 19:15:01.229256 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.229240    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.234347 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.234323    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:15:01.234498 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.234480    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:15:01.244495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.244469    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-cert\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.244636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.244528    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk48t\" (UniqueName: \"kubernetes.io/projected/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-kube-api-access-nk48t\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.251907 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.251884    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:15:01.252047 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.251886    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:15:01.257525 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.257506    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b548v\""
Jul 06 19:15:01.261403 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.261375    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"]
Jul 06 19:15:01.345945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.345904    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk48t\" (UniqueName: \"kubernetes.io/projected/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-kube-api-access-nk48t\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.345945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.345947    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.346189 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.345980    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-cert\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.346189 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.346052    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.346189 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.346080    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlh2n\" (UniqueName: \"kubernetes.io/projected/b66ada90-5c83-4fae-910a-e841dd6a3fcf-kube-api-access-qlh2n\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.348439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.348421    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-cert\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.380029 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.379978    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk48t\" (UniqueName: \"kubernetes.io/projected/f1aa07ab-30d0-4aeb-8d29-d4953870e5f5-kube-api-access-nk48t\") pod \"odh-model-controller-7998c67dc4-wp6vs\" (UID: \"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.446771 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.446745    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.446950 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.446779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlh2n\" (UniqueName: \"kubernetes.io/projected/b66ada90-5c83-4fae-910a-e841dd6a3fcf-kube-api-access-qlh2n\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.446950 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.446813    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.449075 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.449044    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tmp\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.449292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.449273    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66ada90-5c83-4fae-910a-e841dd6a3fcf-tls-certs\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.452087 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.452072    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:01.459203 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.459177    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlh2n\" (UniqueName: \"kubernetes.io/projected/b66ada90-5c83-4fae-910a-e841dd6a3fcf-kube-api-access-qlh2n\") pod \"kube-auth-proxy-7f9b6c5cb8-tfwlf\" (UID: \"b66ada90-5c83-4fae-910a-e841dd6a3fcf\") " pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.538087 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.537814    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"
Jul 06 19:15:01.609062 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.609037    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wp6vs"]
Jul 06 19:15:01.611543 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:15:01.611516    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aa07ab_30d0_4aeb_8d29_d4953870e5f5.slice/crio-c4a1e6df5d8262549dfec3a659a357dfd7f9152f4f1a2aeb396275278130f772 WatchSource:0}: Error finding container c4a1e6df5d8262549dfec3a659a357dfd7f9152f4f1a2aeb396275278130f772: Status 404 returned error can't find the container with id c4a1e6df5d8262549dfec3a659a357dfd7f9152f4f1a2aeb396275278130f772
Jul 06 19:15:01.678363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.678332    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs" event={"ID":"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5","Type":"ContainerStarted","Data":"c4a1e6df5d8262549dfec3a659a357dfd7f9152f4f1a2aeb396275278130f772"}
Jul 06 19:15:01.682964 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:01.682854    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf"]
Jul 06 19:15:01.685017 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:15:01.684970    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66ada90_5c83_4fae_910a_e841dd6a3fcf.slice/crio-f428dff74a029bc7f28404f4200e5a297604f49b3083deb7decc9973e2fc7cb9 WatchSource:0}: Error finding container f428dff74a029bc7f28404f4200e5a297604f49b3083deb7decc9973e2fc7cb9: Status 404 returned error can't find the container with id f428dff74a029bc7f28404f4200e5a297604f49b3083deb7decc9973e2fc7cb9
Jul 06 19:15:02.687850 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:02.687723    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf" event={"ID":"b66ada90-5c83-4fae-910a-e841dd6a3fcf","Type":"ContainerStarted","Data":"f428dff74a029bc7f28404f4200e5a297604f49b3083deb7decc9973e2fc7cb9"}
Jul 06 19:15:05.701319 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:05.701265    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs" event={"ID":"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5","Type":"ContainerStarted","Data":"1d35a87362d6133cb9dd95e67e357c7f6e2b7bf32b49cb80b26e1037c71cc295"}
Jul 06 19:15:05.701783 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:05.701387    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:05.702681 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:05.702660    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf" event={"ID":"b66ada90-5c83-4fae-910a-e841dd6a3fcf","Type":"ContainerStarted","Data":"e8c690ed11804356e9c7f623920f103af8a804f71fea6a0e180c1c083b687d4d"}
Jul 06 19:15:05.724459 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:05.724406    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs" podStartSLOduration=1.510657433 podStartE2EDuration="4.724392121s" totalImagesPullingTime="3.213734688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:05.724367868 +0000 UTC m=+581.684810579" watchObservedRunningTime="2026-07-06 19:15:05.724392121 +0000 UTC m=+581.684834840"
Jul 06 19:15:05.749503 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:05.749449    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f9b6c5cb8-tfwlf" podStartSLOduration=1.609576874 podStartE2EDuration="4.749428564s" totalImagesPullingTime="3.13985169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:05.748767254 +0000 UTC m=+581.709209951" watchObservedRunningTime="2026-07-06 19:15:05.749428564 +0000 UTC m=+581.709871261"
Jul 06 19:15:08.742854 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.742813    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"]
Jul 06 19:15:08.746260 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.746234    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.752980 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.752812    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kcthv\""
Jul 06 19:15:08.753094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.753021    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:15:08.763551 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.763519    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"]
Jul 06 19:15:08.904819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904778    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xnxh\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-kube-api-access-8xnxh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904825    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904855    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904893    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904941    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.904973    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905209 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.905050    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905209 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.905073    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.905209 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.905112    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:08.920079 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.920041    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"]
Jul 06 19:15:08.923125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.923106    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:08.936467 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.936444    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:15:08.938002 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.937965    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:15:08.938132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.937998    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:15:08.938132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.938078    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:15:08.938581 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.938564    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:15:08.943580 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.943553    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgfm6\""
Jul 06 19:15:08.944561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:08.944540    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"]
Jul 06 19:15:09.005884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005787    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-manager-config\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.005884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005830    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.005884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005862    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005887    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005912    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005942    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.005981    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksfh\" (UniqueName: \"kubernetes.io/projected/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-kube-api-access-qksfh\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006045    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xnxh\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-kube-api-access-8xnxh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006079    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006110    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006135    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006159    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.006216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006194    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006709 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006362    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006709 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006529    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006792    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.006878 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.006843    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.007048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.007026    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.008315 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.008297    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.008409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.008393    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.027545 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.027509    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.027644 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.027631    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xnxh\" (UniqueName: \"kubernetes.io/projected/89e42ab3-f7f7-4bf4-972e-574e5ee33b40-kube-api-access-8xnxh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48xhkb\" (UID: \"89e42ab3-f7f7-4bf4-972e-574e5ee33b40\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.056239 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.056209    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:09.106634 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.106589    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.106821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.106659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-manager-config\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.106821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.106694    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.106821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.106742    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksfh\" (UniqueName: \"kubernetes.io/projected/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-kube-api-access-qksfh\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.107764 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.107730    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-manager-config\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.109794 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.109768    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.109924 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.109825    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-cert\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.131160 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.131101    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksfh\" (UniqueName: \"kubernetes.io/projected/e9bcac1f-130e-420e-9c2d-d7f4a42590f6-kube-api-access-qksfh\") pod \"lws-controller-manager-689b9cdffd-ktnqq\" (UID: \"e9bcac1f-130e-420e-9c2d-d7f4a42590f6\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.232382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.232345    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:09.300571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.300544    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"]
Jul 06 19:15:09.302333 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:15:09.302303    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e42ab3_f7f7_4bf4_972e_574e5ee33b40.slice/crio-10a499b77e3f2ce20a3aab661abc75114808851b9d834904ea63cf35f1d344ef WatchSource:0}: Error finding container 10a499b77e3f2ce20a3aab661abc75114808851b9d834904ea63cf35f1d344ef: Status 404 returned error can't find the container with id 10a499b77e3f2ce20a3aab661abc75114808851b9d834904ea63cf35f1d344ef
Jul 06 19:15:09.450542 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.450509    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"]
Jul 06 19:15:09.453476 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:15:09.453448    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bcac1f_130e_420e_9c2d_d7f4a42590f6.slice/crio-3f8132e79ffe64e202843556d6ce0b8b45132dbbf392e85d5eb735f439144b0a WatchSource:0}: Error finding container 3f8132e79ffe64e202843556d6ce0b8b45132dbbf392e85d5eb735f439144b0a: Status 404 returned error can't find the container with id 3f8132e79ffe64e202843556d6ce0b8b45132dbbf392e85d5eb735f439144b0a
Jul 06 19:15:09.719876 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.719833    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq" event={"ID":"e9bcac1f-130e-420e-9c2d-d7f4a42590f6","Type":"ContainerStarted","Data":"3f8132e79ffe64e202843556d6ce0b8b45132dbbf392e85d5eb735f439144b0a"}
Jul 06 19:15:09.720856 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:09.720829    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb" event={"ID":"89e42ab3-f7f7-4bf4-972e-574e5ee33b40","Type":"ContainerStarted","Data":"10a499b77e3f2ce20a3aab661abc75114808851b9d834904ea63cf35f1d344ef"}
Jul 06 19:15:11.959878 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:11.959842    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:15:11.960211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:11.959914    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:15:11.960211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:11.959944    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:15:12.736349 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:12.736303    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb" event={"ID":"89e42ab3-f7f7-4bf4-972e-574e5ee33b40","Type":"ContainerStarted","Data":"8d39c744a67de4afee279fda5c386ed3cdcbfd8c52b4b694487668f11e9ea08d"}
Jul 06 19:15:12.737766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:12.737742    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq" event={"ID":"e9bcac1f-130e-420e-9c2d-d7f4a42590f6","Type":"ContainerStarted","Data":"256bc47e86f047a9ec1a497e93b3b4837f7bb956fea3a7427088ffb89285ef5e"}
Jul 06 19:15:12.737917 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:12.737859    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:15:12.766212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:12.766154    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb" podStartSLOduration=2.11097045 podStartE2EDuration="4.766140072s" totalImagesPullingTime="2.655169622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:12.763571074 +0000 UTC m=+588.724013769" watchObservedRunningTime="2026-07-06 19:15:12.766140072 +0000 UTC m=+588.726582768"
Jul 06 19:15:12.786611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:12.786555    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq" podStartSLOduration=2.289008436 podStartE2EDuration="4.786538533s" totalImagesPullingTime="2.497530097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:12.78451302 +0000 UTC m=+588.744955716" watchObservedRunningTime="2026-07-06 19:15:12.786538533 +0000 UTC m=+588.746981229"
Jul 06 19:15:13.056561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:13.056469    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:13.060681 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:13.060657    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:13.743601 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:13.743558    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:13.744605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:13.744585    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48xhkb"
Jul 06 19:15:16.708453 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:16.708415    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:15:23.745661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:15:23.745632    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:16:17.558601 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.558565    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"]
Jul 06 19:16:17.561837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.561819    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.565555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.565532    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btkqm\""
Jul 06 19:16:17.567311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.566394    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:16:17.571496 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.567448    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:16:17.579978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.579950    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"]
Jul 06 19:16:17.647865 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.647828    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.648069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.647885    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.648069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.647981    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq5kp\" (UniqueName: \"kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.749066 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.749029    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq5kp\" (UniqueName: \"kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.749255 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.749095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.749255 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.749126    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.749478 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.749457    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.749539 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.749490    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.761187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.761160    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq5kp\" (UniqueName: \"kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:17.875267 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:17.875173    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:18.014199 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.014167    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"]
Jul 06 19:16:18.017432 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:16:18.017407    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f8e56_8631_47c8_b356_f383cf6f25bf.slice/crio-7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f WatchSource:0}: Error finding container 7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f: Status 404 returned error can't find the container with id 7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f
Jul 06 19:16:18.366290 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.366253    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"]
Jul 06 19:16:18.369509 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.369484    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.384765 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.384702    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"]
Jul 06 19:16:18.454602 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.454565    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j62v5\" (UniqueName: \"kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.454761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.454610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.454761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.454637    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.555686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.555647    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62v5\" (UniqueName: \"kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.555686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.555691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.555890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.555815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.556158 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.556138    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.556203 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.556166    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.567439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.567417    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j62v5\" (UniqueName: \"kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.678820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.678727    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:18.826330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:18.826300    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"]
Jul 06 19:16:18.828329 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:16:18.828304    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4245be_8853_4638_91e5_74504d7d86a1.slice/crio-39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93 WatchSource:0}: Error finding container 39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93: Status 404 returned error can't find the container with id 39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93
Jul 06 19:16:19.020335 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.020297    2553 generic.go:356] "Generic (PLEG): container finished" podID="5f4245be-8853-4638-91e5-74504d7d86a1" containerID="97dc42812b24bc20e825373b6c5e16e7b0f1a13f4a63ed83b369a2a1e91ea1d0" exitCode=0
Jul 06 19:16:19.020524 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.020382    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq" event={"ID":"5f4245be-8853-4638-91e5-74504d7d86a1","Type":"ContainerDied","Data":"97dc42812b24bc20e825373b6c5e16e7b0f1a13f4a63ed83b369a2a1e91ea1d0"}
Jul 06 19:16:19.020524 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.020443    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq" event={"ID":"5f4245be-8853-4638-91e5-74504d7d86a1","Type":"ContainerStarted","Data":"39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93"}
Jul 06 19:16:19.021915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.021894    2553 generic.go:356] "Generic (PLEG): container finished" podID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerID="10ca8b190d773453af88261f7da4b77e61eb98ff7388ce267ffa3b595d4d4000" exitCode=0
Jul 06 19:16:19.022032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.021944    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4" event={"ID":"086f8e56-8631-47c8-b356-f383cf6f25bf","Type":"ContainerDied","Data":"10ca8b190d773453af88261f7da4b77e61eb98ff7388ce267ffa3b595d4d4000"}
Jul 06 19:16:19.022032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.021978    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4" event={"ID":"086f8e56-8631-47c8-b356-f383cf6f25bf","Type":"ContainerStarted","Data":"7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f"}
Jul 06 19:16:19.196825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.196734    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"]
Jul 06 19:16:19.200259 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.200239    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.213668 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.213641    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"]
Jul 06 19:16:19.261912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.261874    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.262092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.261926    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdhn\" (UniqueName: \"kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.262092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.262036    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.363082 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.363037    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdhn\" (UniqueName: \"kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.363273 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.363113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.363273 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.363163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.363532 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.363512    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.363597 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.363562    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.379497 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.379469    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdhn\" (UniqueName: \"kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.508778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.508706    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:19.790226 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.790196    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"]
Jul 06 19:16:19.832792 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:16:19.832756    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0627a33_bd5b_4a1d_a9b8_991b2bf721e4.slice/crio-de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8 WatchSource:0}: Error finding container de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8: Status 404 returned error can't find the container with id de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8
Jul 06 19:16:19.997947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:19.997916    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"]
Jul 06 19:16:20.001162 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.001144    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.006361 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:16:20.006333    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" is forbidden: User \"system:node:ip-10-0-139-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-205.ec2.internal' and this object" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.021171 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.021141    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"]
Jul 06 19:16:20.053571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.053486    2553 generic.go:356] "Generic (PLEG): container finished" podID="5f4245be-8853-4638-91e5-74504d7d86a1" containerID="c8a8b756cfcfb12a9b65798ceed5b7a3dbe0f9b8295a4e9760394de0d5eefad4" exitCode=0
Jul 06 19:16:20.053753 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.053579    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq" event={"ID":"5f4245be-8853-4638-91e5-74504d7d86a1","Type":"ContainerDied","Data":"c8a8b756cfcfb12a9b65798ceed5b7a3dbe0f9b8295a4e9760394de0d5eefad4"}
Jul 06 19:16:20.061332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.061303    2553 generic.go:356] "Generic (PLEG): container finished" podID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerID="8bfb0574ef2328377653f6c5947549060d40a2849d3dc30d3a83da30144dcb48" exitCode=0
Jul 06 19:16:20.061458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.061382    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4" event={"ID":"086f8e56-8631-47c8-b356-f383cf6f25bf","Type":"ContainerDied","Data":"8bfb0574ef2328377653f6c5947549060d40a2849d3dc30d3a83da30144dcb48"}
Jul 06 19:16:20.063153 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.063118    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerID="def1bca3efa1b4edbe9990b546924fe160b0fd640601a923ae21fe56e699e337" exitCode=0
Jul 06 19:16:20.063254 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.063155    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25" event={"ID":"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4","Type":"ContainerDied","Data":"def1bca3efa1b4edbe9990b546924fe160b0fd640601a923ae21fe56e699e337"}
Jul 06 19:16:20.063254 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.063213    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25" event={"ID":"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4","Type":"ContainerStarted","Data":"de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8"}
Jul 06 19:16:20.068480 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.068457    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snknb\" (UniqueName: \"kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.068579 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.068512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.068641 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.068574    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.169816 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.169784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.170052 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.169828    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.170052 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.169887    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snknb\" (UniqueName: \"kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.170256 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.170233    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.170528 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.170510    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.189885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.189854    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snknb\" (UniqueName: \"kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.309642 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.309549    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:20.453507 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:20.453423    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"]
Jul 06 19:16:20.455630 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:16:20.455604    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2962b1c2_ef12_45bd_bfe2_3b5b2af6c5f0.slice/crio-e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673 WatchSource:0}: Error finding container e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673: Status 404 returned error can't find the container with id e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673
Jul 06 19:16:21.068444 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.068413    2553 generic.go:356] "Generic (PLEG): container finished" podID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerID="25850ae456b9b9261ede675efa82ebb6c396fbc04f741b054f783042a62ed81d" exitCode=0
Jul 06 19:16:21.068884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.068505    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm" event={"ID":"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0","Type":"ContainerDied","Data":"25850ae456b9b9261ede675efa82ebb6c396fbc04f741b054f783042a62ed81d"}
Jul 06 19:16:21.068884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.068561    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm" event={"ID":"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0","Type":"ContainerStarted","Data":"e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673"}
Jul 06 19:16:21.070813 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.070787    2553 generic.go:356] "Generic (PLEG): container finished" podID="5f4245be-8853-4638-91e5-74504d7d86a1" containerID="2d6a0f27ff3207653eac0977e1376576398a8ed03f30265219b14093347da021" exitCode=0
Jul 06 19:16:21.070915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.070865    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq" event={"ID":"5f4245be-8853-4638-91e5-74504d7d86a1","Type":"ContainerDied","Data":"2d6a0f27ff3207653eac0977e1376576398a8ed03f30265219b14093347da021"}
Jul 06 19:16:21.072879 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.072861    2553 generic.go:356] "Generic (PLEG): container finished" podID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerID="a60b8f4dbc524a5112da53b679d2628a2a4c969c2fc98e04fb5916534e44f097" exitCode=0
Jul 06 19:16:21.072975 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.072888    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4" event={"ID":"086f8e56-8631-47c8-b356-f383cf6f25bf","Type":"ContainerDied","Data":"a60b8f4dbc524a5112da53b679d2628a2a4c969c2fc98e04fb5916534e44f097"}
Jul 06 19:16:21.075137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.075120    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerID="4ee81ee57608df1be4f1614c2e299f70bd13e489aae6e5afba8e6426175e02b7" exitCode=0
Jul 06 19:16:21.075219 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:21.075146    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25" event={"ID":"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4","Type":"ContainerDied","Data":"4ee81ee57608df1be4f1614c2e299f70bd13e489aae6e5afba8e6426175e02b7"}
Jul 06 19:16:22.081125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.081090    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerID="549e15e17824de5219cb67b3ff91bde86a643b160a7f465cac517e3509efc38c" exitCode=0
Jul 06 19:16:22.081536 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.081167    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25" event={"ID":"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4","Type":"ContainerDied","Data":"549e15e17824de5219cb67b3ff91bde86a643b160a7f465cac517e3509efc38c"}
Jul 06 19:16:22.082746 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.082726    2553 generic.go:356] "Generic (PLEG): container finished" podID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerID="c0077a006f11094515eef2ac82ad258c0bec81ae3afe71c9726b56fc96cdc177" exitCode=0
Jul 06 19:16:22.082829 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.082800    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm" event={"ID":"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0","Type":"ContainerDied","Data":"c0077a006f11094515eef2ac82ad258c0bec81ae3afe71c9726b56fc96cdc177"}
Jul 06 19:16:22.218242 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.218208    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:22.251831 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.251807    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:22.288785 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.288752    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq5kp\" (UniqueName: \"kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp\") pod \"086f8e56-8631-47c8-b356-f383cf6f25bf\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") "
Jul 06 19:16:22.288979 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.288792    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util\") pod \"086f8e56-8631-47c8-b356-f383cf6f25bf\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") "
Jul 06 19:16:22.288979 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.288844    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle\") pod \"086f8e56-8631-47c8-b356-f383cf6f25bf\" (UID: \"086f8e56-8631-47c8-b356-f383cf6f25bf\") "
Jul 06 19:16:22.289488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.289455    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle" (OuterVolumeSpecName: "bundle") pod "086f8e56-8631-47c8-b356-f383cf6f25bf" (UID: "086f8e56-8631-47c8-b356-f383cf6f25bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:22.291210 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.291185    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp" (OuterVolumeSpecName: "kube-api-access-dq5kp") pod "086f8e56-8631-47c8-b356-f383cf6f25bf" (UID: "086f8e56-8631-47c8-b356-f383cf6f25bf"). InnerVolumeSpecName "kube-api-access-dq5kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:22.297150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.297120    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util" (OuterVolumeSpecName: "util") pod "086f8e56-8631-47c8-b356-f383cf6f25bf" (UID: "086f8e56-8631-47c8-b356-f383cf6f25bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:22.389947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.389855    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle\") pod \"5f4245be-8853-4638-91e5-74504d7d86a1\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") "
Jul 06 19:16:22.389947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.389944    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j62v5\" (UniqueName: \"kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5\") pod \"5f4245be-8853-4638-91e5-74504d7d86a1\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") "
Jul 06 19:16:22.390155 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.389969    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util\") pod \"5f4245be-8853-4638-91e5-74504d7d86a1\" (UID: \"5f4245be-8853-4638-91e5-74504d7d86a1\") "
Jul 06 19:16:22.390155 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.390118    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:22.390155 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.390129    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq5kp\" (UniqueName: \"kubernetes.io/projected/086f8e56-8631-47c8-b356-f383cf6f25bf-kube-api-access-dq5kp\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:22.390155 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.390138    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086f8e56-8631-47c8-b356-f383cf6f25bf-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:22.390420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.390394    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle" (OuterVolumeSpecName: "bundle") pod "5f4245be-8853-4638-91e5-74504d7d86a1" (UID: "5f4245be-8853-4638-91e5-74504d7d86a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:22.392048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.392023    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5" (OuterVolumeSpecName: "kube-api-access-j62v5") pod "5f4245be-8853-4638-91e5-74504d7d86a1" (UID: "5f4245be-8853-4638-91e5-74504d7d86a1"). InnerVolumeSpecName "kube-api-access-j62v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:22.395736 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.395702    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util" (OuterVolumeSpecName: "util") pod "5f4245be-8853-4638-91e5-74504d7d86a1" (UID: "5f4245be-8853-4638-91e5-74504d7d86a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:22.490699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.490654    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j62v5\" (UniqueName: \"kubernetes.io/projected/5f4245be-8853-4638-91e5-74504d7d86a1-kube-api-access-j62v5\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:22.490699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.490691    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:22.490699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:22.490702    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4245be-8853-4638-91e5-74504d7d86a1-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:23.088978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.088946    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq"
Jul 06 19:16:23.089513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.088941    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq" event={"ID":"5f4245be-8853-4638-91e5-74504d7d86a1","Type":"ContainerDied","Data":"39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93"}
Jul 06 19:16:23.089513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.089048    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39ebc382ea91f175ea5f1ba0d54223c80bf05b784275d932bafed6e869403e93"
Jul 06 19:16:23.094044 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.094024    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4"
Jul 06 19:16:23.094183 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.094018    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4" event={"ID":"086f8e56-8631-47c8-b356-f383cf6f25bf","Type":"ContainerDied","Data":"7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f"}
Jul 06 19:16:23.094238 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.094178    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c45a21cd640846c72d7e640c307cc4548a02da9dd760e62bb3f34068bab904f"
Jul 06 19:16:23.096267 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.096239    2553 generic.go:356] "Generic (PLEG): container finished" podID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerID="b92192a9182ccddadffbf30851662f399dbcf788db81932d014fb0dbc80a2937" exitCode=0
Jul 06 19:16:23.096395 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.096319    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm" event={"ID":"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0","Type":"ContainerDied","Data":"b92192a9182ccddadffbf30851662f399dbcf788db81932d014fb0dbc80a2937"}
Jul 06 19:16:23.226078 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.226048    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:23.296636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.296602    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle\") pod \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") "
Jul 06 19:16:23.296636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.296637    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util\") pod \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") "
Jul 06 19:16:23.296837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.296667    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsdhn\" (UniqueName: \"kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn\") pod \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\" (UID: \"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4\") "
Jul 06 19:16:23.297278 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.297238    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle" (OuterVolumeSpecName: "bundle") pod "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" (UID: "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:23.298735 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.298706    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn" (OuterVolumeSpecName: "kube-api-access-xsdhn") pod "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" (UID: "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4"). InnerVolumeSpecName "kube-api-access-xsdhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:23.301820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.301802    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util" (OuterVolumeSpecName: "util") pod "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" (UID: "c0627a33-bd5b-4a1d-a9b8-991b2bf721e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:23.397386 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.397300    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:23.397386 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.397328    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:23.397386 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:23.397337    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsdhn\" (UniqueName: \"kubernetes.io/projected/c0627a33-bd5b-4a1d-a9b8-991b2bf721e4-kube-api-access-xsdhn\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:24.102731 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.102697    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25"
Jul 06 19:16:24.102731 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.102728    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25" event={"ID":"c0627a33-bd5b-4a1d-a9b8-991b2bf721e4","Type":"ContainerDied","Data":"de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8"}
Jul 06 19:16:24.103171 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.102769    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de797dcb97c75b192c3e08ce9efdccafde5517124bd49f26b68b9597d625b9b8"
Jul 06 19:16:24.230789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.230764    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:24.304953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.304922    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snknb\" (UniqueName: \"kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb\") pod \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") "
Jul 06 19:16:24.304953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.304957    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util\") pod \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") "
Jul 06 19:16:24.305201 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.304975    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle\") pod \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\" (UID: \"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0\") "
Jul 06 19:16:24.305594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.305567    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle" (OuterVolumeSpecName: "bundle") pod "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" (UID: "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:24.307064 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.307038    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb" (OuterVolumeSpecName: "kube-api-access-snknb") pod "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" (UID: "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0"). InnerVolumeSpecName "kube-api-access-snknb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:24.310881 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.310778    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util" (OuterVolumeSpecName: "util") pod "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" (UID: "2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:16:24.405922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.405818    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snknb\" (UniqueName: \"kubernetes.io/projected/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-kube-api-access-snknb\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:24.405922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.405865    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-util\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:24.405922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:24.405876    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0-bundle\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:16:25.109417 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:25.109382    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm" event={"ID":"2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0","Type":"ContainerDied","Data":"e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673"}
Jul 06 19:16:25.109818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:25.109425    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm"
Jul 06 19:16:25.109818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:16:25.109430    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3e60ee1dc25cd3c9dd951bd92b42e33a51025834c06157cf27c6ecff71f9673"
Jul 06 19:17:44.253490 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253396    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253684    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253698    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253708    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253713    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253720    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253726    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253734    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253738    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253746    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253751    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253757    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253761    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253767    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253772    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253777    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253781    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253787    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253792    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="pull"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253797    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253802    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253810    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253815    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253823    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253827    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="util"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253871    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4245be-8853-4638-91e5-74504d7d86a1" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253877    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="086f8e56-8631-47c8-b356-f383cf6f25bf" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253884    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0627a33-bd5b-4a1d-a9b8-991b2bf721e4" containerName="extract"
Jul 06 19:17:44.254016 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.253890    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0" containerName="extract"
Jul 06 19:17:44.256630 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.256610    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:44.260106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.260072    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:17:44.260235 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.260114    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t5h6l\""
Jul 06 19:17:44.261465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.261450    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:17:44.269244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.269222    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:44.417939 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.417895    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8zkj\" (UniqueName: \"kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj\") pod \"authorino-58cd955675-vmllh\" (UID: \"568c4c04-61bd-4848-9499-3e2aa8d1e9c3\") " pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:44.519372 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.519276    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8zkj\" (UniqueName: \"kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj\") pod \"authorino-58cd955675-vmllh\" (UID: \"568c4c04-61bd-4848-9499-3e2aa8d1e9c3\") " pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:44.545880 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.545855    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8zkj\" (UniqueName: \"kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj\") pod \"authorino-58cd955675-vmllh\" (UID: \"568c4c04-61bd-4848-9499-3e2aa8d1e9c3\") " pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:44.565805 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.565761    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:44.693295 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.693258    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:17:44.696534 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.696513    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:17:44.707357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.707334    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:44.709850 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:17:44.709828    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod568c4c04_61bd_4848_9499_3e2aa8d1e9c3.slice/crio-96ab34f43b6f020cadbed527f43bcd77c4e5abbdb77e240ce0782dbc26602aa6 WatchSource:0}: Error finding container 96ab34f43b6f020cadbed527f43bcd77c4e5abbdb77e240ce0782dbc26602aa6: Status 404 returned error can't find the container with id 96ab34f43b6f020cadbed527f43bcd77c4e5abbdb77e240ce0782dbc26602aa6
Jul 06 19:17:44.711469 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.711451    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:17:44.715094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.715073    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:17:44.821454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.821355    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf85p\" (UniqueName: \"kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p\") pod \"authorino-75d556bd77-lxl4d\" (UID: \"404abfd5-7bfc-401c-a117-4d5248f09b5a\") " pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:17:44.922767 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.922723    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf85p\" (UniqueName: \"kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p\") pod \"authorino-75d556bd77-lxl4d\" (UID: \"404abfd5-7bfc-401c-a117-4d5248f09b5a\") " pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:17:44.933901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:44.933863    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf85p\" (UniqueName: \"kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p\") pod \"authorino-75d556bd77-lxl4d\" (UID: \"404abfd5-7bfc-401c-a117-4d5248f09b5a\") " pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:17:45.005649 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:45.005608    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:17:45.137222 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:45.137195    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:17:45.138850 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:17:45.138828    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod404abfd5_7bfc_401c_a117_4d5248f09b5a.slice/crio-42d95ed102f8ddc4fc162663a8267ffbdaec7ba05023b8865b148c9a83dca633 WatchSource:0}: Error finding container 42d95ed102f8ddc4fc162663a8267ffbdaec7ba05023b8865b148c9a83dca633: Status 404 returned error can't find the container with id 42d95ed102f8ddc4fc162663a8267ffbdaec7ba05023b8865b148c9a83dca633
Jul 06 19:17:45.458084 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:45.458039    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vmllh" event={"ID":"568c4c04-61bd-4848-9499-3e2aa8d1e9c3","Type":"ContainerStarted","Data":"96ab34f43b6f020cadbed527f43bcd77c4e5abbdb77e240ce0782dbc26602aa6"}
Jul 06 19:17:45.459666 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:45.459636    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lxl4d" event={"ID":"404abfd5-7bfc-401c-a117-4d5248f09b5a","Type":"ContainerStarted","Data":"42d95ed102f8ddc4fc162663a8267ffbdaec7ba05023b8865b148c9a83dca633"}
Jul 06 19:17:49.484532 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:49.484491    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lxl4d" event={"ID":"404abfd5-7bfc-401c-a117-4d5248f09b5a","Type":"ContainerStarted","Data":"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"}
Jul 06 19:17:49.486093 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:49.486049    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vmllh" event={"ID":"568c4c04-61bd-4848-9499-3e2aa8d1e9c3","Type":"ContainerStarted","Data":"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"}
Jul 06 19:17:49.564465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:49.564415    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vmllh" podStartSLOduration=1.282939207 podStartE2EDuration="5.5644004s" totalImagesPullingTime="4.281461193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:49.563549409 +0000 UTC m=+745.523992106" watchObservedRunningTime="2026-07-06 19:17:49.5644004 +0000 UTC m=+745.524843100"
Jul 06 19:17:49.564959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:49.564936    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lxl4d" podStartSLOduration=1.699653632 podStartE2EDuration="5.564926651s" totalImagesPullingTime="3.865273019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:49.512392486 +0000 UTC m=+745.472835183" watchObservedRunningTime="2026-07-06 19:17:49.564926651 +0000 UTC m=+745.525369354"
Jul 06 19:17:49.584020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:49.583970    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:51.495661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:51.495621    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vmllh" podUID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" containerName="authorino" containerID="cri-o://30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341" gracePeriod=30
Jul 06 19:17:51.740809 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:51.740782    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:51.882942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:51.882850    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8zkj\" (UniqueName: \"kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj\") pod \"568c4c04-61bd-4848-9499-3e2aa8d1e9c3\" (UID: \"568c4c04-61bd-4848-9499-3e2aa8d1e9c3\") "
Jul 06 19:17:51.885022 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:51.884973    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj" (OuterVolumeSpecName: "kube-api-access-j8zkj") pod "568c4c04-61bd-4848-9499-3e2aa8d1e9c3" (UID: "568c4c04-61bd-4848-9499-3e2aa8d1e9c3"). InnerVolumeSpecName "kube-api-access-j8zkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:17:51.983557 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:51.983502    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8zkj\" (UniqueName: \"kubernetes.io/projected/568c4c04-61bd-4848-9499-3e2aa8d1e9c3-kube-api-access-j8zkj\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:17:52.501430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.501397    2553 generic.go:356] "Generic (PLEG): container finished" podID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" containerID="30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341" exitCode=0
Jul 06 19:17:52.501843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.501442    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vmllh"
Jul 06 19:17:52.501843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.501441    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vmllh" event={"ID":"568c4c04-61bd-4848-9499-3e2aa8d1e9c3","Type":"ContainerDied","Data":"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"}
Jul 06 19:17:52.501843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.501578    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vmllh" event={"ID":"568c4c04-61bd-4848-9499-3e2aa8d1e9c3","Type":"ContainerDied","Data":"96ab34f43b6f020cadbed527f43bcd77c4e5abbdb77e240ce0782dbc26602aa6"}
Jul 06 19:17:52.501843 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.501606    2553 scope.go:117] "RemoveContainer" containerID="30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"
Jul 06 19:17:52.510246 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.510230    2553 scope.go:117] "RemoveContainer" containerID="30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"
Jul 06 19:17:52.510505 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:17:52.510486    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341\": container with ID starting with 30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341 not found: ID does not exist" containerID="30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"
Jul 06 19:17:52.510573 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.510514    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341"} err="failed to get container status \"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341\": rpc error: code = NotFound desc = could not find container \"30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341\": container with ID starting with 30c9f2eb2257b01eba76d304cc4b5dfb204dd64b5325811b5149f3f2d4b1f341 not found: ID does not exist"
Jul 06 19:17:52.529482 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.529455    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:52.540232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:52.540201    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vmllh"]
Jul 06 19:17:53.541377 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:17:53.541347    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" path="/var/lib/kubelet/pods/568c4c04-61bd-4848-9499-3e2aa8d1e9c3/volumes"
Jul 06 19:18:17.558421 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.558386    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:17.558902 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.558678    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" containerName="authorino"
Jul 06 19:18:17.558902 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.558691    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" containerName="authorino"
Jul 06 19:18:17.558902 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.558743    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="568c4c04-61bd-4848-9499-3e2aa8d1e9c3" containerName="authorino"
Jul 06 19:18:17.563069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.563051    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:17.573265 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.573239    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbbqj\" (UniqueName: \"kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj\") pod \"authorino-5d4b67c446-7cplq\" (UID: \"a8fdbdac-7e0c-444b-a188-4bc6b23fd190\") " pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:17.600140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.600101    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:17.673758 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.673714    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbbqj\" (UniqueName: \"kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj\") pod \"authorino-5d4b67c446-7cplq\" (UID: \"a8fdbdac-7e0c-444b-a188-4bc6b23fd190\") " pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:17.687644 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.687610    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbbqj\" (UniqueName: \"kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj\") pod \"authorino-5d4b67c446-7cplq\" (UID: \"a8fdbdac-7e0c-444b-a188-4bc6b23fd190\") " pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:17.848404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.848307    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:17.848569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:17.848557    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:18.017982 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.017957    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:18.019912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.019887    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:18.020154 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:18:18.020131    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8fdbdac_7e0c_444b_a188_4bc6b23fd190.slice/crio-f37673fa2530da5c230a4796b377d2f25421201b179efc10501d47d945bae713 WatchSource:0}: Error finding container f37673fa2530da5c230a4796b377d2f25421201b179efc10501d47d945bae713: Status 404 returned error can't find the container with id f37673fa2530da5c230a4796b377d2f25421201b179efc10501d47d945bae713
Jul 06 19:18:18.024254 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.024237    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:18.034254 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.034234    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:18.077244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.077206    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mg2c\" (UniqueName: \"kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c\") pod \"authorino-ddfdc5ff5-6mjjr\" (UID: \"ce6caa3f-703d-4ebf-b34e-4eba810c292b\") " pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:18.177807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.177718    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mg2c\" (UniqueName: \"kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c\") pod \"authorino-ddfdc5ff5-6mjjr\" (UID: \"ce6caa3f-703d-4ebf-b34e-4eba810c292b\") " pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:18.199032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.198981    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mg2c\" (UniqueName: \"kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c\") pod \"authorino-ddfdc5ff5-6mjjr\" (UID: \"ce6caa3f-703d-4ebf-b34e-4eba810c292b\") " pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:18.248515 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.248469    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:18.248759 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.248742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:18.301849 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.301810    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:18:18.306333 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.306310    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.313044 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.312980    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:18:18.322745 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.322720    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:18:18.379857 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.379826    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgjh2\" (UniqueName: \"kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.380046 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.379930    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.389009 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.388970    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:18.390157 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:18:18.390126    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6caa3f_703d_4ebf_b34e_4eba810c292b.slice/crio-3638158d89e83085c3914b8f705e6ce33a5c3d364f504b22f7870b17ff338687 WatchSource:0}: Error finding container 3638158d89e83085c3914b8f705e6ce33a5c3d364f504b22f7870b17ff338687: Status 404 returned error can't find the container with id 3638158d89e83085c3914b8f705e6ce33a5c3d364f504b22f7870b17ff338687
Jul 06 19:18:18.480801 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.480768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgjh2\" (UniqueName: \"kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.480965 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.480820    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.483541 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.483517    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.493784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.493758    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgjh2\" (UniqueName: \"kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2\") pod \"authorino-59b99f5-mwljh\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") " pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.616138 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.616094    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:18:18.627126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.626931    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7cplq" event={"ID":"a8fdbdac-7e0c-444b-a188-4bc6b23fd190","Type":"ContainerStarted","Data":"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"}
Jul 06 19:18:18.627126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.627014    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7cplq" event={"ID":"a8fdbdac-7e0c-444b-a188-4bc6b23fd190","Type":"ContainerStarted","Data":"f37673fa2530da5c230a4796b377d2f25421201b179efc10501d47d945bae713"}
Jul 06 19:18:18.627126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.627027    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-7cplq" podUID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" containerName="authorino" containerID="cri-o://6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1" gracePeriod=30
Jul 06 19:18:18.628225 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.628196    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" event={"ID":"ce6caa3f-703d-4ebf-b34e-4eba810c292b","Type":"ContainerStarted","Data":"3638158d89e83085c3914b8f705e6ce33a5c3d364f504b22f7870b17ff338687"}
Jul 06 19:18:18.664480 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.664419    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-7cplq" podStartSLOduration=1.329065915 podStartE2EDuration="1.664402687s" totalImagesPullingTime="335.336772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:18.664289826 +0000 UTC m=+774.624732522" watchObservedRunningTime="2026-07-06 19:18:18.664402687 +0000 UTC m=+774.624845383"
Jul 06 19:18:18.783866 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.783834    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:18:18.886614 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.886584    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:18.985218 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.985106    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbbqj\" (UniqueName: \"kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj\") pod \"a8fdbdac-7e0c-444b-a188-4bc6b23fd190\" (UID: \"a8fdbdac-7e0c-444b-a188-4bc6b23fd190\") "
Jul 06 19:18:18.987195 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:18.987169    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj" (OuterVolumeSpecName: "kube-api-access-gbbqj") pod "a8fdbdac-7e0c-444b-a188-4bc6b23fd190" (UID: "a8fdbdac-7e0c-444b-a188-4bc6b23fd190"). InnerVolumeSpecName "kube-api-access-gbbqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:18:19.086234 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.086184    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbbqj\" (UniqueName: \"kubernetes.io/projected/a8fdbdac-7e0c-444b-a188-4bc6b23fd190-kube-api-access-gbbqj\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:18:19.634525 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.634493    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b99f5-mwljh" event={"ID":"58943894-a968-483d-b6d7-6cd74f9042e7","Type":"ContainerStarted","Data":"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"}
Jul 06 19:18:19.635003 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.634535    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b99f5-mwljh" event={"ID":"58943894-a968-483d-b6d7-6cd74f9042e7","Type":"ContainerStarted","Data":"326607f356b224b0d5ba76176b9938e8a3aac0d639d6a8a68423a6c61ed20b77"}
Jul 06 19:18:19.635741 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.635718    2553 generic.go:356] "Generic (PLEG): container finished" podID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" containerID="6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1" exitCode=0
Jul 06 19:18:19.635832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.635756    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7cplq"
Jul 06 19:18:19.635832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.635799    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7cplq" event={"ID":"a8fdbdac-7e0c-444b-a188-4bc6b23fd190","Type":"ContainerDied","Data":"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"}
Jul 06 19:18:19.635936 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.635841    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7cplq" event={"ID":"a8fdbdac-7e0c-444b-a188-4bc6b23fd190","Type":"ContainerDied","Data":"f37673fa2530da5c230a4796b377d2f25421201b179efc10501d47d945bae713"}
Jul 06 19:18:19.635936 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.635859    2553 scope.go:117] "RemoveContainer" containerID="6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"
Jul 06 19:18:19.637366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.637346    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" event={"ID":"ce6caa3f-703d-4ebf-b34e-4eba810c292b","Type":"ContainerStarted","Data":"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"}
Jul 06 19:18:19.637474 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.637419    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" podUID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" containerName="authorino" containerID="cri-o://b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf" gracePeriod=30
Jul 06 19:18:19.644640 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.644619    2553 scope.go:117] "RemoveContainer" containerID="6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"
Jul 06 19:18:19.644968 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:18:19.644945    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1\": container with ID starting with 6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1 not found: ID does not exist" containerID="6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"
Jul 06 19:18:19.645049 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.644976    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1"} err="failed to get container status \"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1\": rpc error: code = NotFound desc = could not find container \"6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1\": container with ID starting with 6ed018683635a83d6e41603ee57a6bc79fb86620b3e0c5cfe00e0b7e9e4921f1 not found: ID does not exist"
Jul 06 19:18:19.696591 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.696543    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" podStartSLOduration=2.402793979 podStartE2EDuration="2.69652765s" totalImagesPullingTime="293.733671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:19.695722015 +0000 UTC m=+775.656164710" watchObservedRunningTime="2026-07-06 19:18:19.69652765 +0000 UTC m=+775.656970346"
Jul 06 19:18:19.698067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.698023    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59b99f5-mwljh" podStartSLOduration=1.379869552 podStartE2EDuration="1.698010698s" totalImagesPullingTime="318.141146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:19.665153581 +0000 UTC m=+775.625596277" watchObservedRunningTime="2026-07-06 19:18:19.698010698 +0000 UTC m=+775.658453394"
Jul 06 19:18:19.711167 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.711120    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:18:19.711369 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.711346    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lxl4d" podUID="404abfd5-7bfc-401c-a117-4d5248f09b5a" containerName="authorino" containerID="cri-o://324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771" gracePeriod=30
Jul 06 19:18:19.729043 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.729014    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:19.743959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.739750    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7cplq"]
Jul 06 19:18:19.944572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.944543    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:19.976588 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.976562    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:18:19.993542 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.993514    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mg2c\" (UniqueName: \"kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c\") pod \"ce6caa3f-703d-4ebf-b34e-4eba810c292b\" (UID: \"ce6caa3f-703d-4ebf-b34e-4eba810c292b\") "
Jul 06 19:18:19.993700 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.993550    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf85p\" (UniqueName: \"kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p\") pod \"404abfd5-7bfc-401c-a117-4d5248f09b5a\" (UID: \"404abfd5-7bfc-401c-a117-4d5248f09b5a\") "
Jul 06 19:18:19.995607 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.995573    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c" (OuterVolumeSpecName: "kube-api-access-2mg2c") pod "ce6caa3f-703d-4ebf-b34e-4eba810c292b" (UID: "ce6caa3f-703d-4ebf-b34e-4eba810c292b"). InnerVolumeSpecName "kube-api-access-2mg2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:18:19.995607 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:19.995583    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p" (OuterVolumeSpecName: "kube-api-access-qf85p") pod "404abfd5-7bfc-401c-a117-4d5248f09b5a" (UID: "404abfd5-7bfc-401c-a117-4d5248f09b5a"). InnerVolumeSpecName "kube-api-access-qf85p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:18:20.094620 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.094522    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mg2c\" (UniqueName: \"kubernetes.io/projected/ce6caa3f-703d-4ebf-b34e-4eba810c292b-kube-api-access-2mg2c\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:18:20.094620 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.094556    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf85p\" (UniqueName: \"kubernetes.io/projected/404abfd5-7bfc-401c-a117-4d5248f09b5a-kube-api-access-qf85p\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:18:20.642775 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.642742    2553 generic.go:356] "Generic (PLEG): container finished" podID="404abfd5-7bfc-401c-a117-4d5248f09b5a" containerID="324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771" exitCode=0
Jul 06 19:18:20.643229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.642785    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lxl4d"
Jul 06 19:18:20.643229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.642832    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lxl4d" event={"ID":"404abfd5-7bfc-401c-a117-4d5248f09b5a","Type":"ContainerDied","Data":"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"}
Jul 06 19:18:20.643229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.642882    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lxl4d" event={"ID":"404abfd5-7bfc-401c-a117-4d5248f09b5a","Type":"ContainerDied","Data":"42d95ed102f8ddc4fc162663a8267ffbdaec7ba05023b8865b148c9a83dca633"}
Jul 06 19:18:20.643229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.642902    2553 scope.go:117] "RemoveContainer" containerID="324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"
Jul 06 19:18:20.645186 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.645165    2553 generic.go:356] "Generic (PLEG): container finished" podID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" containerID="b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf" exitCode=0
Jul 06 19:18:20.645292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.645202    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr"
Jul 06 19:18:20.645292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.645234    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" event={"ID":"ce6caa3f-703d-4ebf-b34e-4eba810c292b","Type":"ContainerDied","Data":"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"}
Jul 06 19:18:20.645292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.645259    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ddfdc5ff5-6mjjr" event={"ID":"ce6caa3f-703d-4ebf-b34e-4eba810c292b","Type":"ContainerDied","Data":"3638158d89e83085c3914b8f705e6ce33a5c3d364f504b22f7870b17ff338687"}
Jul 06 19:18:20.652395 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.651958    2553 scope.go:117] "RemoveContainer" containerID="324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"
Jul 06 19:18:20.652395 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:18:20.652304    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771\": container with ID starting with 324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771 not found: ID does not exist" containerID="324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"
Jul 06 19:18:20.652395 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.652329    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771"} err="failed to get container status \"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771\": rpc error: code = NotFound desc = could not find container \"324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771\": container with ID starting with 324bad08d23c19b23256501ec88912fbd60e5f0795a2b2777adbafba0b975771 not found: ID does not exist"
Jul 06 19:18:20.652395 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.652347    2553 scope.go:117] "RemoveContainer" containerID="b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"
Jul 06 19:18:20.660180 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.660162    2553 scope.go:117] "RemoveContainer" containerID="b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"
Jul 06 19:18:20.660441 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:18:20.660424    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf\": container with ID starting with b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf not found: ID does not exist" containerID="b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"
Jul 06 19:18:20.660495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.660446    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf"} err="failed to get container status \"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf\": rpc error: code = NotFound desc = could not find container \"b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf\": container with ID starting with b668174b6147bbbc7d79325d1f87ef2189a9c3cc4b169f99b59739c1f1fad3cf not found: ID does not exist"
Jul 06 19:18:20.690063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.690030    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:20.693161 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.693129    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-ddfdc5ff5-6mjjr"]
Jul 06 19:18:20.721371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.721336    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:18:20.723837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:20.723810    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lxl4d"]
Jul 06 19:18:21.541479 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:21.541446    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404abfd5-7bfc-401c-a117-4d5248f09b5a" path="/var/lib/kubelet/pods/404abfd5-7bfc-401c-a117-4d5248f09b5a/volumes"
Jul 06 19:18:21.541778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:21.541765    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" path="/var/lib/kubelet/pods/a8fdbdac-7e0c-444b-a188-4bc6b23fd190/volumes"
Jul 06 19:18:21.542059 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:21.542047    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" path="/var/lib/kubelet/pods/ce6caa3f-703d-4ebf-b34e-4eba810c292b/volumes"
Jul 06 19:18:24.774227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774186    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774553    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774570    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774597    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774606    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774617    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404abfd5-7bfc-401c-a117-4d5248f09b5a" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774626    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="404abfd5-7bfc-401c-a117-4d5248f09b5a" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774700    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6caa3f-703d-4ebf-b34e-4eba810c292b" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774712    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fdbdac-7e0c-444b-a188-4bc6b23fd190" containerName="authorino"
Jul 06 19:18:24.774802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.774722    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="404abfd5-7bfc-401c-a117-4d5248f09b5a" containerName="authorino"
Jul 06 19:18:24.781282 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.781260    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.785618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.785574    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:18:24.785839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.785826    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:18:24.787540 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.787174    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cv44t\""
Jul 06 19:18:24.798009 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.797970    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:18:24.829675 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.829639    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.829675 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.829673    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfd9t\" (UniqueName: \"kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.930999 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.930936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.931184 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.931030    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfd9t\" (UniqueName: \"kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.933339 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.933309    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:24.942574 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:24.942546    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfd9t\" (UniqueName: \"kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t\") pod \"maas-controller-57c97645c5-9qn2s\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") " pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:25.096106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:25.096011    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:25.250190 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:25.250163    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:18:25.252669 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:18:25.252641    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2de6318_0452_4499_a1c8_4f2636c2ff26.slice/crio-78ab9ba35b8b189ceb31cfb1b0b31b1caf405ef5991b12f591863ff8ff99bb01 WatchSource:0}: Error finding container 78ab9ba35b8b189ceb31cfb1b0b31b1caf405ef5991b12f591863ff8ff99bb01: Status 404 returned error can't find the container with id 78ab9ba35b8b189ceb31cfb1b0b31b1caf405ef5991b12f591863ff8ff99bb01
Jul 06 19:18:25.670493 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:25.670455    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-9qn2s" event={"ID":"f2de6318-0452-4499-a1c8-4f2636c2ff26","Type":"ContainerStarted","Data":"78ab9ba35b8b189ceb31cfb1b0b31b1caf405ef5991b12f591863ff8ff99bb01"}
Jul 06 19:18:27.032772 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:27.032746    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:18:27.680840 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:27.680802    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-9qn2s" event={"ID":"f2de6318-0452-4499-a1c8-4f2636c2ff26","Type":"ContainerStarted","Data":"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"}
Jul 06 19:18:27.681061 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:27.680938    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:18:27.740104 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:27.740050    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57c97645c5-9qn2s" podStartSLOduration=1.965613128 podStartE2EDuration="3.740033034s" totalImagesPullingTime="1.774419906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:27.739625258 +0000 UTC m=+783.700067955" watchObservedRunningTime="2026-07-06 19:18:27.740033034 +0000 UTC m=+783.700475729"
Jul 06 19:18:38.695469 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:18:38.695435    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:19:23.536493 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.536456    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"]
Jul 06 19:19:23.539762 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.539738    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.553621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.553597    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:19:23.554946 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.554927    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bj8l\""
Jul 06 19:19:23.555078 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.554967    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:19:23.555078 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.555039    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:19:23.569261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.569231    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"]
Jul 06 19:19:23.601375 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601345    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.601568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601386    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.601568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601413    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.601568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601461    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/301b22d5-5ea6-43d6-97a8-e04dfed40123-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.601568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kbt8\" (UniqueName: \"kubernetes.io/projected/301b22d5-5ea6-43d6-97a8-e04dfed40123-kube-api-access-5kbt8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.601568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.601555    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702297    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702334    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/301b22d5-5ea6-43d6-97a8-e04dfed40123-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702358    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kbt8\" (UniqueName: \"kubernetes.io/projected/301b22d5-5ea6-43d6-97a8-e04dfed40123-kube-api-access-5kbt8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702563    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702755 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702610    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702835 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702817    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.702918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.702896    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.703045 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.703024    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.704799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.704773    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/301b22d5-5ea6-43d6-97a8-e04dfed40123-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.705061 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.705044    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/301b22d5-5ea6-43d6-97a8-e04dfed40123-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.718373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.718345    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kbt8\" (UniqueName: \"kubernetes.io/projected/301b22d5-5ea6-43d6-97a8-e04dfed40123-kube-api-access-5kbt8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk\" (UID: \"301b22d5-5ea6-43d6-97a8-e04dfed40123\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.850849 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.850744    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:23.999661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:23.999636    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"]
Jul 06 19:19:24.001826 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:19:24.001793    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301b22d5_5ea6_43d6_97a8_e04dfed40123.slice/crio-39ebc1e85d1fb1e53b777672542418e0047fb547600f111e46fb28b75d5a5125 WatchSource:0}: Error finding container 39ebc1e85d1fb1e53b777672542418e0047fb547600f111e46fb28b75d5a5125: Status 404 returned error can't find the container with id 39ebc1e85d1fb1e53b777672542418e0047fb547600f111e46fb28b75d5a5125
Jul 06 19:19:24.951385 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:24.951340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk" event={"ID":"301b22d5-5ea6-43d6-97a8-e04dfed40123","Type":"ContainerStarted","Data":"39ebc1e85d1fb1e53b777672542418e0047fb547600f111e46fb28b75d5a5125"}
Jul 06 19:19:25.957647 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:25.957609    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk" event={"ID":"301b22d5-5ea6-43d6-97a8-e04dfed40123","Type":"ContainerStarted","Data":"44d73fd91dbfa7367b9129ef1a15570c6f39f03096a92347702d0fefa13a27c2"}
Jul 06 19:19:25.983925 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:25.983869    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk" podStartSLOduration=1.860191108 podStartE2EDuration="2.983853597s" totalImagesPullingTime="1.123662489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:25.981067516 +0000 UTC m=+841.941510212" watchObservedRunningTime="2026-07-06 19:19:25.983853597 +0000 UTC m=+841.944296293"
Jul 06 19:19:33.851961 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:33.851921    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:33.852564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:33.852018    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:33.864930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:33.864900    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:19:34.005159 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:19:34.005120    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk"
Jul 06 19:21:33.497912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.497875    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64bb688f4b-f8j44"]
Jul 06 19:21:33.501097 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.501080    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.514255 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.514228    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64bb688f4b-f8j44"]
Jul 06 19:21:33.572033 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.571965    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d4d342e-ff05-4410-bf47-ac55b1717499-tls-cert\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.572214 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.572038    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzq4g\" (UniqueName: \"kubernetes.io/projected/8d4d342e-ff05-4410-bf47-ac55b1717499-kube-api-access-wzq4g\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.673223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.673170    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d4d342e-ff05-4410-bf47-ac55b1717499-tls-cert\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.673223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.673225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzq4g\" (UniqueName: \"kubernetes.io/projected/8d4d342e-ff05-4410-bf47-ac55b1717499-kube-api-access-wzq4g\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.675761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.675728    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d4d342e-ff05-4410-bf47-ac55b1717499-tls-cert\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.684656 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.684628    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzq4g\" (UniqueName: \"kubernetes.io/projected/8d4d342e-ff05-4410-bf47-ac55b1717499-kube-api-access-wzq4g\") pod \"authorino-64bb688f4b-f8j44\" (UID: \"8d4d342e-ff05-4410-bf47-ac55b1717499\") " pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.810345 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.810260    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bb688f4b-f8j44"
Jul 06 19:21:33.963116 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:33.963090    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64bb688f4b-f8j44"]
Jul 06 19:21:33.964613 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:21:33.964585    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d4d342e_ff05_4410_bf47_ac55b1717499.slice/crio-75cbad78dc4df01d785166b7cf29b23ed091a878d67021d0a0f80389250917cb WatchSource:0}: Error finding container 75cbad78dc4df01d785166b7cf29b23ed091a878d67021d0a0f80389250917cb: Status 404 returned error can't find the container with id 75cbad78dc4df01d785166b7cf29b23ed091a878d67021d0a0f80389250917cb
Jul 06 19:21:34.541715 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:34.541688    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bb688f4b-f8j44" event={"ID":"8d4d342e-ff05-4410-bf47-ac55b1717499","Type":"ContainerStarted","Data":"75cbad78dc4df01d785166b7cf29b23ed091a878d67021d0a0f80389250917cb"}
Jul 06 19:21:35.548473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.548435    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bb688f4b-f8j44" event={"ID":"8d4d342e-ff05-4410-bf47-ac55b1717499","Type":"ContainerStarted","Data":"a1bc0945d7ba84ceea2b64b4c85f4ef09b37f142573d09750de3b40cbe9d4f61"}
Jul 06 19:21:35.573761 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.573694    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64bb688f4b-f8j44" podStartSLOduration=2.028355224 podStartE2EDuration="2.573674398s" totalImagesPullingTime="545.319174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:35.571046396 +0000 UTC m=+971.531489096" watchObservedRunningTime="2026-07-06 19:21:35.573674398 +0000 UTC m=+971.534117094"
Jul 06 19:21:35.605293 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.605254    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:21:35.605514 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.605484    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-59b99f5-mwljh" podUID="58943894-a968-483d-b6d7-6cd74f9042e7" containerName="authorino" containerID="cri-o://6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74" gracePeriod=30
Jul 06 19:21:35.868688 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.868652    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:21:35.892473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.892439    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgjh2\" (UniqueName: \"kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2\") pod \"58943894-a968-483d-b6d7-6cd74f9042e7\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") "
Jul 06 19:21:35.892656 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.892503    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert\") pod \"58943894-a968-483d-b6d7-6cd74f9042e7\" (UID: \"58943894-a968-483d-b6d7-6cd74f9042e7\") "
Jul 06 19:21:35.894767 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.894732    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2" (OuterVolumeSpecName: "kube-api-access-tgjh2") pod "58943894-a968-483d-b6d7-6cd74f9042e7" (UID: "58943894-a968-483d-b6d7-6cd74f9042e7"). InnerVolumeSpecName "kube-api-access-tgjh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:21:35.904413 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.904376    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "58943894-a968-483d-b6d7-6cd74f9042e7" (UID: "58943894-a968-483d-b6d7-6cd74f9042e7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:21:35.993663 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.993622    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgjh2\" (UniqueName: \"kubernetes.io/projected/58943894-a968-483d-b6d7-6cd74f9042e7-kube-api-access-tgjh2\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:21:35.993663 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:35.993653    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58943894-a968-483d-b6d7-6cd74f9042e7-tls-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:21:36.554320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.554284    2553 generic.go:356] "Generic (PLEG): container finished" podID="58943894-a968-483d-b6d7-6cd74f9042e7" containerID="6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74" exitCode=0
Jul 06 19:21:36.554862 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.554336    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b99f5-mwljh"
Jul 06 19:21:36.554862 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.554382    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b99f5-mwljh" event={"ID":"58943894-a968-483d-b6d7-6cd74f9042e7","Type":"ContainerDied","Data":"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"}
Jul 06 19:21:36.554862 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.554426    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b99f5-mwljh" event={"ID":"58943894-a968-483d-b6d7-6cd74f9042e7","Type":"ContainerDied","Data":"326607f356b224b0d5ba76176b9938e8a3aac0d639d6a8a68423a6c61ed20b77"}
Jul 06 19:21:36.554862 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.554444    2553 scope.go:117] "RemoveContainer" containerID="6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"
Jul 06 19:21:36.563486 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.563469    2553 scope.go:117] "RemoveContainer" containerID="6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"
Jul 06 19:21:36.563757 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:21:36.563736    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74\": container with ID starting with 6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74 not found: ID does not exist" containerID="6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"
Jul 06 19:21:36.563821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.563763    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74"} err="failed to get container status \"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74\": rpc error: code = NotFound desc = could not find container \"6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74\": container with ID starting with 6b61a171af7c4d037b622f8c777a9ceb897f7862a99a1def66ee07cb98961b74 not found: ID does not exist"
Jul 06 19:21:36.604275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.604238    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:21:36.605925 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:36.605899    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59b99f5-mwljh"]
Jul 06 19:21:37.543309 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:21:37.543274    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58943894-a968-483d-b6d7-6cd74f9042e7" path="/var/lib/kubelet/pods/58943894-a968-483d-b6d7-6cd74f9042e7/volumes"
Jul 06 19:22:51.559837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.559795    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:22:51.560298 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.560022    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-57c97645c5-9qn2s" podUID="f2de6318-0452-4499-a1c8-4f2636c2ff26" containerName="manager" containerID="cri-o://421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f" gracePeriod=30
Jul 06 19:22:51.811637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.811575    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:22:51.914415 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.914378    2553 generic.go:356] "Generic (PLEG): container finished" podID="f2de6318-0452-4499-a1c8-4f2636c2ff26" containerID="421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f" exitCode=0
Jul 06 19:22:51.914594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.914427    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-9qn2s"
Jul 06 19:22:51.914594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.914465    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-9qn2s" event={"ID":"f2de6318-0452-4499-a1c8-4f2636c2ff26","Type":"ContainerDied","Data":"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"}
Jul 06 19:22:51.914594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.914517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-9qn2s" event={"ID":"f2de6318-0452-4499-a1c8-4f2636c2ff26","Type":"ContainerDied","Data":"78ab9ba35b8b189ceb31cfb1b0b31b1caf405ef5991b12f591863ff8ff99bb01"}
Jul 06 19:22:51.914594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.914546    2553 scope.go:117] "RemoveContainer" containerID="421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"
Jul 06 19:22:51.922917 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.922807    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert\") pod \"f2de6318-0452-4499-a1c8-4f2636c2ff26\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") "
Jul 06 19:22:51.922917 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.922846    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfd9t\" (UniqueName: \"kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t\") pod \"f2de6318-0452-4499-a1c8-4f2636c2ff26\" (UID: \"f2de6318-0452-4499-a1c8-4f2636c2ff26\") "
Jul 06 19:22:51.923067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.922933    2553 scope.go:117] "RemoveContainer" containerID="421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"
Jul 06 19:22:51.923267 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:22:51.923244    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f\": container with ID starting with 421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f not found: ID does not exist" containerID="421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"
Jul 06 19:22:51.923363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.923275    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f"} err="failed to get container status \"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f\": rpc error: code = NotFound desc = could not find container \"421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f\": container with ID starting with 421c365aa9a5482326854d8e8239f8bc2afeecb48e9e3290aca95433b2f8319f not found: ID does not exist"
Jul 06 19:22:51.924954 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.924932    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f2de6318-0452-4499-a1c8-4f2636c2ff26" (UID: "f2de6318-0452-4499-a1c8-4f2636c2ff26"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:22:51.925129 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:51.925018    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t" (OuterVolumeSpecName: "kube-api-access-wfd9t") pod "f2de6318-0452-4499-a1c8-4f2636c2ff26" (UID: "f2de6318-0452-4499-a1c8-4f2636c2ff26"). InnerVolumeSpecName "kube-api-access-wfd9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:22:52.024443 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:52.024401    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2de6318-0452-4499-a1c8-4f2636c2ff26-webhook-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:22:52.024443 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:52.024434    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfd9t\" (UniqueName: \"kubernetes.io/projected/f2de6318-0452-4499-a1c8-4f2636c2ff26-kube-api-access-wfd9t\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:22:52.246202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:52.246169    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:22:52.251572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:52.251543    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57c97645c5-9qn2s"]
Jul 06 19:22:53.075818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.075780    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57c97645c5-rvpgm"]
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076068    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2de6318-0452-4499-a1c8-4f2636c2ff26" containerName="manager"
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076080    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2de6318-0452-4499-a1c8-4f2636c2ff26" containerName="manager"
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076095    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58943894-a968-483d-b6d7-6cd74f9042e7" containerName="authorino"
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076102    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="58943894-a968-483d-b6d7-6cd74f9042e7" containerName="authorino"
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076155    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="58943894-a968-483d-b6d7-6cd74f9042e7" containerName="authorino"
Jul 06 19:22:53.076224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.076162    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2de6318-0452-4499-a1c8-4f2636c2ff26" containerName="manager"
Jul 06 19:22:53.078970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.078953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.084040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.084011    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cv44t\""
Jul 06 19:22:53.084040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.084035    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:22:53.084214 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.084011    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:22:53.095260 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.095230    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c97645c5-rvpgm"]
Jul 06 19:22:53.134237 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.134198    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trphf\" (UniqueName: \"kubernetes.io/projected/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-kube-api-access-trphf\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.134419 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.134242    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-webhook-cert\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.235620 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.235558    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trphf\" (UniqueName: \"kubernetes.io/projected/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-kube-api-access-trphf\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.235818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.235729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-webhook-cert\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.238135 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.238106    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-webhook-cert\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.249377 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.249350    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trphf\" (UniqueName: \"kubernetes.io/projected/f319f225-5f5c-45e0-8e07-6ac6bd4f937d-kube-api-access-trphf\") pod \"maas-controller-57c97645c5-rvpgm\" (UID: \"f319f225-5f5c-45e0-8e07-6ac6bd4f937d\") " pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.388789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.388697    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:53.534979 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.534952    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c97645c5-rvpgm"]
Jul 06 19:22:53.537411 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:22:53.537378    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf319f225_5f5c_45e0_8e07_6ac6bd4f937d.slice/crio-2d8c5ca86c85fde7e2a5a34a5a37ad3f669179df3b7fc195c26edb0bd0b9d8f3 WatchSource:0}: Error finding container 2d8c5ca86c85fde7e2a5a34a5a37ad3f669179df3b7fc195c26edb0bd0b9d8f3: Status 404 returned error can't find the container with id 2d8c5ca86c85fde7e2a5a34a5a37ad3f669179df3b7fc195c26edb0bd0b9d8f3
Jul 06 19:22:53.538730 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.538710    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:22:53.542684 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.542659    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2de6318-0452-4499-a1c8-4f2636c2ff26" path="/var/lib/kubelet/pods/f2de6318-0452-4499-a1c8-4f2636c2ff26/volumes"
Jul 06 19:22:53.931516 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:53.931475    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-rvpgm" event={"ID":"f319f225-5f5c-45e0-8e07-6ac6bd4f937d","Type":"ContainerStarted","Data":"2d8c5ca86c85fde7e2a5a34a5a37ad3f669179df3b7fc195c26edb0bd0b9d8f3"}
Jul 06 19:22:54.937536 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:54.937493    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-rvpgm" event={"ID":"f319f225-5f5c-45e0-8e07-6ac6bd4f937d","Type":"ContainerStarted","Data":"c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"}
Jul 06 19:22:54.937973 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:54.937649    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:22:54.964757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:22:54.964702    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podStartSLOduration=1.454127667 podStartE2EDuration="1.964685348s" totalImagesPullingTime="510.557681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:22:54.963637959 +0000 UTC m=+1050.924080656" watchObservedRunningTime="2026-07-06 19:22:54.964685348 +0000 UTC m=+1050.925128044"
Jul 06 19:23:05.949661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:23:05.949626    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:29:57.728600 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:29:57.728554    2553 controller.go:195] "Failed to update lease" err="Put \"https://a222d379bd82d4b8d94201e0815a06f4-c29cc58d05ce0064.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-139-205.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:30:07.729218 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:30:07.729161    2553 controller.go:195] "Failed to update lease" err="Put \"https://a222d379bd82d4b8d94201e0815a06f4-c29cc58d05ce0064.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-139-205.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:30:17.730281 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:30:17.730224    2553 controller.go:195] "Failed to update lease" err="Put \"https://a222d379bd82d4b8d94201e0815a06f4-c29cc58d05ce0064.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-139-205.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:30:24.792420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792368    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792426    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792449    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792474    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792446    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792461    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792494    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792501    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b548v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792515    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792510    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h2c44\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792540    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q6kbs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792550    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792511    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792459    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792568    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vgbgk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792579    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792555    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kcthv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792575    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.792937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792605    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792622    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792624    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792653    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792659    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792670    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792679    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n9pt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792626    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792673    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjkqn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792700    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792704    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792645    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792681    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5cx5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792708    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792730    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792740    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792745    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792752    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.793744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792769    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792776    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792767    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792793    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792807    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp86h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792811    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792825    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792810    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792826    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792845    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qlc5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792854    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792863    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792869    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792845    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792882    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792885    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws5pk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792876    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792886    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792903    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792910    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792867    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792921    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792900    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792924    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792927    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792927    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792951    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792952    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792938    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792964    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.792979    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793005    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793012    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793023    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793042    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cv44t\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793050    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-tb57k\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.794930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793053    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793057    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dcvz6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793062    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793072    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793073    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793093    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-fgpct\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793102    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793106    2553 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793131    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793160    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793166    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-2bj8l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793170    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793190    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793209    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:30:24.793240    2553 controller.go:195] "Failed to update lease" err="Put \"https://a222d379bd82d4b8d94201e0815a06f4-c29cc58d05ce0064.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-139-205.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793269    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793272    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793283    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.795513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793299    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t5h6l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793308    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793312    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793322    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793325    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgfm6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793333    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793336    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793340    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793342    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793361    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75b77\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793360    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793363    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793368    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793381    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793387    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nvdgj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793389    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:24.796175 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:24.793382    2553 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 19:30:25.601257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.601228    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.619401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.619369    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:30:25.620263 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.620242    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\""
Jul 06 19:30:25.629179 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.629157    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:30:25.648665 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.648638    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cv44t\""
Jul 06 19:30:25.670274 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.670246    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:30:25.671860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.671837    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws5pk\""
Jul 06 19:30:25.671972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.671911    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.673611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.673596    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:30:25.684136 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.684117    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:30:25.686241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.686225    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:30:25.689827 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.689812    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.690582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.690567    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:30:25.691600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.691585    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:30:25.710973 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.710948    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:30:25.712632 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.712618    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.716636 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.716619    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:30:25.735140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.735117    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:30:25.743251 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.743219    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75b77\""
Jul 06 19:30:25.743334 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.743317    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\""
Jul 06 19:30:25.752069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.752046    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:30:25.753194 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.753177    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:30:25.760458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.760440    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:30:25.767698 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.767676    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.770854 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.770839    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.791970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.791946    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.800088 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.800068    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjkqn\""
Jul 06 19:30:25.803323 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.803306    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:30:25.805586 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.805569    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fgpct\""
Jul 06 19:30:25.807898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.807883    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:30:25.815227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.815210    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.831732 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.831708    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n9pt\""
Jul 06 19:30:25.837948 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.837925    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\""
Jul 06 19:30:25.844869 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.844846    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.853485 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.853431    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:30:25.858195 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.858174    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:30:25.885916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.885880    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:30:25.887954 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.887936    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.894031 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.894011    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.905373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.905351    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.936918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.936887    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:30:25.944527 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.944497    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:30:25.953975 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.953951    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:30:25.958699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.958677    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:30:25.958817 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.958743    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h2c44\""
Jul 06 19:30:25.969721 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.969701    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:30:25.981148 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.981125    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:30:25.993350 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:25.993328    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.005405 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.005381    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:30:26.008087 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.008070    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.012422 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.012404    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.015965 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.015947    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nvdgj\""
Jul 06 19:30:26.021736 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.021721    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.024950 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.024933    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:30:26.029143 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.029124    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.052538 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.052506    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.052765 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.052750    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bj8l\""
Jul 06 19:30:26.054316 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.054297    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgfm6\""
Jul 06 19:30:26.063117 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.063093    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:30:26.077920 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.077887    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.078072 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.077938    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.078072 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.077952    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dcvz6\""
Jul 06 19:30:26.078072 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.077954    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qlc5\""
Jul 06 19:30:26.079451 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.079435    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.091977 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.091952    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:30:26.092300 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.092285    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.106341 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.106276    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:30:26.108781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.108765    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:30:26.110932 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.110915    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:30:26.127430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.127401    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.129246 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.129231    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t5h6l\""
Jul 06 19:30:26.135168 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.135150    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tb57k\""
Jul 06 19:30:26.138925 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.138907    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.151371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.151347    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:30:26.163885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.163861    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:30:26.170866 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.170840    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.187104 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.187072    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5cx5\""
Jul 06 19:30:26.189678 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.189659    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.198387 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.198367    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.207060 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.207037    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kcthv\""
Jul 06 19:30:26.217397 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.217377    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:30:26.224192 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.224169    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.226456 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.226441    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:30:26.234780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.234747    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.246082 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.246060    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:30:26.246082 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.246072    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\""
Jul 06 19:30:26.246344 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.246329    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.254239 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.254220    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.255282 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.255268    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:30:26.286831 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.286799    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b548v\""
Jul 06 19:30:26.293190 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.293164    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:30:26.302668 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.302646    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp86h\""
Jul 06 19:30:26.313504 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.313473    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:30:26.319478 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.319453    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:30:26.328902 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.328869    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:30:26.333486 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.333464    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vgbgk\""
Jul 06 19:30:26.336564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.336536    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\""
Jul 06 19:30:26.336712 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.336665    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:30:26.345216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.345195    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:30:26.352273 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.352255    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q6kbs\""
Jul 06 19:30:26.361388 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.361320    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:30:26.363667 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.363654    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.384943 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.384917    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:30:26.388280 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.388263    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:30:26.389882 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.389868    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:30:26.392836 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:30:26.392813    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 19:35:21.818275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.818241    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:21.821588 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.821569    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.825253 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.825231    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-894faafa-openshift-default-dockercfg-gngns\""
Jul 06 19:35:21.850651 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.850616    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:21.932283 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932240    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932283 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932290    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932309    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932420    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pz5v\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932445    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932463    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932506 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932487    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:21.932692 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:21.932531    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.033789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033739    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz5v\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.033789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033841    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033863    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033905    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033945    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.033976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034455 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034328    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034455 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034346    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034492    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034661    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.034956 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.034934    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.036407 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.036382    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.036562 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.036546    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.044837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.044810    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.044998 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.044892    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pz5v\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v\") pod \"e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") " pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.131973 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.131943    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:22.281809 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.281783    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:22.283612 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:35:22.283584    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7f2aa2_5a52_4f85_99b4_9cacf631d24e.slice/crio-a83585a112aad1d75bc8202a38c5609e5d4b1baf64e585830c814c9136cc3fef WatchSource:0}: Error finding container a83585a112aad1d75bc8202a38c5609e5d4b1baf64e585830c814c9136cc3fef: Status 404 returned error can't find the container with id a83585a112aad1d75bc8202a38c5609e5d4b1baf64e585830c814c9136cc3fef
Jul 06 19:35:22.285569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.285533    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:22.285638 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.285605    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:22.285638 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.285633    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:22.344223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:22.344150    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" event={"ID":"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e","Type":"ContainerStarted","Data":"a83585a112aad1d75bc8202a38c5609e5d4b1baf64e585830c814c9136cc3fef"}
Jul 06 19:35:23.121419 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.121375    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:23.125163 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.125137    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.127741 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.127706    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:35:23.127892 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.127829    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-894faafa-serving-cert\""
Jul 06 19:35:23.139769 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.139739    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:23.242556 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.242516    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.242731 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.242620    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.242731 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.242664    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7fsx\" (UniqueName: \"kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.343915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.343871    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.344113 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.343957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.344113 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.344024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7fsx\" (UniqueName: \"kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.344201 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:35:23.344141    2553 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-894faafa-serving-cert: secret "maas-api-e2e-ait-894faafa-serving-cert" not found
Jul 06 19:35:23.344251 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:35:23.344221    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls podName:7785ea31-eb4d-4b33-925b-f68430f9d638 nodeName:}" failed. No retries permitted until 2026-07-06 19:35:23.844196427 +0000 UTC m=+1799.804639123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls") pod "maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" (UID: "7785ea31-eb4d-4b33-925b-f68430f9d638") : secret "maas-api-e2e-ait-894faafa-serving-cert" not found
Jul 06 19:35:23.344714 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.344695    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.349955 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.349923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" event={"ID":"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e","Type":"ContainerStarted","Data":"ec013070f0fbf35933beaedb14c1ed27e7226293a7e0682b2919240deefbeef0"}
Jul 06 19:35:23.354849 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.354825    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7fsx\" (UniqueName: \"kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.379513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.379401    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" podStartSLOduration=2.379380047 podStartE2EDuration="2.379380047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:23.378608032 +0000 UTC m=+1799.339050729" watchObservedRunningTime="2026-07-06 19:35:23.379380047 +0000 UTC m=+1799.339822746"
Jul 06 19:35:23.847679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.847626    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:23.850166 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:23.850131    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") pod \"maas-api-e2e-ait-894faafa-85d878f56b-vlnpr\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") " pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:24.037461 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.037420    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:24.132495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.132426    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:24.138621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.138588    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:24.187533 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.187503    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:24.189460 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:35:24.189432    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7785ea31_eb4d_4b33_925b_f68430f9d638.slice/crio-cb49b78ae0548d0b26d9d0fa521560a7e5287d907a96067e30e2b7f4dfc79f47 WatchSource:0}: Error finding container cb49b78ae0548d0b26d9d0fa521560a7e5287d907a96067e30e2b7f4dfc79f47: Status 404 returned error can't find the container with id cb49b78ae0548d0b26d9d0fa521560a7e5287d907a96067e30e2b7f4dfc79f47
Jul 06 19:35:24.191333 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.191313    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:35:24.355942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.355908    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" event={"ID":"7785ea31-eb4d-4b33-925b-f68430f9d638","Type":"ContainerStarted","Data":"cb49b78ae0548d0b26d9d0fa521560a7e5287d907a96067e30e2b7f4dfc79f47"}
Jul 06 19:35:24.356236 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.356220    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:24.357286 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:24.357264    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:26.367583 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:26.367534    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" event={"ID":"7785ea31-eb4d-4b33-925b-f68430f9d638","Type":"ContainerStarted","Data":"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"}
Jul 06 19:35:26.368106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:26.367799    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:26.392942 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:26.392889    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" podStartSLOduration=1.660593429 podStartE2EDuration="3.392871179s" totalImagesPullingTime="1.73227775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:26.391031556 +0000 UTC m=+1802.351474253" watchObservedRunningTime="2026-07-06 19:35:26.392871179 +0000 UTC m=+1802.353313874"
Jul 06 19:35:28.280172 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.280135    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:28.280682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.280348    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" podUID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" containerName="istio-proxy" containerID="cri-o://ec013070f0fbf35933beaedb14c1ed27e7226293a7e0682b2919240deefbeef0" gracePeriod=30
Jul 06 19:35:28.575947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.575847    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:28.576125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.576084    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" podUID="7785ea31-eb4d-4b33-925b-f68430f9d638" containerName="maas-api" containerID="cri-o://45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff" gracePeriod=30
Jul 06 19:35:28.813109 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.813078    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:28.989037 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.988973    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") pod \"7785ea31-eb4d-4b33-925b-f68430f9d638\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") "
Jul 06 19:35:28.989212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.989052    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7fsx\" (UniqueName: \"kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx\") pod \"7785ea31-eb4d-4b33-925b-f68430f9d638\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") "
Jul 06 19:35:28.989212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.989099    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca\") pod \"7785ea31-eb4d-4b33-925b-f68430f9d638\" (UID: \"7785ea31-eb4d-4b33-925b-f68430f9d638\") "
Jul 06 19:35:28.989508 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.989482    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7785ea31-eb4d-4b33-925b-f68430f9d638" (UID: "7785ea31-eb4d-4b33-925b-f68430f9d638"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:28.991232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.991211    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx" (OuterVolumeSpecName: "kube-api-access-x7fsx") pod "7785ea31-eb4d-4b33-925b-f68430f9d638" (UID: "7785ea31-eb4d-4b33-925b-f68430f9d638"). InnerVolumeSpecName "kube-api-access-x7fsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:28.991291 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:28.991225    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7785ea31-eb4d-4b33-925b-f68430f9d638" (UID: "7785ea31-eb4d-4b33-925b-f68430f9d638"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:29.090153 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.090116    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7785ea31-eb4d-4b33-925b-f68430f9d638-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:29.090153 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.090146    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7fsx\" (UniqueName: \"kubernetes.io/projected/7785ea31-eb4d-4b33-925b-f68430f9d638-kube-api-access-x7fsx\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:29.090153 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.090157    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7785ea31-eb4d-4b33-925b-f68430f9d638-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:29.384128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.384040    2553 generic.go:356] "Generic (PLEG): container finished" podID="7785ea31-eb4d-4b33-925b-f68430f9d638" containerID="45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff" exitCode=0
Jul 06 19:35:29.384128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.384087    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"
Jul 06 19:35:29.384128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.384097    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" event={"ID":"7785ea31-eb4d-4b33-925b-f68430f9d638","Type":"ContainerDied","Data":"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"}
Jul 06 19:35:29.384584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.384139    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr" event={"ID":"7785ea31-eb4d-4b33-925b-f68430f9d638","Type":"ContainerDied","Data":"cb49b78ae0548d0b26d9d0fa521560a7e5287d907a96067e30e2b7f4dfc79f47"}
Jul 06 19:35:29.384584 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.384164    2553 scope.go:117] "RemoveContainer" containerID="45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"
Jul 06 19:35:29.393608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.393587    2553 scope.go:117] "RemoveContainer" containerID="45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"
Jul 06 19:35:29.393882 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:35:29.393865    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff\": container with ID starting with 45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff not found: ID does not exist" containerID="45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"
Jul 06 19:35:29.393938 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.393894    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff"} err="failed to get container status \"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff\": rpc error: code = NotFound desc = could not find container \"45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff\": container with ID starting with 45b35ebc28d72298b631bb096e4192d7685b4a1986f9999371c24c69d48c8fff not found: ID does not exist"
Jul 06 19:35:29.423472 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.423435    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:29.430251 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.430217    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-894faafa-85d878f56b-vlnpr"]
Jul 06 19:35:29.542673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:29.542639    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7785ea31-eb4d-4b33-925b-f68430f9d638" path="/var/lib/kubelet/pods/7785ea31-eb4d-4b33-925b-f68430f9d638/volumes"
Jul 06 19:35:33.405820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.405783    2553 generic.go:356] "Generic (PLEG): container finished" podID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" containerID="ec013070f0fbf35933beaedb14c1ed27e7226293a7e0682b2919240deefbeef0" exitCode=0
Jul 06 19:35:33.406287 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.405817    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" event={"ID":"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e","Type":"ContainerDied","Data":"ec013070f0fbf35933beaedb14c1ed27e7226293a7e0682b2919240deefbeef0"}
Jul 06 19:35:33.525605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.525578    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:33.631241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631150    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631210    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631242    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631261    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pz5v\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631395    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631470    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631509    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631540    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo\") pod \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\" (UID: \"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e\") "
Jul 06 19:35:33.631779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631504    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:33.631779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631639    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:33.631779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631721    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:33.631779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631727    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:33.632030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631872    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.632030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631893    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.632030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631909    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.632030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631923    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.632030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.631944    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:33.633569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.633540    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:33.633676 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.633575    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:35:33.633829 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.633806    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v" (OuterVolumeSpecName: "kube-api-access-6pz5v") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "kube-api-access-6pz5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:33.633931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.633843    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" (UID: "1d7f2aa2-5a52-4f85-99b4-9cacf631d24e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:33.733205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.733164    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.733205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.733195    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pz5v\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-kube-api-access-6pz5v\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.733205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.733206    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.733205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.733214    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:33.733467 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:33.733222    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:34.411827 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:34.411796    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"
Jul 06 19:35:34.412233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:34.411799    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl" event={"ID":"1d7f2aa2-5a52-4f85-99b4-9cacf631d24e","Type":"ContainerDied","Data":"a83585a112aad1d75bc8202a38c5609e5d4b1baf64e585830c814c9136cc3fef"}
Jul 06 19:35:34.412233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:34.411944    2553 scope.go:117] "RemoveContainer" containerID="ec013070f0fbf35933beaedb14c1ed27e7226293a7e0682b2919240deefbeef0"
Jul 06 19:35:34.440915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:34.440879    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:34.447400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:34.447374    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-894faafa-openshift-default-6dc9458d67-khjtl"]
Jul 06 19:35:35.542596 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.542563    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" path="/var/lib/kubelet/pods/1d7f2aa2-5a52-4f85-99b4-9cacf631d24e/volumes"
Jul 06 19:35:35.545052 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545023    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:35.545322 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545310    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7785ea31-eb4d-4b33-925b-f68430f9d638" containerName="maas-api"
Jul 06 19:35:35.545374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545323    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7785ea31-eb4d-4b33-925b-f68430f9d638" containerName="maas-api"
Jul 06 19:35:35.545374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545343    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" containerName="istio-proxy"
Jul 06 19:35:35.545374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545349    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" containerName="istio-proxy"
Jul 06 19:35:35.545472 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545391    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d7f2aa2-5a52-4f85-99b4-9cacf631d24e" containerName="istio-proxy"
Jul 06 19:35:35.545472 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.545400    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7785ea31-eb4d-4b33-925b-f68430f9d638" containerName="maas-api"
Jul 06 19:35:35.549529 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.549509    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.552578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.552556    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-66f608b7-openshift-default-dockercfg-dxs7d\""
Jul 06 19:35:35.562303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.562275    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:35.649743 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649711    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649751    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649770    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649799    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649822    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brsw9\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649852    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.649927 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649919    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.650182 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.649954    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750315    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750365    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750388    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750403    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750449    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsw9\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750474    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750492    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.750619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.751012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750911    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.751012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.750934    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.751119 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.751054    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.751119 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.751082    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.751315 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.751296    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.753274 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.753248    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.753512 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.753498    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.761439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.761413    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.761648 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.761626    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brsw9\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9\") pod \"e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") " pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:35.861204 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:35.861104    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:36.010729 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.010562    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:36.013315 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:35:36.013292    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408bdf4a_4990_4232_aa0c_3b3d7347247a.slice/crio-6743c81fd46970288dbf259fb3c6ff6ad12d87c5a82a1986792ac625e92e59f8 WatchSource:0}: Error finding container 6743c81fd46970288dbf259fb3c6ff6ad12d87c5a82a1986792ac625e92e59f8: Status 404 returned error can't find the container with id 6743c81fd46970288dbf259fb3c6ff6ad12d87c5a82a1986792ac625e92e59f8
Jul 06 19:35:36.015260 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.015225    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:36.015357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.015294    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:36.015357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.015323    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:36.427063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.427024    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerStarted","Data":"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"}
Jul 06 19:35:36.427257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.427092    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerStarted","Data":"6743c81fd46970288dbf259fb3c6ff6ad12d87c5a82a1986792ac625e92e59f8"}
Jul 06 19:35:36.453569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.453357    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" podStartSLOduration=1.453337686 podStartE2EDuration="1.453337686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:36.452558169 +0000 UTC m=+1812.413000876" watchObservedRunningTime="2026-07-06 19:35:36.453337686 +0000 UTC m=+1812.413780382"
Jul 06 19:35:36.861716 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:36.861672    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:37.866692 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:37.866654    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:38.436094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:38.436066    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:38.437024 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:38.436979    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:47.483085 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.483051    2553 generic.go:356] "Generic (PLEG): container finished" podID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerID="31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198" exitCode=0
Jul 06 19:35:47.483624 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.483132    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerDied","Data":"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"}
Jul 06 19:35:47.483624 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.483582    2553 scope.go:117] "RemoveContainer" containerID="31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"
Jul 06 19:35:47.484613 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.484586    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:47.484673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.484653    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:47.484709 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:47.484687    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:48.099733 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:48.099700    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:48.489686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:48.489647    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerStarted","Data":"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"}
Jul 06 19:35:48.490145 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:48.489713    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy" containerID="cri-o://cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6" gracePeriod=30
Jul 06 19:35:53.436893 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.436848    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:53.740124 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.740098    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:53.798378 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798339    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798378 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798375    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798424    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798472    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798488    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798510    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798642    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:53.798825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798645    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brsw9\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798725    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798748    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy\") pod \"408bdf4a-4990-4232-aa0c-3b3d7347247a\" (UID: \"408bdf4a-4990-4232-aa0c-3b3d7347247a\") "
Jul 06 19:35:53.798825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798793    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798822    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.798926    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.799056    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408bdf4a-4990-4232-aa0c-3b3d7347247a-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.799075    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.799090    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.799126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.799103    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.799426 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.799278    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data" (OuterVolumeSpecName: "istio-data") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:53.800831 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.800800    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:53.800928 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.800833    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:35:53.800928 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.800835    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9" (OuterVolumeSpecName: "kube-api-access-brsw9") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "kube-api-access-brsw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:53.800928 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.800900    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token" (OuterVolumeSpecName: "istio-token") pod "408bdf4a-4990-4232-aa0c-3b3d7347247a" (UID: "408bdf4a-4990-4232-aa0c-3b3d7347247a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:53.900243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.900201    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.900243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.900233    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.900243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.900242    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brsw9\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-kube-api-access-brsw9\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.900243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.900250    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:53.900521 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:53.900260    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408bdf4a-4990-4232-aa0c-3b3d7347247a-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:35:54.518810 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.518779    2553 generic.go:356] "Generic (PLEG): container finished" podID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerID="cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6" exitCode=0
Jul 06 19:35:54.519302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.518819    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerDied","Data":"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"}
Jul 06 19:35:54.519302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.518846    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"
Jul 06 19:35:54.519302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.518866    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x" event={"ID":"408bdf4a-4990-4232-aa0c-3b3d7347247a","Type":"ContainerDied","Data":"6743c81fd46970288dbf259fb3c6ff6ad12d87c5a82a1986792ac625e92e59f8"}
Jul 06 19:35:54.519302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.518891    2553 scope.go:117] "RemoveContainer" containerID="cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"
Jul 06 19:35:54.527913 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.527893    2553 scope.go:117] "RemoveContainer" containerID="31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"
Jul 06 19:35:54.535935 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.535915    2553 scope.go:117] "RemoveContainer" containerID="cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"
Jul 06 19:35:54.536242 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:35:54.536221    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6\": container with ID starting with cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6 not found: ID does not exist" containerID="cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"
Jul 06 19:35:54.536320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.536255    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6"} err="failed to get container status \"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6\": rpc error: code = NotFound desc = could not find container \"cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6\": container with ID starting with cecf44662b22d0e2948d083ddeb6d6c029007954d953d3f527b0178f26e941c6 not found: ID does not exist"
Jul 06 19:35:54.536320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.536278    2553 scope.go:117] "RemoveContainer" containerID="31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"
Jul 06 19:35:54.536514 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:35:54.536496    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198\": container with ID starting with 31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198 not found: ID does not exist" containerID="31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"
Jul 06 19:35:54.536555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.536521    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198"} err="failed to get container status \"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198\": rpc error: code = NotFound desc = could not find container \"31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198\": container with ID starting with 31ca2a5b9be7b62e9f77b15b5fb8234706574a88b3f00c9183533068cb084198 not found: ID does not exist"
Jul 06 19:35:54.543871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.543848    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:54.549523 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:54.549495    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-66f608b7-openshift-default-cfdf9db57-x5z9x"]
Jul 06 19:35:55.465191 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.465159    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:35:55.465477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.465465    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:35:55.465519 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.465478    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:35:55.465554 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.465537    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:35:55.470124 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.470102    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.472973 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.472950    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b394aded-openshift-default-dockercfg-26j57\""
Jul 06 19:35:55.489796 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.489766    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:35:55.513646 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513598    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.513802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513664    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.513802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513726    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.513802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.513802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513786    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.514012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513861    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.514012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513876    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.514012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513890    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.514012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.513908    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98hl\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.543734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.543700    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" path="/var/lib/kubelet/pods/408bdf4a-4990-4232-aa0c-3b3d7347247a/volumes"
Jul 06 19:35:55.614469 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614428    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614469 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614474    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614701 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614493    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614701 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614611    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614701 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614688    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614704    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614719    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614744    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98hl\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.614842 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614782    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.615080 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614878    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.615080 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614916    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.615080 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.614954    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.615259 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.615227    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.615505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.615479    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.617076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.617046    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.617346 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.617328    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.625450 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.625427    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.625633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.625615    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98hl\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl\") pod \"e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") " pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.780517 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.780413    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:55.944192 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.944166    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:35:55.945903 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:35:55.945873    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa685cb_245a_45f8_a3af_e80f9ccf9cb9.slice/crio-bf1d8912fc1dbc24f8788c73c09ef99ad55cce65c9b44a7c25b3ae25df831419 WatchSource:0}: Error finding container bf1d8912fc1dbc24f8788c73c09ef99ad55cce65c9b44a7c25b3ae25df831419: Status 404 returned error can't find the container with id bf1d8912fc1dbc24f8788c73c09ef99ad55cce65c9b44a7c25b3ae25df831419
Jul 06 19:35:55.947997 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.947950    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:55.948090 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.948043    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:55.948137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:55.948103    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:56.531233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:56.531196    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" event={"ID":"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9","Type":"ContainerStarted","Data":"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"}
Jul 06 19:35:56.531417 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:56.531251    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" event={"ID":"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9","Type":"ContainerStarted","Data":"bf1d8912fc1dbc24f8788c73c09ef99ad55cce65c9b44a7c25b3ae25df831419"}
Jul 06 19:35:56.567355 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:56.567291    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" podStartSLOduration=1.5672697869999999 podStartE2EDuration="1.567269787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:56.565226881 +0000 UTC m=+1832.525669582" watchObservedRunningTime="2026-07-06 19:35:56.567269787 +0000 UTC m=+1832.527712486"
Jul 06 19:35:56.780559 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:56.780519    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:57.785957 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:57.785923    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:58.541320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:58.541289    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:35:58.542297 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:35:58.542273    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:36:01.375073 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:01.375025    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:36:01.556235 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:01.556188    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" podUID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" containerName="istio-proxy" containerID="cri-o://c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0" gracePeriod=30
Jul 06 19:36:07.302819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.302794    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:36:07.424173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424074    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424131    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424173 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424157    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k98hl\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424185    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424235    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424293    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424333    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424369    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424396    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy\") pod \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\" (UID: \"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9\") "
Jul 06 19:36:07.424780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424489    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:07.424780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424526    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:07.424898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424784    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.424898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424809    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.424898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.424840    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:07.425480 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.425450    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:07.425582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.425502    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:07.426585 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.426553    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl" (OuterVolumeSpecName: "kube-api-access-k98hl") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "kube-api-access-k98hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:07.426710 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.426585    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:07.426710 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.426621    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:07.426710 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.426663    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" (UID: "eaa685cb-245a-45f8-a3af-e80f9ccf9cb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:36:07.526123 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526085    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k98hl\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-kube-api-access-k98hl\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526123 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526119    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526123 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526129    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526138    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526146    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526154    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.526420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.526161    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:36:07.592716 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.592684    2553 generic.go:356] "Generic (PLEG): container finished" podID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" containerID="c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0" exitCode=0
Jul 06 19:36:07.592891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.592729    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"
Jul 06 19:36:07.592891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.592746    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" event={"ID":"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9","Type":"ContainerDied","Data":"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"}
Jul 06 19:36:07.592891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.592793    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8" event={"ID":"eaa685cb-245a-45f8-a3af-e80f9ccf9cb9","Type":"ContainerDied","Data":"bf1d8912fc1dbc24f8788c73c09ef99ad55cce65c9b44a7c25b3ae25df831419"}
Jul 06 19:36:07.592891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.592816    2553 scope.go:117] "RemoveContainer" containerID="c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"
Jul 06 19:36:07.601335 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.601312    2553 scope.go:117] "RemoveContainer" containerID="c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"
Jul 06 19:36:07.601633 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:36:07.601613    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0\": container with ID starting with c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0 not found: ID does not exist" containerID="c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"
Jul 06 19:36:07.601684 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.601642    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0"} err="failed to get container status \"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0\": rpc error: code = NotFound desc = could not find container \"c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0\": container with ID starting with c4553e9aa8d3f8c87b60a1259cc00c4cb1975e1a08301d43cf41ce616031c1d0 not found: ID does not exist"
Jul 06 19:36:07.616271 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.616235    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:36:07.622145 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:07.622119    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b394aded-openshift-default-d9d9f89dc-2sgs8"]
Jul 06 19:36:09.542254 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:36:09.542219    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" path="/var/lib/kubelet/pods/eaa685cb-245a-45f8-a3af-e80f9ccf9cb9/volumes"
Jul 06 19:37:49.963742 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.963700    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964122    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964141    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964169    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" containerName="istio-proxy"
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964178    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" containerName="istio-proxy"
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964255    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="408bdf4a-4990-4232-aa0c-3b3d7347247a" containerName="istio-proxy"
Jul 06 19:37:49.964409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.964267    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa685cb-245a-45f8-a3af-e80f9ccf9cb9" containerName="istio-proxy"
Jul 06 19:37:49.967300 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.967278    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:49.970151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:49.970118    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-62b13cf2-openshift-default-dockercfg-5txl4\""
Jul 06 19:37:50.041750 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.041707    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:37:50.064412 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064378    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t5sw\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064467    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064582 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064555    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064612    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064629    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.064757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.064688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165270    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165327    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165391    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165412    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165435    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t5sw\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165467    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165496    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165518    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.165967 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165938    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.166129 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.165978    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.166129 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.166046    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.166287 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.166266    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.166360 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.166343    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.168248 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.168218    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.168363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.168346    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.178457 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.178426    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.178595 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.178564    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t5sw\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw\") pod \"e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") " pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.277028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.276896    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:50.424857 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.424824    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:37:50.426491 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:37:50.426461    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3c6faa_ca05_446c_90ae_d2abc9d63813.slice/crio-bb200ccb687d1b7491079329638deb25739917307e77f19982b8341de09cb255 WatchSource:0}: Error finding container bb200ccb687d1b7491079329638deb25739917307e77f19982b8341de09cb255: Status 404 returned error can't find the container with id bb200ccb687d1b7491079329638deb25739917307e77f19982b8341de09cb255
Jul 06 19:37:50.428601 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.428565    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:37:50.428686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.428633    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:37:50.428686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:50.428662    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:37:51.082208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:51.082164    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerStarted","Data":"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"}
Jul 06 19:37:51.082637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:51.082262    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerStarted","Data":"bb200ccb687d1b7491079329638deb25739917307e77f19982b8341de09cb255"}
Jul 06 19:37:51.111058 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:51.111007    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" podStartSLOduration=2.110977849 podStartE2EDuration="2.110977849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:51.109431155 +0000 UTC m=+1947.069873851" watchObservedRunningTime="2026-07-06 19:37:51.110977849 +0000 UTC m=+1947.071420536"
Jul 06 19:37:51.277500 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:51.277455    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:51.282224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:51.282191    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:52.087252 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:52.087220    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:52.088139 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:52.088119    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:37:53.190729 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.190692    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:37:53.194067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.194043    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.196416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.196391    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-62b13cf2-serving-cert\""
Jul 06 19:37:53.196724 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.196704    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:37:53.206519 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.206493    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:37:53.288522 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.288476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfh7\" (UniqueName: \"kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.288522 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.288526    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.288784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.288650    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.389210 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.389174    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfh7\" (UniqueName: \"kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.389427 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.389226    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.389427 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.389272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.389935 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.389906    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.391768 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.391749    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.399879 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.399853    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfh7\" (UniqueName: \"kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7\") pod \"maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") " pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.506200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.506107    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:53.647178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:53.647150    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:37:53.648913 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:37:53.648886    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d4c242_a62f_453a_9723_18a946c9dd88.slice/crio-1586af9f1d47cb52332277d7105df42db8922db482cfad7ac39ded6c4004c42c WatchSource:0}: Error finding container 1586af9f1d47cb52332277d7105df42db8922db482cfad7ac39ded6c4004c42c: Status 404 returned error can't find the container with id 1586af9f1d47cb52332277d7105df42db8922db482cfad7ac39ded6c4004c42c
Jul 06 19:37:54.097652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:54.097619    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" event={"ID":"f3d4c242-a62f-453a-9723-18a946c9dd88","Type":"ContainerStarted","Data":"1586af9f1d47cb52332277d7105df42db8922db482cfad7ac39ded6c4004c42c"}
Jul 06 19:37:55.103568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:55.103531    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" event={"ID":"f3d4c242-a62f-453a-9723-18a946c9dd88","Type":"ContainerStarted","Data":"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"}
Jul 06 19:37:55.104044 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:55.103598    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:37:55.126610 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:37:55.126549    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" podStartSLOduration=1.640734256 podStartE2EDuration="2.126533718s" totalImagesPullingTime="485.799462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:55.124863007 +0000 UTC m=+1951.085305705" watchObservedRunningTime="2026-07-06 19:37:55.126533718 +0000 UTC m=+1951.086976413"
Jul 06 19:38:01.113664 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:01.113632    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:38:06.338100 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.338061    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:38:06.338594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.338280    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" podUID="f3d4c242-a62f-453a-9723-18a946c9dd88" containerName="maas-api" containerID="cri-o://6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e" gracePeriod=30
Jul 06 19:38:06.603632 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.603560    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:38:06.720258 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.720213    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smfh7\" (UniqueName: \"kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7\") pod \"f3d4c242-a62f-453a-9723-18a946c9dd88\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") "
Jul 06 19:38:06.720454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.720291    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca\") pod \"f3d4c242-a62f-453a-9723-18a946c9dd88\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") "
Jul 06 19:38:06.720454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.720330    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls\") pod \"f3d4c242-a62f-453a-9723-18a946c9dd88\" (UID: \"f3d4c242-a62f-453a-9723-18a946c9dd88\") "
Jul 06 19:38:06.720719 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.720681    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3d4c242-a62f-453a-9723-18a946c9dd88" (UID: "f3d4c242-a62f-453a-9723-18a946c9dd88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:06.722549 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.722512    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3d4c242-a62f-453a-9723-18a946c9dd88" (UID: "f3d4c242-a62f-453a-9723-18a946c9dd88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:38:06.722654 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.722577    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7" (OuterVolumeSpecName: "kube-api-access-smfh7") pod "f3d4c242-a62f-453a-9723-18a946c9dd88" (UID: "f3d4c242-a62f-453a-9723-18a946c9dd88"). InnerVolumeSpecName "kube-api-access-smfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:06.821134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.821096    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smfh7\" (UniqueName: \"kubernetes.io/projected/f3d4c242-a62f-453a-9723-18a946c9dd88-kube-api-access-smfh7\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:06.821134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.821125    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d4c242-a62f-453a-9723-18a946c9dd88-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:06.821134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:06.821135    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d4c242-a62f-453a-9723-18a946c9dd88-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:07.160352 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.160316    2553 generic.go:356] "Generic (PLEG): container finished" podID="f3d4c242-a62f-453a-9723-18a946c9dd88" containerID="6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e" exitCode=0
Jul 06 19:38:07.160530 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.160378    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"
Jul 06 19:38:07.160530 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.160391    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" event={"ID":"f3d4c242-a62f-453a-9723-18a946c9dd88","Type":"ContainerDied","Data":"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"}
Jul 06 19:38:07.160530 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.160435    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5" event={"ID":"f3d4c242-a62f-453a-9723-18a946c9dd88","Type":"ContainerDied","Data":"1586af9f1d47cb52332277d7105df42db8922db482cfad7ac39ded6c4004c42c"}
Jul 06 19:38:07.160530 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.160456    2553 scope.go:117] "RemoveContainer" containerID="6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"
Jul 06 19:38:07.169018 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.168967    2553 scope.go:117] "RemoveContainer" containerID="6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"
Jul 06 19:38:07.169282 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:38:07.169261    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e\": container with ID starting with 6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e not found: ID does not exist" containerID="6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"
Jul 06 19:38:07.169348 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.169292    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e"} err="failed to get container status \"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e\": rpc error: code = NotFound desc = could not find container \"6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e\": container with ID starting with 6bb2bf24ca0630db27092815735203c5f7ba50a58c2c95f29d2430cb8266d66e not found: ID does not exist"
Jul 06 19:38:07.189749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.189709    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:38:07.195845 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.195816    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-62b13cf2-75678775bd-dbfg5"]
Jul 06 19:38:07.543152 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:07.543112    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d4c242-a62f-453a-9723-18a946c9dd88" path="/var/lib/kubelet/pods/f3d4c242-a62f-453a-9723-18a946c9dd88/volumes"
Jul 06 19:38:08.128195 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:08.128148    2553 patch_prober.go:28] interesting pod/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 19:38:08.128387 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:08.128223    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:38:09.173346 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.173304    2553 generic.go:356] "Generic (PLEG): container finished" podID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerID="d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02" exitCode=0
Jul 06 19:38:09.173814 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.173372    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerDied","Data":"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"}
Jul 06 19:38:09.173863 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.173840    2553 scope.go:117] "RemoveContainer" containerID="d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"
Jul 06 19:38:09.174868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.174835    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:09.174975 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.174924    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:09.175067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:09.174981    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:10.179467 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:10.179431    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerStarted","Data":"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"}
Jul 06 19:38:10.277577 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:10.277537    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:10.281444 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:10.281421    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:11.183868 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:11.183830    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:11.184978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:11.184952    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:13.123621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:13.123579    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:38:13.193589 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:13.193553    2553 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" secret="" err="secret \"e2e-mt-62b13cf2-openshift-default-dockercfg-5txl4\" not found"
Jul 06 19:38:14.198749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:14.198708    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy" containerID="cri-o://37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2" gracePeriod=30
Jul 06 19:38:19.454952 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.454925    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:19.536803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536699    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.536803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536745    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t5sw\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.536803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536764    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.536803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536803    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536821    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536844    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536866    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536892    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.536938    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data\") pod \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\" (UID: \"9d3c6faa-ca05-446c-90ae-d2abc9d63813\") "
Jul 06 19:38:19.537185 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.537155    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:19.537476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.537242    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.537476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.537254    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:19.537476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.537351    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:19.537476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.537403    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:19.538031 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.538009    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:19.539374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.539352    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:38:19.539505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.539481    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:19.539599 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.539585    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:19.539702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.539682    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw" (OuterVolumeSpecName: "kube-api-access-8t5sw") pod "9d3c6faa-ca05-446c-90ae-d2abc9d63813" (UID: "9d3c6faa-ca05-446c-90ae-d2abc9d63813"). InnerVolumeSpecName "kube-api-access-8t5sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:19.638151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638111    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638143    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t5sw\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-kube-api-access-8t5sw\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638153    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638162    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638170    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638178    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638185    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:19.638425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:19.638193    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d3c6faa-ca05-446c-90ae-d2abc9d63813-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:38:20.233674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.233641    2553 generic.go:356] "Generic (PLEG): container finished" podID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerID="37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2" exitCode=0
Jul 06 19:38:20.233921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.233694    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"
Jul 06 19:38:20.233921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.233722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerDied","Data":"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"}
Jul 06 19:38:20.233921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.233782    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72" event={"ID":"9d3c6faa-ca05-446c-90ae-d2abc9d63813","Type":"ContainerDied","Data":"bb200ccb687d1b7491079329638deb25739917307e77f19982b8341de09cb255"}
Jul 06 19:38:20.233921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.233799    2553 scope.go:117] "RemoveContainer" containerID="37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"
Jul 06 19:38:20.242177 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.242158    2553 scope.go:117] "RemoveContainer" containerID="d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"
Jul 06 19:38:20.250610 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.250590    2553 scope.go:117] "RemoveContainer" containerID="37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"
Jul 06 19:38:20.250895 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:38:20.250878    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2\": container with ID starting with 37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2 not found: ID does not exist" containerID="37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"
Jul 06 19:38:20.250934 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.250901    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2"} err="failed to get container status \"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2\": rpc error: code = NotFound desc = could not find container \"37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2\": container with ID starting with 37005c12bb5a13227c82740dec0bbff4b4b2a296cb0b28f7c3e8044fe46548d2 not found: ID does not exist"
Jul 06 19:38:20.250934 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.250918    2553 scope.go:117] "RemoveContainer" containerID="d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"
Jul 06 19:38:20.251166 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:38:20.251150    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02\": container with ID starting with d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02 not found: ID does not exist" containerID="d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"
Jul 06 19:38:20.251207 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.251171    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02"} err="failed to get container status \"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02\": rpc error: code = NotFound desc = could not find container \"d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02\": container with ID starting with d20533835dd738ce7be3f0018cfec2845f722c82624d1854eedb55ae50011f02 not found: ID does not exist"
Jul 06 19:38:20.256858 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.256833    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:38:20.262633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:20.262609    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-62b13cf2-openshift-default-6f79c86659-n2d72"]
Jul 06 19:38:21.541997 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:21.541963    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" path="/var/lib/kubelet/pods/9d3c6faa-ca05-446c-90ae-d2abc9d63813/volumes"
Jul 06 19:38:34.486180 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486141    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486447    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d4c242-a62f-453a-9723-18a946c9dd88" containerName="maas-api"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486460    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d4c242-a62f-453a-9723-18a946c9dd88" containerName="maas-api"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486483    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486490    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486499    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486506    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486554    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d4c242-a62f-453a-9723-18a946c9dd88" containerName="maas-api"
Jul 06 19:38:34.486564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486566    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.486856 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.486574    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3c6faa-ca05-446c-90ae-d2abc9d63813" containerName="istio-proxy"
Jul 06 19:38:34.489535 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.489513    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.492721 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.492697    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c133441a-openshift-default-dockercfg-tw5vh\""
Jul 06 19:38:34.501302 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.501274    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:38:34.555106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555062    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555106 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555115    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnxb6\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555172    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555232    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555282    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555304    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555337    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555356    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.555391 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.555379    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656501 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656458    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656707 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656707 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656649    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656707 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656689    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656724    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656755    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656793    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656834    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.656885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.656878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnxb6\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.657307 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.657207    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.657446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.657418    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.657578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.657445    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.657804 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.657755    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.657901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.657825    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.659656 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.659632    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.659824 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.659806    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.667388 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.667367    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.667509 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.667466    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnxb6\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6\") pod \"e2e-mt-c133441a-openshift-default-7678fd995f-kz8db\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") " pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.801205 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.801109    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:34.984473 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.984420    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:38:34.987258 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:38:34.987225    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0bc71e_ee28_451b_a263_25fdd479764b.slice/crio-95dd835bad78358b8411a2803d3f45b6fffd2b9118dfd0f5230945d845c6eb14 WatchSource:0}: Error finding container 95dd835bad78358b8411a2803d3f45b6fffd2b9118dfd0f5230945d845c6eb14: Status 404 returned error can't find the container with id 95dd835bad78358b8411a2803d3f45b6fffd2b9118dfd0f5230945d845c6eb14
Jul 06 19:38:34.989918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.989877    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:34.990030 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.989977    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:34.990089 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:34.990041    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:35.304319 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:35.304280    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerStarted","Data":"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"}
Jul 06 19:38:35.304536 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:35.304331    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerStarted","Data":"95dd835bad78358b8411a2803d3f45b6fffd2b9118dfd0f5230945d845c6eb14"}
Jul 06 19:38:35.334129 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:35.334054    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podStartSLOduration=1.334029393 podStartE2EDuration="1.334029393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:35.327274035 +0000 UTC m=+1991.287716834" watchObservedRunningTime="2026-07-06 19:38:35.334029393 +0000 UTC m=+1991.294472093"
Jul 06 19:38:35.802202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:35.802162    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:36.807094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:36.807063    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:37.314108 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.314073    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:37.315025 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.315006    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:37.439660 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.439623    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:38:37.443077 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.443047    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.445922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.445894    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:38:37.446096 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.446054    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-c133441a-serving-cert\""
Jul 06 19:38:37.458146 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.458121    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:38:37.482416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.482381    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.482416 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.482413    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwsm6\" (UniqueName: \"kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.482629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.482444    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.583200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.583104    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.583200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.583145    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwsm6\" (UniqueName: \"kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.583200 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.583187    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.583889 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.583868    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.585629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.585597    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.595468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.595440    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwsm6\" (UniqueName: \"kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6\") pod \"maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") " pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.753777 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.753735    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:37.891228 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:37.891195    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:38:37.892739 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:38:37.892714    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d40ffb_8c65_4304_b181_185f49ca2bfe.slice/crio-d03a3bbac0e6cad4c39a344c7a66eaf40a2d70c3836ee1e6e506936512425d4a WatchSource:0}: Error finding container d03a3bbac0e6cad4c39a344c7a66eaf40a2d70c3836ee1e6e506936512425d4a: Status 404 returned error can't find the container with id d03a3bbac0e6cad4c39a344c7a66eaf40a2d70c3836ee1e6e506936512425d4a
Jul 06 19:38:38.320203 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:38.320166    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" event={"ID":"58d40ffb-8c65-4304-b181-185f49ca2bfe","Type":"ContainerStarted","Data":"d03a3bbac0e6cad4c39a344c7a66eaf40a2d70c3836ee1e6e506936512425d4a"}
Jul 06 19:38:39.325945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:39.325907    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" event={"ID":"58d40ffb-8c65-4304-b181-185f49ca2bfe","Type":"ContainerStarted","Data":"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"}
Jul 06 19:38:39.326363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:39.326142    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:39.349202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:39.349142    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" podStartSLOduration=1.8175487380000002 podStartE2EDuration="2.349125561s" totalImagesPullingTime="531.576823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:39.348585094 +0000 UTC m=+1995.309027792" watchObservedRunningTime="2026-07-06 19:38:39.349125561 +0000 UTC m=+1995.309568248"
Jul 06 19:38:45.336081 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:45.336050    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:38:49.585663 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.585616    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:38:49.590727 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.590700    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.594817 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.594785    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c133441a\"/\"kube-root-ca.crt\""
Jul 06 19:38:49.595020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.594847    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c133441a\"/\"default-dockercfg-p7g7j\""
Jul 06 19:38:49.595020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.594862    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c133441a\"/\"e2e-lifecycle-model-c133441a-kserve-self-signed-certs\""
Jul 06 19:38:49.595020 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.594909    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c133441a\"/\"openshift-service-ca.crt\""
Jul 06 19:38:49.601581 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.601548    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:38:49.689418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689381    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.689619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.689619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.689619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.689619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689594    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.689780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.689644    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdsg\" (UniqueName: \"kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.790779 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790832    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790849    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790876    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.790902    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdsg\" (UniqueName: \"kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791407 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.791365    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791407 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.791406    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.791600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.791522    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.793128 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.793102    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.793598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.793572    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.802618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.802587    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdsg\" (UniqueName: \"kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg\") pod \"e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") " pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:49.901594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:49.901492    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:50.050437 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:50.050407    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:38:50.051862 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:38:50.051835    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90584c8c_305e_4656_b967_03bf855a4257.slice/crio-5b69825c923cd4cf38ba58b5ab0cd4edf8b4e980899aa9f54deeaead96e2ef75 WatchSource:0}: Error finding container 5b69825c923cd4cf38ba58b5ab0cd4edf8b4e980899aa9f54deeaead96e2ef75: Status 404 returned error can't find the container with id 5b69825c923cd4cf38ba58b5ab0cd4edf8b4e980899aa9f54deeaead96e2ef75
Jul 06 19:38:50.388811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:50.388765    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" event={"ID":"90584c8c-305e-4656-b967-03bf855a4257","Type":"ContainerStarted","Data":"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"}
Jul 06 19:38:50.389060 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:50.388823    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" event={"ID":"90584c8c-305e-4656-b967-03bf855a4257","Type":"ContainerStarted","Data":"5b69825c923cd4cf38ba58b5ab0cd4edf8b4e980899aa9f54deeaead96e2ef75"}
Jul 06 19:38:50.409914 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:50.409849    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" podStartSLOduration=1.409830726 podStartE2EDuration="1.409830726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:50.409551116 +0000 UTC m=+2006.369993812" watchObservedRunningTime="2026-07-06 19:38:50.409830726 +0000 UTC m=+2006.370273421"
Jul 06 19:38:52.315897 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.315855    2553 patch_prober.go:28] interesting pod/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 06 19:38:52.316377 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.315914    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 06 19:38:52.400343 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.400309    2553 generic.go:356] "Generic (PLEG): container finished" podID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerID="b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9" exitCode=0
Jul 06 19:38:52.400505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.400354    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerDied","Data":"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"}
Jul 06 19:38:52.400762 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.400747    2553 scope.go:117] "RemoveContainer" containerID="b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"
Jul 06 19:38:52.401696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.401665    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:52.401756 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.401734    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:52.401799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:52.401766    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:38:53.407130 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:53.407096    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerStarted","Data":"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"}
Jul 06 19:38:53.801961 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:53.801917    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:53.802191 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:53.802168    2553 patch_prober.go:28] interesting pod/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 06 19:38:53.802240 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:53.802216    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 06 19:38:54.801869 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:54.801829    2553 patch_prober.go:28] interesting pod/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 06 19:38:54.802399 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:54.801894    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 06 19:38:55.802406 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:55.802368    2553 patch_prober.go:28] interesting pod/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 06 19:38:55.802839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:55.802425    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 06 19:38:56.801831 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:56.801789    2553 patch_prober.go:28] interesting pod/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 06 19:38:56.802092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:56.801853    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 06 19:38:57.806191 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:57.806159    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:57.806672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:57.806558    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:57.807172 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:57.807155    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:38:59.902047 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:59.902006    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:59.902498 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:59.902065    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:38:59.914365 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:38:59.914340    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:39:00.451512 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:00.451478    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:39:19.649738 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.649698    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:39:19.650208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.649998    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" podUID="58d40ffb-8c65-4304-b181-185f49ca2bfe" containerName="maas-api" containerID="cri-o://92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28" gracePeriod=30
Jul 06 19:39:19.897383 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.897357    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:39:19.951432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.951395    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwsm6\" (UniqueName: \"kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6\") pod \"58d40ffb-8c65-4304-b181-185f49ca2bfe\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") "
Jul 06 19:39:19.951608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.951449    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls\") pod \"58d40ffb-8c65-4304-b181-185f49ca2bfe\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") "
Jul 06 19:39:19.951608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.951471    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca\") pod \"58d40ffb-8c65-4304-b181-185f49ca2bfe\" (UID: \"58d40ffb-8c65-4304-b181-185f49ca2bfe\") "
Jul 06 19:39:19.951893 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.951867    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58d40ffb-8c65-4304-b181-185f49ca2bfe" (UID: "58d40ffb-8c65-4304-b181-185f49ca2bfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:39:19.953643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.953616    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58d40ffb-8c65-4304-b181-185f49ca2bfe" (UID: "58d40ffb-8c65-4304-b181-185f49ca2bfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:39:19.953643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:19.953617    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6" (OuterVolumeSpecName: "kube-api-access-mwsm6") pod "58d40ffb-8c65-4304-b181-185f49ca2bfe" (UID: "58d40ffb-8c65-4304-b181-185f49ca2bfe"). InnerVolumeSpecName "kube-api-access-mwsm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:20.052150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.052105    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwsm6\" (UniqueName: \"kubernetes.io/projected/58d40ffb-8c65-4304-b181-185f49ca2bfe-kube-api-access-mwsm6\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:20.052150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.052141    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58d40ffb-8c65-4304-b181-185f49ca2bfe-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:20.052150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.052153    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58d40ffb-8c65-4304-b181-185f49ca2bfe-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:20.537598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.537565    2553 generic.go:356] "Generic (PLEG): container finished" podID="58d40ffb-8c65-4304-b181-185f49ca2bfe" containerID="92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28" exitCode=0
Jul 06 19:39:20.537598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.537605    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"
Jul 06 19:39:20.537886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.537642    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" event={"ID":"58d40ffb-8c65-4304-b181-185f49ca2bfe","Type":"ContainerDied","Data":"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"}
Jul 06 19:39:20.537886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.537697    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2" event={"ID":"58d40ffb-8c65-4304-b181-185f49ca2bfe","Type":"ContainerDied","Data":"d03a3bbac0e6cad4c39a344c7a66eaf40a2d70c3836ee1e6e506936512425d4a"}
Jul 06 19:39:20.537886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.537720    2553 scope.go:117] "RemoveContainer" containerID="92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"
Jul 06 19:39:20.547802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.547671    2553 scope.go:117] "RemoveContainer" containerID="92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"
Jul 06 19:39:20.548142 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:39:20.548101    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28\": container with ID starting with 92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28 not found: ID does not exist" containerID="92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"
Jul 06 19:39:20.548255 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.548145    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28"} err="failed to get container status \"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28\": rpc error: code = NotFound desc = could not find container \"92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28\": container with ID starting with 92c0c17180de845f1608141cf38dd4352fd72e491f09748ba51f2c9060665f28 not found: ID does not exist"
Jul 06 19:39:20.565700 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.565669    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:39:20.572373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:20.572344    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-c133441a-6f66fd6865-2gcr2"]
Jul 06 19:39:21.541702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:21.541661    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d40ffb-8c65-4304-b181-185f49ca2bfe" path="/var/lib/kubelet/pods/58d40ffb-8c65-4304-b181-185f49ca2bfe/volumes"
Jul 06 19:39:30.348799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:30.348750    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:39:45.369229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.369169    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" podUID="90584c8c-305e-4656-b967-03bf855a4257" containerName="main" containerID="cri-o://67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126" gracePeriod=45
Jul 06 19:39:45.618646 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.618619    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:39:45.640502 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640366    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhdsg\" (UniqueName: \"kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.640502 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640419    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.640502 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640487    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.641224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640541    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.641224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640589    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.641224 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.640624    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home\") pod \"90584c8c-305e-4656-b967-03bf855a4257\" (UID: \"90584c8c-305e-4656-b967-03bf855a4257\") "
Jul 06 19:39:45.641621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.641593    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home" (OuterVolumeSpecName: "home") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:45.641810 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.641648    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache" (OuterVolumeSpecName: "model-cache") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:45.641946 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.641755    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:45.643402 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.643372    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg" (OuterVolumeSpecName: "kube-api-access-dhdsg") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "kube-api-access-dhdsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:45.643713 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.643678    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm" (OuterVolumeSpecName: "dshm") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:45.643791 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.643764    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90584c8c-305e-4656-b967-03bf855a4257" (UID: "90584c8c-305e-4656-b967-03bf855a4257"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:39:45.659682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.659647    2553 generic.go:356] "Generic (PLEG): container finished" podID="90584c8c-305e-4656-b967-03bf855a4257" containerID="67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126" exitCode=0
Jul 06 19:39:45.659860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.659690    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"
Jul 06 19:39:45.659860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.659719    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" event={"ID":"90584c8c-305e-4656-b967-03bf855a4257","Type":"ContainerDied","Data":"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"}
Jul 06 19:39:45.659860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.659765    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk" event={"ID":"90584c8c-305e-4656-b967-03bf855a4257","Type":"ContainerDied","Data":"5b69825c923cd4cf38ba58b5ab0cd4edf8b4e980899aa9f54deeaead96e2ef75"}
Jul 06 19:39:45.659860 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.659783    2553 scope.go:117] "RemoveContainer" containerID="67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"
Jul 06 19:39:45.671067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.671044    2553 scope.go:117] "RemoveContainer" containerID="67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"
Jul 06 19:39:45.671411 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:39:45.671388    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126\": container with ID starting with 67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126 not found: ID does not exist" containerID="67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"
Jul 06 19:39:45.671461 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.671422    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126"} err="failed to get container status \"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126\": rpc error: code = NotFound desc = could not find container \"67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126\": container with ID starting with 67f453f3a5b314348facdb7b557c5c91f71cdd35ef7dd4bbf88e20d764177126 not found: ID does not exist"
Jul 06 19:39:45.685528 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.685489    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:39:45.693174 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.693145    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c133441a/e2e-lifecycle-model-c133441a-kserve-776f9c8ff5-jdqfk"]
Jul 06 19:39:45.742261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742222    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-model-cache\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:45.742261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742255    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-home\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:45.742261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742264    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhdsg\" (UniqueName: \"kubernetes.io/projected/90584c8c-305e-4656-b967-03bf855a4257-kube-api-access-dhdsg\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:45.742544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742274    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-tmp-dir\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:45.742544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742286    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90584c8c-305e-4656-b967-03bf855a4257-dshm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:45.742544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:45.742293    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90584c8c-305e-4656-b967-03bf855a4257-tls-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:39:47.541727 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:39:47.541647    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90584c8c-305e-4656-b967-03bf855a4257" path="/var/lib/kubelet/pods/90584c8c-305e-4656-b967-03bf855a4257/volumes"
Jul 06 19:40:14.342162 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:14.342121    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:40:14.342714 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:14.342386    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy" containerID="cri-o://0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4" gracePeriod=30
Jul 06 19:40:19.596213 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.596179    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:40:19.722835 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.722791    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.722835 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.722832    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.722866    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnxb6\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.722883    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.722924    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723082    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723126    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723196    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723233    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy\") pod \"ed0bc71e-ee28-451b-a263-25fdd479764b\" (UID: \"ed0bc71e-ee28-451b-a263-25fdd479764b\") "
Jul 06 19:40:19.723477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723274    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:19.723477 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723293    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:19.723685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723483    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.723685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723504    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.723685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723511    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:19.723685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.723631    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:40:19.724188 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.724164    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:19.725724 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.725696    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:40:19.725847 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.725751    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6" (OuterVolumeSpecName: "kube-api-access-rnxb6") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "kube-api-access-rnxb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:40:19.725912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.725861    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:19.725912 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.725862    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed0bc71e-ee28-451b-a263-25fdd479764b" (UID: "ed0bc71e-ee28-451b-a263-25fdd479764b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:40:19.817192 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.817154    2553 generic.go:356] "Generic (PLEG): container finished" podID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerID="0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4" exitCode=0
Jul 06 19:40:19.817366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.817209    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"
Jul 06 19:40:19.817366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.817230    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerDied","Data":"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"}
Jul 06 19:40:19.817366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.817290    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db" event={"ID":"ed0bc71e-ee28-451b-a263-25fdd479764b","Type":"ContainerDied","Data":"95dd835bad78358b8411a2803d3f45b6fffd2b9118dfd0f5230945d845c6eb14"}
Jul 06 19:40:19.817366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.817313    2553 scope.go:117] "RemoveContainer" containerID="0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"
Jul 06 19:40:19.824206 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824182    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824206 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824203    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824213    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed0bc71e-ee28-451b-a263-25fdd479764b-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824221    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnxb6\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-kube-api-access-rnxb6\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824230    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824238    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed0bc71e-ee28-451b-a263-25fdd479764b-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.824400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.824246    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed0bc71e-ee28-451b-a263-25fdd479764b-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:40:19.827187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.827169    2553 scope.go:117] "RemoveContainer" containerID="b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"
Jul 06 19:40:19.835345 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.835326    2553 scope.go:117] "RemoveContainer" containerID="0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"
Jul 06 19:40:19.835618 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:40:19.835597    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4\": container with ID starting with 0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4 not found: ID does not exist" containerID="0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"
Jul 06 19:40:19.835690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.835631    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4"} err="failed to get container status \"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4\": rpc error: code = NotFound desc = could not find container \"0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4\": container with ID starting with 0dcd5c74e36e12a106b1107408bc99e7f7b4ffd9ae70512e1afd6e32557eadf4 not found: ID does not exist"
Jul 06 19:40:19.835690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.835661    2553 scope.go:117] "RemoveContainer" containerID="b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"
Jul 06 19:40:19.835894 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:40:19.835876    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9\": container with ID starting with b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9 not found: ID does not exist" containerID="b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"
Jul 06 19:40:19.835945 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.835901    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9"} err="failed to get container status \"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9\": rpc error: code = NotFound desc = could not find container \"b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9\": container with ID starting with b4315e4b6710b1067baf5939abaf58401f3e591a95616e59bf61dd746b61dac9 not found: ID does not exist"
Jul 06 19:40:19.843223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.843193    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:40:19.851074 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:19.851043    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c133441a-openshift-default-7678fd995f-kz8db"]
Jul 06 19:40:21.542601 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:40:21.542557    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" path="/var/lib/kubelet/pods/ed0bc71e-ee28-451b-a263-25fdd479764b/volumes"
Jul 06 19:41:13.541625 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541595    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541858    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541868    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541882    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90584c8c-305e-4656-b967-03bf855a4257" containerName="main"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541888    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="90584c8c-305e-4656-b967-03bf855a4257" containerName="main"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541898    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d40ffb-8c65-4304-b181-185f49ca2bfe" containerName="maas-api"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541904    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d40ffb-8c65-4304-b181-185f49ca2bfe" containerName="maas-api"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541952    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="90584c8c-305e-4656-b967-03bf855a4257" containerName="main"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541958    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541965    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d40ffb-8c65-4304-b181-185f49ca2bfe" containerName="maas-api"
Jul 06 19:41:13.542121 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.541972    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:13.544900 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.544883    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.547664 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.547644    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c985ce-openshift-default-dockercfg-592rq\""
Jul 06 19:41:13.559921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.559888    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:41:13.655877 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.655832    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.655877 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.655879    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656156 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656133    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656215 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656170    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656215 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656188    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656317 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656261    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6pq\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656317 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656305    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656383 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.656434 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.656408    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.756911 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.756882    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.756924    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.756939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.756968    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757020    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757066    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6pq\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757445 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757245    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757445 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757301    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757445 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757368    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757609 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757453    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.757609 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.757584    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.758053 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.758025    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.758277 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.758262    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.759315 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.759293    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.760019 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.759974    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.773898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.773871    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.774069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.774048    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6pq\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq\") pod \"e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") " pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:13.855067 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:13.854968    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:14.006661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:14.006634    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:41:14.008394 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:41:14.008367    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cf5938_0207_441a_a90c_1fae6ec576df.slice/crio-10f3022807550cd3df749275711d3c4ba1b49bf60d7372b3936da53a9a1a8148 WatchSource:0}: Error finding container 10f3022807550cd3df749275711d3c4ba1b49bf60d7372b3936da53a9a1a8148: Status 404 returned error can't find the container with id 10f3022807550cd3df749275711d3c4ba1b49bf60d7372b3936da53a9a1a8148
Jul 06 19:41:14.010404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:14.010370    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:14.010465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:14.010436    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:14.010509 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:14.010466    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:14.059230 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:14.059200    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerStarted","Data":"10f3022807550cd3df749275711d3c4ba1b49bf60d7372b3936da53a9a1a8148"}
Jul 06 19:41:15.066140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:15.066099    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerStarted","Data":"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"}
Jul 06 19:41:15.093786 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:15.093735    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podStartSLOduration=2.093717657 podStartE2EDuration="2.093717657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:15.092391751 +0000 UTC m=+2151.052834447" watchObservedRunningTime="2026-07-06 19:41:15.093717657 +0000 UTC m=+2151.054160353"
Jul 06 19:41:15.855290 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:15.855242    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:15.860290 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:15.860265    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:16.070756 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:16.070722    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:16.071739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:16.071715    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:17.317646 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.317613    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:41:17.318026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.317898    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:17.318026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.317908    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0bc71e-ee28-451b-a263-25fdd479764b" containerName="istio-proxy"
Jul 06 19:41:17.320867 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.320846    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.326414 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.326392    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:41:17.326764 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.326748    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-c985ce-serving-cert\""
Jul 06 19:41:17.337094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.337060    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:41:17.489643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.489592    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.489643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.489637    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.489894 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.489738    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdhrh\" (UniqueName: \"kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.590757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.590651    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.590757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.590696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.591021 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.590769    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdhrh\" (UniqueName: \"kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.591475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.591453    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.593148 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.593129    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.601055 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.601028    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdhrh\" (UniqueName: \"kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh\") pod \"maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") " pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.631788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.631758    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:17.773150 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.773119    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:41:17.774592 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:41:17.774559    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ddfbc1_e99d_487b_a3ef_1b102048d571.slice/crio-882d0d75a08d2b240af4bda43e905c752e52119c28924957b913c227cff7e0c8 WatchSource:0}: Error finding container 882d0d75a08d2b240af4bda43e905c752e52119c28924957b913c227cff7e0c8: Status 404 returned error can't find the container with id 882d0d75a08d2b240af4bda43e905c752e52119c28924957b913c227cff7e0c8
Jul 06 19:41:17.775978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:17.775956    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:41:18.082652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:18.082620    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" event={"ID":"c9ddfbc1-e99d-487b-a3ef-1b102048d571","Type":"ContainerStarted","Data":"882d0d75a08d2b240af4bda43e905c752e52119c28924957b913c227cff7e0c8"}
Jul 06 19:41:19.088767 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:19.088727    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" event={"ID":"c9ddfbc1-e99d-487b-a3ef-1b102048d571","Type":"ContainerStarted","Data":"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"}
Jul 06 19:41:19.089194 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:19.088794    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:19.109673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:19.109613    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" podStartSLOduration=1.5504611879999999 podStartE2EDuration="2.10959787s" totalImagesPullingTime="559.136682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:19.108407916 +0000 UTC m=+2155.068850614" watchObservedRunningTime="2026-07-06 19:41:19.10959787 +0000 UTC m=+2155.070040565"
Jul 06 19:41:22.206696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.206658    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:41:22.210140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.210121    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.215407 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.215386    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-167b10-openshift-default-dockercfg-nkm7m\""
Jul 06 19:41:22.223474 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.223446    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:41:22.335959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.335923    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.335959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.335961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7bgm\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336054    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336122    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336156    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336259    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336280    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.336318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.336304    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437333    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437556 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437385    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437556 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437503    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437556 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437551    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437580    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437628    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437660    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7bgm\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.437795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.438070 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.437861    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.438243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.438212    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.438379 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.438257    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.438379 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.438281    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.438379 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.438353    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.439881 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.439860    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.440308 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.440290    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.449513 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.449485    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.449739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.449720    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7bgm\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm\") pod \"e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") " pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.520840 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.520749    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:22.661372 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.661347    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:41:22.663218 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:41:22.663188    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a59b51_3192_447c_b6ab_6ccff58919f1.slice/crio-581f61a5b087ad5c7172ab1cbf314a8b4c43287ab7cf4ffa188e7949d2debe46 WatchSource:0}: Error finding container 581f61a5b087ad5c7172ab1cbf314a8b4c43287ab7cf4ffa188e7949d2debe46: Status 404 returned error can't find the container with id 581f61a5b087ad5c7172ab1cbf314a8b4c43287ab7cf4ffa188e7949d2debe46
Jul 06 19:41:22.665334 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.665300    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:22.665404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.665373    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:22.665450 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:22.665403    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:23.109727 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:23.109689    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerStarted","Data":"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"}
Jul 06 19:41:23.109894 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:23.109744    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerStarted","Data":"581f61a5b087ad5c7172ab1cbf314a8b4c43287ab7cf4ffa188e7949d2debe46"}
Jul 06 19:41:23.136280 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:23.136231    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podStartSLOduration=1.136214189 podStartE2EDuration="1.136214189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:23.134114379 +0000 UTC m=+2159.094557075" watchObservedRunningTime="2026-07-06 19:41:23.136214189 +0000 UTC m=+2159.096656884"
Jul 06 19:41:23.521068 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:23.521025    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:23.526008 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:23.525962    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:24.115085 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:24.115054    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:24.116182 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:24.116160    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:25.100865 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.100837    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:41:25.269014 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.267154    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:41:25.272952 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.272920    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.278748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.278451    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-167b10-serving-cert\""
Jul 06 19:41:25.280397 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.279361    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:41:25.368079 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.366525    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.368079 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.366599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.368079 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.366676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6psqr\" (UniqueName: \"kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.467823 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.467769    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6psqr\" (UniqueName: \"kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.468071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.467904    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.468071 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.467941    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.468879 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.468848    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.470685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.470651    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-167b10-serving-cert\""
Jul 06 19:41:25.478566 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.478528    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6psqr\" (UniqueName: \"kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.480637 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.480614    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls\") pod \"maas-api-e2e-inf-b-167b10-5997b475f9-z4wln\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") " pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.592463 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.592423    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:25.779685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:25.779566    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:41:26.128130 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:26.128099    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" event={"ID":"edc4b2bd-c313-4802-a6bd-358fb2ca0b02","Type":"ContainerStarted","Data":"d7cdb37923533c2a2205bdd0a6255b329d86be4e187eb299cec66f02399ce754"}
Jul 06 19:41:27.135156 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:27.135120    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" event={"ID":"edc4b2bd-c313-4802-a6bd-358fb2ca0b02","Type":"ContainerStarted","Data":"c22f77ad187da2049a532b458511fb5c0e86ef6aaa0d46c2001334c9be06fecd"}
Jul 06 19:41:27.135650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:27.135242    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:27.160231 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:27.160159    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" podStartSLOduration=1.819661962 podStartE2EDuration="2.160136633s" totalImagesPullingTime="340.474671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:27.15842202 +0000 UTC m=+2163.118864716" watchObservedRunningTime="2026-07-06 19:41:27.160136633 +0000 UTC m=+2163.120579329"
Jul 06 19:41:32.113218 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:32.113177    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 19:41:32.116208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:32.113285    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:33.144440 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.144398    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:41:33.186134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.186097    2553 generic.go:356] "Generic (PLEG): container finished" podID="54cf5938-0207-441a-a90c-1fae6ec576df" containerID="6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de" exitCode=0
Jul 06 19:41:33.186303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.186161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerDied","Data":"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"}
Jul 06 19:41:33.186564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.186543    2553 scope.go:117] "RemoveContainer" containerID="6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"
Jul 06 19:41:33.187624 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.187596    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:33.187711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.187666    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:33.187711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:33.187699    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:34.197409 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:34.196404    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerStarted","Data":"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"}
Jul 06 19:41:34.855742 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:34.855709    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:34.856372 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:34.856278    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 19:41:34.856561 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:34.856539    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 19:41:35.866563 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:35.866462    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 19:41:35.866563 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:35.866534    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 19:41:36.856232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:36.856182    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 19:41:36.856450 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:36.856261    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 19:41:37.855614 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:37.855573    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 06 19:41:37.856231 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:37.856196    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 06 19:41:38.858707 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:38.858676    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:38.859227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:38.859112    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:38.859695 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:38.859677    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:41:39.116839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.116710    2553 patch_prober.go:28] interesting pod/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 19:41:39.116839 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.116792    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 19:41:39.229805 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.229772    2553 generic.go:356] "Generic (PLEG): container finished" podID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerID="70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5" exitCode=0
Jul 06 19:41:39.230015 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.229851    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerDied","Data":"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"}
Jul 06 19:41:39.230388 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.230372    2553 scope.go:117] "RemoveContainer" containerID="70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"
Jul 06 19:41:39.231509 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.231479    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:39.231622 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.231549    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:39.231622 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:39.231614    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:41:40.238635 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:40.238603    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerStarted","Data":"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"}
Jul 06 19:41:40.521414 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:40.521319    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:40.521611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:40.521584    2553 patch_prober.go:28] interesting pod/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 19:41:40.521700 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:40.521645    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 19:41:41.521612 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:41.521568    2553 patch_prober.go:28] interesting pod/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 19:41:41.522042 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:41.521634    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 19:41:42.521962 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:42.521923    2553 patch_prober.go:28] interesting pod/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 19:41:42.522404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:42.522014    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 19:41:43.521228 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:43.521189    2553 patch_prober.go:28] interesting pod/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 06 19:41:43.521412 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:43.521245    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 06 19:41:44.525930 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:44.525898    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:44.526357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:44.526264    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:41:44.526881 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:41:44.526858    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:42:16.327485 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.327446    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:16.330854 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.330834    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.335223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.335199    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-167b10\"/\"default-dockercfg-6kvmn\""
Jul 06 19:42:16.335747 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.335726    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-167b10\"/\"openshift-service-ca.crt\""
Jul 06 19:42:16.336564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.336546    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-167b10\"/\"kube-root-ca.crt\""
Jul 06 19:42:16.336667 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.336562    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-167b10\"/\"test-model-167b10-kserve-self-signed-certs\""
Jul 06 19:42:16.348253 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.348225    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:16.421420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421386    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.421420 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.421650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421458    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcfj\" (UniqueName: \"kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.421650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421509    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.421650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421541    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.421650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.421556    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.522954    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523022    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523090    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523156    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcfj\" (UniqueName: \"kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523211    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523531 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523466    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523531 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523517    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.523621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.523605    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.525399 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.525378    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.525686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.525668    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.535236 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.535205    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcfj\" (UniqueName: \"kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj\") pod \"test-model-167b10-kserve-5b4fcf6659-ll92w\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") " pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.639621 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.639531    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:16.787112 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:16.787082    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:16.790704 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:42:16.790679    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod254c01bb_a927_4498_9fa2_07cceee97df2.slice/crio-8ed1b3c6b6d8dec297331f7044e8f2f8c1d95841f9500b4335d80b72e996fbf0 WatchSource:0}: Error finding container 8ed1b3c6b6d8dec297331f7044e8f2f8c1d95841f9500b4335d80b72e996fbf0: Status 404 returned error can't find the container with id 8ed1b3c6b6d8dec297331f7044e8f2f8c1d95841f9500b4335d80b72e996fbf0
Jul 06 19:42:17.418819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:17.418780    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" event={"ID":"254c01bb-a927-4498-9fa2-07cceee97df2","Type":"ContainerStarted","Data":"278daaeeed121c8c5712a061e380d0c2e1c31258dc4ea1b45072552b1e2c98ef"}
Jul 06 19:42:17.418819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:17.418827    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" event={"ID":"254c01bb-a927-4498-9fa2-07cceee97df2","Type":"ContainerStarted","Data":"8ed1b3c6b6d8dec297331f7044e8f2f8c1d95841f9500b4335d80b72e996fbf0"}
Jul 06 19:42:17.455059 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:17.454982    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" podStartSLOduration=1.454965436 podStartE2EDuration="1.454965436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:17.453980721 +0000 UTC m=+2213.414423418" watchObservedRunningTime="2026-07-06 19:42:17.454965436 +0000 UTC m=+2213.415408132"
Jul 06 19:42:26.640056 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:26.640010    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:26.640479 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:26.640077    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:26.652614 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:26.652585    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:27.480006 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:27.479961    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:39.462811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:39.462773    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:40.440612 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.440575    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:42:40.440841 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.440814    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" podUID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" containerName="maas-api" containerID="cri-o://d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226" gracePeriod=30
Jul 06 19:42:40.688652 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.688623    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:42:40.742970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.742885    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls\") pod \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") "
Jul 06 19:42:40.742970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.742966    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdhrh\" (UniqueName: \"kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh\") pod \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") "
Jul 06 19:42:40.743182 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.742999    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca\") pod \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\" (UID: \"c9ddfbc1-e99d-487b-a3ef-1b102048d571\") "
Jul 06 19:42:40.743510 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.743472    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9ddfbc1-e99d-487b-a3ef-1b102048d571" (UID: "c9ddfbc1-e99d-487b-a3ef-1b102048d571"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:42:40.745140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.745110    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9ddfbc1-e99d-487b-a3ef-1b102048d571" (UID: "c9ddfbc1-e99d-487b-a3ef-1b102048d571"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:42:40.745140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.745117    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh" (OuterVolumeSpecName: "kube-api-access-zdhrh") pod "c9ddfbc1-e99d-487b-a3ef-1b102048d571" (UID: "c9ddfbc1-e99d-487b-a3ef-1b102048d571"). InnerVolumeSpecName "kube-api-access-zdhrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:42:40.843578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.843535    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdhrh\" (UniqueName: \"kubernetes.io/projected/c9ddfbc1-e99d-487b-a3ef-1b102048d571-kube-api-access-zdhrh\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:40.843578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.843570    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ddfbc1-e99d-487b-a3ef-1b102048d571-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:40.843578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:40.843585    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9ddfbc1-e99d-487b-a3ef-1b102048d571-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:41.539054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.539022    2553 generic.go:356] "Generic (PLEG): container finished" podID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" containerID="d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226" exitCode=0
Jul 06 19:42:41.539241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.539164    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"
Jul 06 19:42:41.542516 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.542489    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" event={"ID":"c9ddfbc1-e99d-487b-a3ef-1b102048d571","Type":"ContainerDied","Data":"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"}
Jul 06 19:42:41.542657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.542534    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd" event={"ID":"c9ddfbc1-e99d-487b-a3ef-1b102048d571","Type":"ContainerDied","Data":"882d0d75a08d2b240af4bda43e905c752e52119c28924957b913c227cff7e0c8"}
Jul 06 19:42:41.542657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.542556    2553 scope.go:117] "RemoveContainer" containerID="d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"
Jul 06 19:42:41.551661 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.551640    2553 scope.go:117] "RemoveContainer" containerID="d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"
Jul 06 19:42:41.551912 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:42:41.551891    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226\": container with ID starting with d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226 not found: ID does not exist" containerID="d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"
Jul 06 19:42:41.551972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.551925    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226"} err="failed to get container status \"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226\": rpc error: code = NotFound desc = could not find container \"d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226\": container with ID starting with d75c9dd163d3187f7801d2efdc6a72698d2b9950e3d383091b9ee862995e1226 not found: ID does not exist"
Jul 06 19:42:41.567822 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.567796    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:42:41.573604 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:41.573580    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c985ce-7c4bbb5df4-ns7qd"]
Jul 06 19:42:43.542169 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:43.542126    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" path="/var/lib/kubelet/pods/c9ddfbc1-e99d-487b-a3ef-1b102048d571/volumes"
Jul 06 19:42:54.485610 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.485568    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" podUID="254c01bb-a927-4498-9fa2-07cceee97df2" containerName="main" containerID="cri-o://278daaeeed121c8c5712a061e380d0c2e1c31258dc4ea1b45072552b1e2c98ef" gracePeriod=45
Jul 06 19:42:54.606571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.606541    2553 generic.go:356] "Generic (PLEG): container finished" podID="254c01bb-a927-4498-9fa2-07cceee97df2" containerID="278daaeeed121c8c5712a061e380d0c2e1c31258dc4ea1b45072552b1e2c98ef" exitCode=0
Jul 06 19:42:54.606723 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.606596    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" event={"ID":"254c01bb-a927-4498-9fa2-07cceee97df2","Type":"ContainerDied","Data":"278daaeeed121c8c5712a061e380d0c2e1c31258dc4ea1b45072552b1e2c98ef"}
Jul 06 19:42:54.730380 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.730348    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:54.862054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.861938    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.861974    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862025    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862043    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pcfj\" (UniqueName: \"kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862346 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862101    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862346 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862144    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs\") pod \"254c01bb-a927-4498-9fa2-07cceee97df2\" (UID: \"254c01bb-a927-4498-9fa2-07cceee97df2\") "
Jul 06 19:42:54.862453 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862348    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home" (OuterVolumeSpecName: "home") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:54.862453 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862353    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:54.862453 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.862436    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache" (OuterVolumeSpecName: "model-cache") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:54.864248 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.864205    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm" (OuterVolumeSpecName: "dshm") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:42:54.864357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.864301    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:42:54.864357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.864309    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj" (OuterVolumeSpecName: "kube-api-access-8pcfj") pod "254c01bb-a927-4498-9fa2-07cceee97df2" (UID: "254c01bb-a927-4498-9fa2-07cceee97df2"). InnerVolumeSpecName "kube-api-access-8pcfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:42:54.962734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962682    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254c01bb-a927-4498-9fa2-07cceee97df2-tls-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.962734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962726    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-dshm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.962734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962735    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-home\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.962734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962744    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-tmp-dir\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.962734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962752    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pcfj\" (UniqueName: \"kubernetes.io/projected/254c01bb-a927-4498-9fa2-07cceee97df2-kube-api-access-8pcfj\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:54.963082 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:54.962761    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254c01bb-a927-4498-9fa2-07cceee97df2-model-cache\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:42:55.612136 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:55.612105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w" event={"ID":"254c01bb-a927-4498-9fa2-07cceee97df2","Type":"ContainerDied","Data":"8ed1b3c6b6d8dec297331f7044e8f2f8c1d95841f9500b4335d80b72e996fbf0"}
Jul 06 19:42:55.612136 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:55.612146    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"
Jul 06 19:42:55.612598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:55.612155    2553 scope.go:117] "RemoveContainer" containerID="278daaeeed121c8c5712a061e380d0c2e1c31258dc4ea1b45072552b1e2c98ef"
Jul 06 19:42:55.635324 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:55.635295    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:55.641458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:55.641431    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-167b10/test-model-167b10-kserve-5b4fcf6659-ll92w"]
Jul 06 19:42:57.541901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:42:57.541870    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="254c01bb-a927-4498-9fa2-07cceee97df2" path="/var/lib/kubelet/pods/254c01bb-a927-4498-9fa2-07cceee97df2/volumes"
Jul 06 19:43:23.408910 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:23.408873    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:43:23.409502 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:23.409187    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" containerID="cri-o://db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e" gracePeriod=30
Jul 06 19:43:23.862675 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:23.862637    2553 patch_prober.go:28] interesting pod/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:43:23.862875 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:23.862701    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:43:24.635208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.635168    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:43:24.635720 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.635395    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" podUID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" containerName="maas-api" containerID="cri-o://c22f77ad187da2049a532b458511fb5c0e86ef6aaa0d46c2001334c9be06fecd" gracePeriod=30
Jul 06 19:43:24.751318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.751287    2553 generic.go:356] "Generic (PLEG): container finished" podID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" containerID="c22f77ad187da2049a532b458511fb5c0e86ef6aaa0d46c2001334c9be06fecd" exitCode=0
Jul 06 19:43:24.751444 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.751355    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" event={"ID":"edc4b2bd-c313-4802-a6bd-358fb2ca0b02","Type":"ContainerDied","Data":"c22f77ad187da2049a532b458511fb5c0e86ef6aaa0d46c2001334c9be06fecd"}
Jul 06 19:43:24.878885 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.878859    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:43:24.919510 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.919416    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca\") pod \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") "
Jul 06 19:43:24.919510 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.919506    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls\") pod \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") "
Jul 06 19:43:24.919757 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.919549    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6psqr\" (UniqueName: \"kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr\") pod \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\" (UID: \"edc4b2bd-c313-4802-a6bd-358fb2ca0b02\") "
Jul 06 19:43:24.919820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.919772    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edc4b2bd-c313-4802-a6bd-358fb2ca0b02" (UID: "edc4b2bd-c313-4802-a6bd-358fb2ca0b02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:43:24.921703 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.921669    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr" (OuterVolumeSpecName: "kube-api-access-6psqr") pod "edc4b2bd-c313-4802-a6bd-358fb2ca0b02" (UID: "edc4b2bd-c313-4802-a6bd-358fb2ca0b02"). InnerVolumeSpecName "kube-api-access-6psqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:24.921827 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:24.921681    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edc4b2bd-c313-4802-a6bd-358fb2ca0b02" (UID: "edc4b2bd-c313-4802-a6bd-358fb2ca0b02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:43:25.020802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.020762    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:25.020802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.020794    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6psqr\" (UniqueName: \"kubernetes.io/projected/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-kube-api-access-6psqr\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:25.020802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.020804    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc4b2bd-c313-4802-a6bd-358fb2ca0b02-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:25.757829 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.757793    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln" event={"ID":"edc4b2bd-c313-4802-a6bd-358fb2ca0b02","Type":"ContainerDied","Data":"d7cdb37923533c2a2205bdd0a6255b329d86be4e187eb299cec66f02399ce754"}
Jul 06 19:43:25.758330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.757869    2553 scope.go:117] "RemoveContainer" containerID="c22f77ad187da2049a532b458511fb5c0e86ef6aaa0d46c2001334c9be06fecd"
Jul 06 19:43:25.758330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.757805    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"
Jul 06 19:43:25.781739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.781706    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:43:25.790605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:25.790575    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-167b10-5997b475f9-z4wln"]
Jul 06 19:43:27.542300 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:27.542263    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" path="/var/lib/kubelet/pods/edc4b2bd-c313-4802-a6bd-358fb2ca0b02/volumes"
Jul 06 19:43:28.661041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.661017    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:43:28.753227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753190    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp6pq\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753235    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753266    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753320    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753360    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753402    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753429    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753476    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753501    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs\") pod \"54cf5938-0207-441a-a90c-1fae6ec576df\" (UID: \"54cf5938-0207-441a-a90c-1fae6ec576df\") "
Jul 06 19:43:28.753857 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753785    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:43:28.753857 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753825    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:28.753974 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753905    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:28.753974 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.753945    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:28.754382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.754355    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data" (OuterVolumeSpecName: "istio-data") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:28.755725 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.755691    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:28.755827 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.755780    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:43:28.756021 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.755969    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token" (OuterVolumeSpecName: "istio-token") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:28.756021 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.755969    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq" (OuterVolumeSpecName: "kube-api-access-bp6pq") pod "54cf5938-0207-441a-a90c-1fae6ec576df" (UID: "54cf5938-0207-441a-a90c-1fae6ec576df"). InnerVolumeSpecName "kube-api-access-bp6pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:28.775673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.775643    2553 generic.go:356] "Generic (PLEG): container finished" podID="54cf5938-0207-441a-a90c-1fae6ec576df" containerID="db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e" exitCode=0
Jul 06 19:43:28.775832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.775689    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"
Jul 06 19:43:28.775832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.775722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerDied","Data":"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"}
Jul 06 19:43:28.775832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.775784    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q" event={"ID":"54cf5938-0207-441a-a90c-1fae6ec576df","Type":"ContainerDied","Data":"10f3022807550cd3df749275711d3c4ba1b49bf60d7372b3936da53a9a1a8148"}
Jul 06 19:43:28.775832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.775807    2553 scope.go:117] "RemoveContainer" containerID="db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"
Jul 06 19:43:28.785300 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.785283    2553 scope.go:117] "RemoveContainer" containerID="6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"
Jul 06 19:43:28.793213 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.793191    2553 scope.go:117] "RemoveContainer" containerID="db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"
Jul 06 19:43:28.793494 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:28.793473    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e\": container with ID starting with db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e not found: ID does not exist" containerID="db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"
Jul 06 19:43:28.793568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.793507    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e"} err="failed to get container status \"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e\": rpc error: code = NotFound desc = could not find container \"db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e\": container with ID starting with db238c3f4dd38c61e64de0177e8899dd6573049eacf808e68f5458943c299e6e not found: ID does not exist"
Jul 06 19:43:28.793568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.793535    2553 scope.go:117] "RemoveContainer" containerID="6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"
Jul 06 19:43:28.793798 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:28.793781    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de\": container with ID starting with 6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de not found: ID does not exist" containerID="6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"
Jul 06 19:43:28.793845 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.793804    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de"} err="failed to get container status \"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de\": rpc error: code = NotFound desc = could not find container \"6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de\": container with ID starting with 6a4795c1e98c8241bdbbd2460f7c1528259b7e4154748cd6eaa177f1551880de not found: ID does not exist"
Jul 06 19:43:28.801488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.801453    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:43:28.807024 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.806968    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c985ce-openshift-default-85c98488cf-2rz9q"]
Jul 06 19:43:28.855040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.854963    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855034    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855044    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855054    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cf5938-0207-441a-a90c-1fae6ec576df-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855062    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855071    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp6pq\" (UniqueName: \"kubernetes.io/projected/54cf5938-0207-441a-a90c-1fae6ec576df-kube-api-access-bp6pq\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855080    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cf5938-0207-441a-a90c-1fae6ec576df-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855088    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:28.855311 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:28.855095    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cf5938-0207-441a-a90c-1fae6ec576df-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:29.542092 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:29.542059    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" path="/var/lib/kubelet/pods/54cf5938-0207-441a-a90c-1fae6ec576df/volumes"
Jul 06 19:43:31.108729 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:31.108688    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:43:31.109230 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:31.108949    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy" containerID="cri-o://f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e" gracePeriod=30
Jul 06 19:43:32.000519 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000483    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:43:32.000772 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000761    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" containerName="maas-api"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000774    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" containerName="maas-api"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000782    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000788    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000798    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000803    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.000818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000815    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" containerName="maas-api"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000820    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" containerName="maas-api"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000828    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254c01bb-a927-4498-9fa2-07cceee97df2" containerName="main"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000833    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="254c01bb-a927-4498-9fa2-07cceee97df2" containerName="main"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000882    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="254c01bb-a927-4498-9fa2-07cceee97df2" containerName="main"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000889    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc4b2bd-c313-4802-a6bd-358fb2ca0b02" containerName="maas-api"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000895    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ddfbc1-e99d-487b-a3ef-1b102048d571" containerName="maas-api"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000903    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.001028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.000909    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cf5938-0207-441a-a90c-1fae6ec576df" containerName="istio-proxy"
Jul 06 19:43:32.003769 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.003753    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.006405 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.006383    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-406026-openshift-default-dockercfg-82jgj\""
Jul 06 19:43:32.018344 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.018316    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:43:32.082241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082201    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082241 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082244    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082484 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082271    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082484 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082336    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082484 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082381    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082484 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082424    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082484 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082452    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082681 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082500    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvkl\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.082681 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.082528    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183273    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183338    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183388    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvkl\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183415    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183485    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183512    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183537    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183676    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183721    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183783    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.183855 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.183854    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.184401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.184076    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.184401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.184110    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.184401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.184296    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.186159 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.186137    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.186266 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.186207    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.197571 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.197539    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.197803 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.197779    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvkl\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl\") pod \"e2e-api-a-406026-openshift-default-6bccd55f79-rckxt\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") " pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.314091 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.313972    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:32.456019 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.455976    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:43:32.457574 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:43:32.457550    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1c3a6e_5f12_40c1_94b2_7d151cdc9545.slice/crio-cc5d009ec6cff70fd6f3a383503f854be916aeea354c6b66fefd2102e07fde7c WatchSource:0}: Error finding container cc5d009ec6cff70fd6f3a383503f854be916aeea354c6b66fefd2102e07fde7c: Status 404 returned error can't find the container with id cc5d009ec6cff70fd6f3a383503f854be916aeea354c6b66fefd2102e07fde7c
Jul 06 19:43:32.459633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.459592    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:32.459738 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.459665    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:32.459738 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.459694    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:32.799003 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.798946    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerStarted","Data":"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"}
Jul 06 19:43:32.799194 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.799034    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerStarted","Data":"cc5d009ec6cff70fd6f3a383503f854be916aeea354c6b66fefd2102e07fde7c"}
Jul 06 19:43:32.829729 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:32.829675    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podStartSLOduration=1.8296586129999999 podStartE2EDuration="1.829658613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:32.827357479 +0000 UTC m=+2288.787800176" watchObservedRunningTime="2026-07-06 19:43:32.829658613 +0000 UTC m=+2288.790101309"
Jul 06 19:43:33.314922 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:33.314882    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:33.319796 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:33.319769    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:33.804399 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:33.804372    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:33.805417 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:33.805399    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:34.892772 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:34.892736    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:34.896213 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:34.896190    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:34.899243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:34.899226    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:43:34.899463 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:34.899443    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-406026-serving-cert\""
Jul 06 19:43:34.911702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:34.911670    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:35.008317 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.008281    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.008527 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.008331    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.008527 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.008349    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8lh\" (UniqueName: \"kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.109454 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.109415    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.109664 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.109465    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.109664 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.109582    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8lh\" (UniqueName: \"kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.110187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.110162    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.112572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.112540    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.122627 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.122600    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8lh\" (UniqueName: \"kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh\") pod \"maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") " pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.206874 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.206847    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:35.347465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.347436    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:35.349061 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:43:35.349028    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e1a70f_62b0_437b_b4d2_32c5b3b7bb4b.slice/crio-8e7cafb4bcf1ae28fe459764f20d1658a19f37c6af06011cc2d4f847be7ce768 WatchSource:0}: Error finding container 8e7cafb4bcf1ae28fe459764f20d1658a19f37c6af06011cc2d4f847be7ce768: Status 404 returned error can't find the container with id 8e7cafb4bcf1ae28fe459764f20d1658a19f37c6af06011cc2d4f847be7ce768
Jul 06 19:43:35.814913 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:35.814874    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" event={"ID":"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b","Type":"ContainerStarted","Data":"8e7cafb4bcf1ae28fe459764f20d1658a19f37c6af06011cc2d4f847be7ce768"}
Jul 06 19:43:36.369585 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.369523    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:43:36.420784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.420749    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.420784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.420791    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.420854    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.420959    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7bgm\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421041 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421025    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421049    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421084    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421112    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421217 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421147    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token\") pod \"e6a59b51-3192-447c-b6ab-6ccff58919f1\" (UID: \"e6a59b51-3192-447c-b6ab-6ccff58919f1\") "
Jul 06 19:43:36.421418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421207    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:36.421418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421322    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:43:36.421532 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421439    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6a59b51-3192-447c-b6ab-6ccff58919f1-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.421532 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421458    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.421643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421502    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:36.421815 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.421771    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:36.422049 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.422008    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:36.423564 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.423534    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm" (OuterVolumeSpecName: "kube-api-access-f7bgm") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "kube-api-access-f7bgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:36.423650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.423579    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:36.423650 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.423582    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:43:36.423891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.423877    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6a59b51-3192-447c-b6ab-6ccff58919f1" (UID: "e6a59b51-3192-447c-b6ab-6ccff58919f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:36.522252 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522214    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522252 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522245    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7bgm\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-kube-api-access-f7bgm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522252 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522256    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522494 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522265    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522494 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522275    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522494 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522283    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6a59b51-3192-447c-b6ab-6ccff58919f1-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.522494 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.522291    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6a59b51-3192-447c-b6ab-6ccff58919f1-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:36.821261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.821223    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" event={"ID":"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b","Type":"ContainerStarted","Data":"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"}
Jul 06 19:43:36.821452 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.821389    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:36.822834 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.822810    2553 generic.go:356] "Generic (PLEG): container finished" podID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerID="f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e" exitCode=0
Jul 06 19:43:36.822953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.822852    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"
Jul 06 19:43:36.822953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.822884    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerDied","Data":"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"}
Jul 06 19:43:36.822953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.822926    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf" event={"ID":"e6a59b51-3192-447c-b6ab-6ccff58919f1","Type":"ContainerDied","Data":"581f61a5b087ad5c7172ab1cbf314a8b4c43287ab7cf4ffa188e7949d2debe46"}
Jul 06 19:43:36.822953 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.822947    2553 scope.go:117] "RemoveContainer" containerID="f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"
Jul 06 19:43:36.831611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.831593    2553 scope.go:117] "RemoveContainer" containerID="70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"
Jul 06 19:43:36.840489 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.840462    2553 scope.go:117] "RemoveContainer" containerID="f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"
Jul 06 19:43:36.840820 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:36.840802    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e\": container with ID starting with f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e not found: ID does not exist" containerID="f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"
Jul 06 19:43:36.840898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.840830    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e"} err="failed to get container status \"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e\": rpc error: code = NotFound desc = could not find container \"f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e\": container with ID starting with f35696882fe0a5abbccc8ea1f293581df73b34639f71ca4533a123743d72ac2e not found: ID does not exist"
Jul 06 19:43:36.840898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.840847    2553 scope.go:117] "RemoveContainer" containerID="70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"
Jul 06 19:43:36.841121 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:36.841104    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5\": container with ID starting with 70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5 not found: ID does not exist" containerID="70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"
Jul 06 19:43:36.841192 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.841124    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5"} err="failed to get container status \"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5\": rpc error: code = NotFound desc = could not find container \"70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5\": container with ID starting with 70e73953abc9d62102a0abf42016b7a8a5e3b6a3faf4be8e141ab5af3722a8e5 not found: ID does not exist"
Jul 06 19:43:36.841322 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.841282    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" podStartSLOduration=2.422648549 podStartE2EDuration="2.841268742s" totalImagesPullingTime="418.620193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:36.839565651 +0000 UTC m=+2292.800008347" watchObservedRunningTime="2026-07-06 19:43:36.841268742 +0000 UTC m=+2292.801711438"
Jul 06 19:43:36.856486 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.856460    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:43:36.859978 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:36.859951    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-167b10-openshift-default-86c9746c45-dgczf"]
Jul 06 19:43:37.542531 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:37.542494    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" path="/var/lib/kubelet/pods/e6a59b51-3192-447c-b6ab-6ccff58919f1/volumes"
Jul 06 19:43:40.113374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113341    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:43:40.113748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113631    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.113748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113642    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.113748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113650    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.113748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113655    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.113748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113742    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.114012 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.113756    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a59b51-3192-447c-b6ab-6ccff58919f1" containerName="istio-proxy"
Jul 06 19:43:40.118250 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.118227    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.120888 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.120866    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9c4193-openshift-default-dockercfg-wqqlp\""
Jul 06 19:43:40.130387 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.130362    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:43:40.152712 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152670    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.152712 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152709    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrp8\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.152943 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152741    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.152943 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152824    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.152943 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152869    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.152943 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152891    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.153109 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152941    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.153109 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.152997    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.153109 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.153023    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253567 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253567 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253671    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253707    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253740    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.253811 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253766    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.253934    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254068    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrp8\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254132    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254211 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254149    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254326 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254217    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254326 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254242    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254319    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.254418 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.254387    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.256255 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.256230    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.256372 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.256234    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.264657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.264633    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.264774 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.264724    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrp8\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8\") pod \"e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") " pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.429515 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.429422    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:40.580831 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.580795    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:43:40.583546 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:43:40.583517    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e9863e_1df9_46a3_a7f0_0da24e3f3c96.slice/crio-20b3772ddb661fddb63e1a8f3e2f8987b08705841f53e4c5c151cf596ed8a76c WatchSource:0}: Error finding container 20b3772ddb661fddb63e1a8f3e2f8987b08705841f53e4c5c151cf596ed8a76c: Status 404 returned error can't find the container with id 20b3772ddb661fddb63e1a8f3e2f8987b08705841f53e4c5c151cf596ed8a76c
Jul 06 19:43:40.585697 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.585663    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:40.585789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.585728    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:40.585789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.585758    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:40.845792 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.845749    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerStarted","Data":"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"}
Jul 06 19:43:40.846004 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.845820    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerStarted","Data":"20b3772ddb661fddb63e1a8f3e2f8987b08705841f53e4c5c151cf596ed8a76c"}
Jul 06 19:43:40.869087 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:40.869033    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podStartSLOduration=0.869016322 podStartE2EDuration="869.016322ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:40.868381858 +0000 UTC m=+2296.828824567" watchObservedRunningTime="2026-07-06 19:43:40.869016322 +0000 UTC m=+2296.829459018"
Jul 06 19:43:41.429657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:41.429615    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:41.431119 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:41.431088    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:43:41.431247 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:41.431140    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:43:42.433926 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:42.433892    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:42.834249 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:42.834172    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:42.860973 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:42.860903    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:42.869619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:42.869580    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:43.014529 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.014474    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:43:43.018726 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.018701    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.021570 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.021539    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-9c4193-serving-cert\""
Jul 06 19:43:43.032970 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.032943    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:43:43.090587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.090489    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.090587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.090540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.090778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.090591    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njcd8\" (UniqueName: \"kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.191308 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.191272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.191308 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.191312    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njcd8\" (UniqueName: \"kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.191526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.191385    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.191526 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:43.191481    2553 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-9c4193-serving-cert: secret "maas-api-e2e-api-b-9c4193-serving-cert" not found
Jul 06 19:43:43.191608 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:43.191556    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls podName:e503d1b1-5328-4b6d-ac44-a68876b58a13 nodeName:}" failed. No retries permitted until 2026-07-06 19:43:43.691540238 +0000 UTC m=+2299.651982912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls") pod "maas-api-e2e-api-b-9c4193-6797758596-dc7bj" (UID: "e503d1b1-5328-4b6d-ac44-a68876b58a13") : secret "maas-api-e2e-api-b-9c4193-serving-cert" not found
Jul 06 19:43:43.191951 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.191931    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.202796 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.202767    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njcd8\" (UniqueName: \"kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.697677 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:43.697636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:43.698093 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:43.697750    2553 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-9c4193-serving-cert: secret "maas-api-e2e-api-b-9c4193-serving-cert" not found
Jul 06 19:43:43.698093 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:43.697813    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls podName:e503d1b1-5328-4b6d-ac44-a68876b58a13 nodeName:}" failed. No retries permitted until 2026-07-06 19:43:44.697799524 +0000 UTC m=+2300.658242198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls") pod "maas-api-e2e-api-b-9c4193-6797758596-dc7bj" (UID: "e503d1b1-5328-4b6d-ac44-a68876b58a13") : secret "maas-api-e2e-api-b-9c4193-serving-cert" not found
Jul 06 19:43:44.707980 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:44.707941    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:44.710486 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:44.710455    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"maas-api-e2e-api-b-9c4193-6797758596-dc7bj\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") " pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:44.832376 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:44.832334    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:45.046237 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:45.046210    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:43:45.048458 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:43:45.048430    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode503d1b1_5328_4b6d_ac44_a68876b58a13.slice/crio-0cd5e4fe4cc1578a6d0e5e6476a45abe2ab4d1ab2a9a1cbf1217537d76c7d082 WatchSource:0}: Error finding container 0cd5e4fe4cc1578a6d0e5e6476a45abe2ab4d1ab2a9a1cbf1217537d76c7d082: Status 404 returned error can't find the container with id 0cd5e4fe4cc1578a6d0e5e6476a45abe2ab4d1ab2a9a1cbf1217537d76c7d082
Jul 06 19:43:45.898261 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:45.898216    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" event={"ID":"e503d1b1-5328-4b6d-ac44-a68876b58a13","Type":"ContainerStarted","Data":"f1d5b7cf508de5ca7e08181ad3ef1191a1da8f2cd0b8567c18e3ee899b99b3ab"}
Jul 06 19:43:45.898669 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:45.898320    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" event={"ID":"e503d1b1-5328-4b6d-ac44-a68876b58a13","Type":"ContainerStarted","Data":"0cd5e4fe4cc1578a6d0e5e6476a45abe2ab4d1ab2a9a1cbf1217537d76c7d082"}
Jul 06 19:43:45.898669 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:45.898354    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:45.920667 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:45.920615    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" podStartSLOduration=3.500040308 podStartE2EDuration="3.920600648s" totalImagesPullingTime="420.56034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:45.920172555 +0000 UTC m=+2301.880615253" watchObservedRunningTime="2026-07-06 19:43:45.920600648 +0000 UTC m=+2301.881043344"
Jul 06 19:43:48.806358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.806253    2553 patch_prober.go:28] interesting pod/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:43:48.806358 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.806336    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:43:48.916123 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.916092    2553 generic.go:356] "Generic (PLEG): container finished" podID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerID="f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888" exitCode=0
Jul 06 19:43:48.916306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.916149    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerDied","Data":"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"}
Jul 06 19:43:48.916557 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.916541    2553 scope.go:117] "RemoveContainer" containerID="f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"
Jul 06 19:43:48.917599 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.917564    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:48.917677 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.917656    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:48.917720 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:48.917697    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:49.923433 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:49.923400    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerStarted","Data":"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"}
Jul 06 19:43:50.314935 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:50.314892    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:50.315172 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:50.315072    2553 patch_prober.go:28] interesting pod/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:43:50.315172 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:50.315118    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:43:51.315210 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:51.315174    2553 patch_prober.go:28] interesting pod/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:43:51.315624 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:51.315231    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:43:51.910435 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:51.910394    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:43:52.314974 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:52.314938    2553 patch_prober.go:28] interesting pod/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:43:52.315188 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:52.315027    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:43:53.314583 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:53.314543    2553 patch_prober.go:28] interesting pod/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:43:53.315014 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:53.314602    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:43:54.319083 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.319051    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:54.319611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.319421    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:54.320086 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.320066    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:43:54.950190 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.950113    2553 generic.go:356] "Generic (PLEG): container finished" podID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerID="b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9" exitCode=0
Jul 06 19:43:54.950383 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.950186    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerDied","Data":"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"}
Jul 06 19:43:54.950759 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.950744    2553 scope.go:117] "RemoveContainer" containerID="b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"
Jul 06 19:43:54.951718 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.951693    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:54.951781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.951768    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:54.951828 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:54.951802    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:43:55.959681 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:55.959634    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerStarted","Data":"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"}
Jul 06 19:43:56.288458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.288361    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:56.288693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.288651    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" podUID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" containerName="maas-api" containerID="cri-o://322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df" gracePeriod=30
Jul 06 19:43:56.430276 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.430239    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:56.431499 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.431470    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:43:56.431606 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.431543    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:43:56.566520 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.566211    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:56.724673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.724633    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca\") pod \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") "
Jul 06 19:43:56.724876 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.724728    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8lh\" (UniqueName: \"kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh\") pod \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") "
Jul 06 19:43:56.724876 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.724781    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls\") pod \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\" (UID: \"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b\") "
Jul 06 19:43:56.725048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.724967    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" (UID: "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:43:56.726874 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.726841    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" (UID: "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:43:56.727021 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.726904    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh" (OuterVolumeSpecName: "kube-api-access-2w8lh") pod "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" (UID: "95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b"). InnerVolumeSpecName "kube-api-access-2w8lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:56.825832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.825729    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8lh\" (UniqueName: \"kubernetes.io/projected/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-kube-api-access-2w8lh\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:56.825832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.825767    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:56.825832 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.825777    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:43:56.967949 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.967904    2553 generic.go:356] "Generic (PLEG): container finished" podID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" containerID="322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df" exitCode=0
Jul 06 19:43:56.968814 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.968785    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"
Jul 06 19:43:56.977309 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.977235    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" event={"ID":"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b","Type":"ContainerDied","Data":"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"}
Jul 06 19:43:56.977589 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.977546    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt" event={"ID":"95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b","Type":"ContainerDied","Data":"8e7cafb4bcf1ae28fe459764f20d1658a19f37c6af06011cc2d4f847be7ce768"}
Jul 06 19:43:56.977706 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.977594    2553 scope.go:117] "RemoveContainer" containerID="322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"
Jul 06 19:43:56.989035 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.989015    2553 scope.go:117] "RemoveContainer" containerID="322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"
Jul 06 19:43:56.989335 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:43:56.989311    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df\": container with ID starting with 322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df not found: ID does not exist" containerID="322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"
Jul 06 19:43:56.989385 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:56.989343    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df"} err="failed to get container status \"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df\": rpc error: code = NotFound desc = could not find container \"322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df\": container with ID starting with 322688c15b952c6440bf81cf3a6866ac86a4db8a3e68e79b1865e91f935296df not found: ID does not exist"
Jul 06 19:43:57.023802 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.023763    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:57.033419 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.033380    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-406026-7c6c79cdc8-btnrt"]
Jul 06 19:43:57.430422 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.430376    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:43:57.430614 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.430445    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:43:57.542038 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.541980    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" path="/var/lib/kubelet/pods/95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b/volumes"
Jul 06 19:43:57.860865 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:57.860747    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:43:58.430394 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:58.430355    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:43:58.430799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:58.430411    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:43:59.430611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:59.430575    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:43:59.431045 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:43:59.430644    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:44:00.434054 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:00.434020    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:44:00.434884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:00.434868    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:44:02.716592 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:02.716553    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:44:02.717152 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:02.716778    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy" containerID="cri-o://ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81" gracePeriod=30
Jul 06 19:44:03.840680 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:03.840645    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:44:03.841187 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:03.840890    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" podUID="e503d1b1-5328-4b6d-ac44-a68876b58a13" containerName="maas-api" containerID="cri-o://f1d5b7cf508de5ca7e08181ad3ef1191a1da8f2cd0b8567c18e3ee899b99b3ab" gracePeriod=30
Jul 06 19:44:04.010738 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.010703    2553 generic.go:356] "Generic (PLEG): container finished" podID="e503d1b1-5328-4b6d-ac44-a68876b58a13" containerID="f1d5b7cf508de5ca7e08181ad3ef1191a1da8f2cd0b8567c18e3ee899b99b3ab" exitCode=0
Jul 06 19:44:04.010886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.010758    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" event={"ID":"e503d1b1-5328-4b6d-ac44-a68876b58a13","Type":"ContainerDied","Data":"f1d5b7cf508de5ca7e08181ad3ef1191a1da8f2cd0b8567c18e3ee899b99b3ab"}
Jul 06 19:44:04.092028 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.091939    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:44:04.192734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.192696    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") pod \"e503d1b1-5328-4b6d-ac44-a68876b58a13\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") "
Jul 06 19:44:04.192734 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.192737    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca\") pod \"e503d1b1-5328-4b6d-ac44-a68876b58a13\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") "
Jul 06 19:44:04.192956 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.192813    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njcd8\" (UniqueName: \"kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8\") pod \"e503d1b1-5328-4b6d-ac44-a68876b58a13\" (UID: \"e503d1b1-5328-4b6d-ac44-a68876b58a13\") "
Jul 06 19:44:04.193178 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.193144    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e503d1b1-5328-4b6d-ac44-a68876b58a13" (UID: "e503d1b1-5328-4b6d-ac44-a68876b58a13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:44:04.194858 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.194830    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8" (OuterVolumeSpecName: "kube-api-access-njcd8") pod "e503d1b1-5328-4b6d-ac44-a68876b58a13" (UID: "e503d1b1-5328-4b6d-ac44-a68876b58a13"). InnerVolumeSpecName "kube-api-access-njcd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:44:04.194952 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.194859    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e503d1b1-5328-4b6d-ac44-a68876b58a13" (UID: "e503d1b1-5328-4b6d-ac44-a68876b58a13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:44:04.293555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.293513    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njcd8\" (UniqueName: \"kubernetes.io/projected/e503d1b1-5328-4b6d-ac44-a68876b58a13-kube-api-access-njcd8\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:04.293555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.293547    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e503d1b1-5328-4b6d-ac44-a68876b58a13-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:04.293555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:04.293556    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e503d1b1-5328-4b6d-ac44-a68876b58a13-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:05.017344 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.017305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj" event={"ID":"e503d1b1-5328-4b6d-ac44-a68876b58a13","Type":"ContainerDied","Data":"0cd5e4fe4cc1578a6d0e5e6476a45abe2ab4d1ab2a9a1cbf1217537d76c7d082"}
Jul 06 19:44:05.017778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.017369    2553 scope.go:117] "RemoveContainer" containerID="f1d5b7cf508de5ca7e08181ad3ef1191a1da8f2cd0b8567c18e3ee899b99b3ab"
Jul 06 19:44:05.017778 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.017326    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"
Jul 06 19:44:05.044272 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.044233    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:44:05.051769 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.051739    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9c4193-6797758596-dc7bj"]
Jul 06 19:44:05.542021 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:05.541971    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e503d1b1-5328-4b6d-ac44-a68876b58a13" path="/var/lib/kubelet/pods/e503d1b1-5328-4b6d-ac44-a68876b58a13/volumes"
Jul 06 19:44:07.973827 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:07.973797    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:44:08.019916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019811    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.019916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019853    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvkl\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.019916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019878    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.019916 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019898    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019935    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019956    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.019972    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020032    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020070    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket\") pod \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\" (UID: \"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545\") "
Jul 06 19:44:08.020303 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020129    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:08.020629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020315    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:08.020629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020340    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.020629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020484    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:08.020629 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.020531    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:44:08.021324 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.021296    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:08.022439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.022417    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:44:08.022439 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.022430    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:08.022699 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.022680    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl" (OuterVolumeSpecName: "kube-api-access-tfvkl") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "kube-api-access-tfvkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:44:08.022751 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.022676    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" (UID: "4a1c3a6e-5f12-40c1-94b2-7d151cdc9545"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:44:08.033706 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.033677    2553 generic.go:356] "Generic (PLEG): container finished" podID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerID="ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81" exitCode=0
Jul 06 19:44:08.033820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.033731    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"
Jul 06 19:44:08.033820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.033749    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerDied","Data":"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"}
Jul 06 19:44:08.033820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.033794    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt" event={"ID":"4a1c3a6e-5f12-40c1-94b2-7d151cdc9545","Type":"ContainerDied","Data":"cc5d009ec6cff70fd6f3a383503f854be916aeea354c6b66fefd2102e07fde7c"}
Jul 06 19:44:08.033820 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.033815    2553 scope.go:117] "RemoveContainer" containerID="ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"
Jul 06 19:44:08.043581 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.043561    2553 scope.go:117] "RemoveContainer" containerID="f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"
Jul 06 19:44:08.051883 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.051863    2553 scope.go:117] "RemoveContainer" containerID="ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"
Jul 06 19:44:08.052149 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:08.052129    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81\": container with ID starting with ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81 not found: ID does not exist" containerID="ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"
Jul 06 19:44:08.052215 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.052155    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81"} err="failed to get container status \"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81\": rpc error: code = NotFound desc = could not find container \"ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81\": container with ID starting with ab26f371e8be22dec64726fac6542b54ee93127f066d55b3de2baac77f820f81 not found: ID does not exist"
Jul 06 19:44:08.052215 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.052171    2553 scope.go:117] "RemoveContainer" containerID="f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"
Jul 06 19:44:08.052427 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:08.052412    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888\": container with ID starting with f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888 not found: ID does not exist" containerID="f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"
Jul 06 19:44:08.052478 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.052429    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888"} err="failed to get container status \"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888\": rpc error: code = NotFound desc = could not find container \"f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888\": container with ID starting with f49f85be68bc3da2faa88c90d2b511206817c24d6b4cdcf799e39054b6f64888 not found: ID does not exist"
Jul 06 19:44:08.063345 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.063302    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:44:08.069032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.069006    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-406026-openshift-default-6bccd55f79-rckxt"]
Jul 06 19:44:08.120740 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120704    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvkl\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-kube-api-access-tfvkl\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.120740 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120735    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.120740 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120747    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.121026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120756    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.121026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120764    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.121026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120772    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.121026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120779    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:08.121026 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:08.120788    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:09.542434 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:09.542397    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" path="/var/lib/kubelet/pods/4a1c3a6e-5f12-40c1-94b2-7d151cdc9545/volumes"
Jul 06 19:44:10.386792 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:10.386752    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:44:10.387023 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:10.386977    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" containerID="cri-o://b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e" gracePeriod=30
Jul 06 19:44:11.288421 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288384    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288697    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288708    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288717    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e503d1b1-5328-4b6d-ac44-a68876b58a13" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288724    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e503d1b1-5328-4b6d-ac44-a68876b58a13" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288735    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288741    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288796    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e503d1b1-5328-4b6d-ac44-a68876b58a13" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288804    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e1a70f-62b0-437b-b4d2-32c5b3b7bb4b" containerName="maas-api"
Jul 06 19:44:11.288807 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288810    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:11.289111 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.288817    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:11.292976 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.292959    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.297554 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.297530    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f22821-openshift-default-dockercfg-fnqlb\""
Jul 06 19:44:11.307576 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.307545    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:44:11.343915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.343872    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.343915 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.343914    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344174 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.343932    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344174 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.343961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344174 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.343981    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344174 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.344034    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rwq\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344324 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.344182    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344324 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.344210    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.344324 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.344246    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445381    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445425 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rwq\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445477    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445492    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445517    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445537    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445556    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.445690 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445572    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445909    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446040 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.445963    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446166 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.446039    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446166 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.446068    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446278 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.446250    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.446335 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.446291    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.448005 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.447964    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.448214 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.448192    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.457465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.457434    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rwq\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.457655 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.457637    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token\") pod \"e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") " pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.603231 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.603130    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:11.752090 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.752060    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:44:11.754441 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:44:11.754414    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7559170_eb20_4c87_81c2_0e1342957959.slice/crio-d2a3885713d8d95a810d5b5408c08243e168b207a12a2335a056d845ce9ddec9 WatchSource:0}: Error finding container d2a3885713d8d95a810d5b5408c08243e168b207a12a2335a056d845ce9ddec9: Status 404 returned error can't find the container with id d2a3885713d8d95a810d5b5408c08243e168b207a12a2335a056d845ce9ddec9
Jul 06 19:44:11.756672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.756637    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:11.756758 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.756709    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:11.756758 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:11.756749    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:12.054141 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:12.054102    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerStarted","Data":"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"}
Jul 06 19:44:12.054333 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:12.054159    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerStarted","Data":"d2a3885713d8d95a810d5b5408c08243e168b207a12a2335a056d845ce9ddec9"}
Jul 06 19:44:12.088275 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:12.088215    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podStartSLOduration=1.088197694 podStartE2EDuration="1.088197694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:12.079387538 +0000 UTC m=+2328.039830231" watchObservedRunningTime="2026-07-06 19:44:12.088197694 +0000 UTC m=+2328.048640389"
Jul 06 19:44:12.604269 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:12.604228    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:12.609208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:12.609181    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:13.059240 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:13.059211    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:13.060250 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:13.060227    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:14.131825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.131786    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:44:14.132237 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.132108    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:14.132237 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.132120    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c3a6e-5f12-40c1-94b2-7d151cdc9545" containerName="istio-proxy"
Jul 06 19:44:14.135286 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.135261    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.139771 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.139746    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-f22821-serving-cert\""
Jul 06 19:44:14.139771 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.139767    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\""
Jul 06 19:44:14.152682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.152640    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:44:14.166642 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.166605    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.166828 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.166678    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.166895 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.166823    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgr9q\" (UniqueName: \"kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.267928 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.267881    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgr9q\" (UniqueName: \"kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.268144 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.267947    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.268144 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.267977    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.268144 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:14.268069    2553 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-f22821-serving-cert: secret "maas-api-e2e-shared-a-f22821-serving-cert" not found
Jul 06 19:44:14.268282 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:14.268156    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls podName:b6b64260-7616-4e22-a4df-aeebc2827595 nodeName:}" failed. No retries permitted until 2026-07-06 19:44:14.768139356 +0000 UTC m=+2330.728582031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls") pod "maas-api-e2e-shared-a-f22821-8f5497654-26f24" (UID: "b6b64260-7616-4e22-a4df-aeebc2827595") : secret "maas-api-e2e-shared-a-f22821-serving-cert" not found
Jul 06 19:44:14.268577 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.268560    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.279424 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.279394    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgr9q\" (UniqueName: \"kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.771937 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.771888    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:14.774569 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:14.774531    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f22821-8f5497654-26f24\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") " pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:15.045890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.045800    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:15.188921 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.188886    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:44:15.190176 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:44:15.190150    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b64260_7616_4e22_a4df_aeebc2827595.slice/crio-8ea8a5debf0aec86f72e8dd9159bcefd3a767f67ec925159e3e155494ad71cbc WatchSource:0}: Error finding container 8ea8a5debf0aec86f72e8dd9159bcefd3a767f67ec925159e3e155494ad71cbc: Status 404 returned error can't find the container with id 8ea8a5debf0aec86f72e8dd9159bcefd3a767f67ec925159e3e155494ad71cbc
Jul 06 19:44:15.436210 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.436172    2553 patch_prober.go:28] interesting pod/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:44:15.436372 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.436245    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:44:15.647191 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.647125    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:44:15.680585 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680469    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680585 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680524    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680585 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680547    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680710    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680753    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680778    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680838    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.680891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680889    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvrp8\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.681306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.680917    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token\") pod \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\" (UID: \"33e9863e-1df9-46a3-a7f0-0da24e3f3c96\") "
Jul 06 19:44:15.681306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681066    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:44:15.681306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681252    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:15.681306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681276    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.681306 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681293    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:15.681568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681477    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:15.681568 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.681527    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data" (OuterVolumeSpecName: "istio-data") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:15.683403 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.683362    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:44:15.683760 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.683722    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token" (OuterVolumeSpecName: "istio-token") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:44:15.684117 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.684083    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:44:15.684312 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.684284    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8" (OuterVolumeSpecName: "kube-api-access-dvrp8") pod "33e9863e-1df9-46a3-a7f0-0da24e3f3c96" (UID: "33e9863e-1df9-46a3-a7f0-0da24e3f3c96"). InnerVolumeSpecName "kube-api-access-dvrp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:44:15.782227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782191    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782227 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782230    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782244    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782253    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782262    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvrp8\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-kube-api-access-dvrp8\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782271    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782279    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:15.782446 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:15.782286    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e9863e-1df9-46a3-a7f0-0da24e3f3c96-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:44:16.078588 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.078550    2553 generic.go:356] "Generic (PLEG): container finished" podID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerID="b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e" exitCode=0
Jul 06 19:44:16.078788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.078642    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"
Jul 06 19:44:16.078788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.078641    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerDied","Data":"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"}
Jul 06 19:44:16.078788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.078707    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj" event={"ID":"33e9863e-1df9-46a3-a7f0-0da24e3f3c96","Type":"ContainerDied","Data":"20b3772ddb661fddb63e1a8f3e2f8987b08705841f53e4c5c151cf596ed8a76c"}
Jul 06 19:44:16.078788 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.078736    2553 scope.go:117] "RemoveContainer" containerID="b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"
Jul 06 19:44:16.080476 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.080446    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" event={"ID":"b6b64260-7616-4e22-a4df-aeebc2827595","Type":"ContainerStarted","Data":"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"}
Jul 06 19:44:16.080617 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.080497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" event={"ID":"b6b64260-7616-4e22-a4df-aeebc2827595","Type":"ContainerStarted","Data":"8ea8a5debf0aec86f72e8dd9159bcefd3a767f67ec925159e3e155494ad71cbc"}
Jul 06 19:44:16.080617 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.080527    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:16.091396 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.091370    2553 scope.go:117] "RemoveContainer" containerID="b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"
Jul 06 19:44:16.102597 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.102577    2553 scope.go:117] "RemoveContainer" containerID="b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"
Jul 06 19:44:16.102830 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:16.102813    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e\": container with ID starting with b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e not found: ID does not exist" containerID="b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"
Jul 06 19:44:16.102884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.102838    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e"} err="failed to get container status \"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e\": rpc error: code = NotFound desc = could not find container \"b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e\": container with ID starting with b68f7aecf05590b8f6dde543565022c093791684934ec10292a2f5560a7ec40e not found: ID does not exist"
Jul 06 19:44:16.102884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.102854    2553 scope.go:117] "RemoveContainer" containerID="b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"
Jul 06 19:44:16.103119 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:44:16.103102    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9\": container with ID starting with b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9 not found: ID does not exist" containerID="b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"
Jul 06 19:44:16.103216 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.103122    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9"} err="failed to get container status \"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9\": rpc error: code = NotFound desc = could not find container \"b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9\": container with ID starting with b1a5bbd90d53678b090b11216c5b987bbad05e3d14f9d0a7ca354ad0e14558f9 not found: ID does not exist"
Jul 06 19:44:16.106475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.106432    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" podStartSLOduration=1.744072415 podStartE2EDuration="2.106417863s" totalImagesPullingTime="362.345448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:16.105875443 +0000 UTC m=+2332.066318139" watchObservedRunningTime="2026-07-06 19:44:16.106417863 +0000 UTC m=+2332.066860558"
Jul 06 19:44:16.126426 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.126351    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:44:16.131537 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:16.131507    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9c4193-openshift-default-86d98d5cd7-x6rcj"]
Jul 06 19:44:17.542496 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:17.542465    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" path="/var/lib/kubelet/pods/33e9863e-1df9-46a3-a7f0-0da24e3f3c96/volumes"
Jul 06 19:44:19.179094 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179059    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:44:19.179488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179346    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:19.179488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179358    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:19.179488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179367    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:19.179488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179373    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:19.179488 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.179432    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:19.183658 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.183629    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.186615 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.186588    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9293de-openshift-default-dockercfg-j7f7w\""
Jul 06 19:44:19.200540 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.200513    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:44:19.214323 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214292    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214331    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7955j\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214413    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214440    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214468 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214466    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214525    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214613    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.214780 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.214663    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315520 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315473    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315520 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315526    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315563    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315688    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315763 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315746    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315929 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315787    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7955j\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315929 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315849    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315929 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315879    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.315929 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315913    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.316171 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.315947    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.316171 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.316095    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.316283 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.316258    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.316361 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.316341    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.316711 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.316690    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.318013 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.317977    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.318101 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.318071    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.326968 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.326938    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7955j\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.331755 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.331730    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token\") pod \"e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") " pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.494393 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.494352    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:19.650603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.650573    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:44:19.652099 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:44:19.652067    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b91d0f6_a7ca_45f1_bfea_25d4501c5327.slice/crio-349beb799ebeb83a1d66310d12bdbfd82fbf62ea2e00c022f17fd8df868de70e WatchSource:0}: Error finding container 349beb799ebeb83a1d66310d12bdbfd82fbf62ea2e00c022f17fd8df868de70e: Status 404 returned error can't find the container with id 349beb799ebeb83a1d66310d12bdbfd82fbf62ea2e00c022f17fd8df868de70e
Jul 06 19:44:19.654329 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.654290    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:19.654404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.654360    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:19.654404 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:19.654390    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:20.104033 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:20.103974    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerStarted","Data":"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"}
Jul 06 19:44:20.104191 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:20.104052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerStarted","Data":"349beb799ebeb83a1d66310d12bdbfd82fbf62ea2e00c022f17fd8df868de70e"}
Jul 06 19:44:20.128609 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:20.128559    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podStartSLOduration=1.12854095 podStartE2EDuration="1.12854095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:20.126496342 +0000 UTC m=+2336.086939028" watchObservedRunningTime="2026-07-06 19:44:20.12854095 +0000 UTC m=+2336.088983704"
Jul 06 19:44:20.495373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:20.495339    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:20.500388 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:20.500357    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:21.108722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:21.108689    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:21.109793 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:21.109771    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:22.094386 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.094354    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:44:22.237289 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.237252    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:44:22.237817 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.237802    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e9863e-1df9-46a3-a7f0-0da24e3f3c96" containerName="istio-proxy"
Jul 06 19:44:22.241219 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.241201    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.243724 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.243694    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-9293de-serving-cert\""
Jul 06 19:44:22.283576 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.283524    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:44:22.343331 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.343278    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.343558 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.343416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wnq9\" (UniqueName: \"kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.343558 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.343463    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.444167 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.444129    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.444354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.444302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wnq9\" (UniqueName: \"kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.444445 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.444358    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.444883 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.444858    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.446739 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.446722    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.456397 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.456358    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wnq9\" (UniqueName: \"kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9\") pod \"maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") " pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.552882 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.552843    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:22.737898 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:22.737865    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:44:22.739304 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:44:22.739276    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e92f5f_eac9_480a_98b2_bfa6162cfdf9.slice/crio-af7a18fd010a8d0c6ad3e1b569a79cac41ea0ec69814d4a11ecb4207f482db71 WatchSource:0}: Error finding container af7a18fd010a8d0c6ad3e1b569a79cac41ea0ec69814d4a11ecb4207f482db71: Status 404 returned error can't find the container with id af7a18fd010a8d0c6ad3e1b569a79cac41ea0ec69814d4a11ecb4207f482db71
Jul 06 19:44:23.121353 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:23.121318    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" event={"ID":"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9","Type":"ContainerStarted","Data":"af7a18fd010a8d0c6ad3e1b569a79cac41ea0ec69814d4a11ecb4207f482db71"}
Jul 06 19:44:24.127764 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:24.127723    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" event={"ID":"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9","Type":"ContainerStarted","Data":"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"}
Jul 06 19:44:24.128232 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:24.127875    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:24.170565 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:24.170498    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" podStartSLOduration=1.830110553 podStartE2EDuration="2.17045879s" totalImagesPullingTime="340.348237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:24.169354619 +0000 UTC m=+2340.129797316" watchObservedRunningTime="2026-07-06 19:44:24.17045879 +0000 UTC m=+2340.130901492"
Jul 06 19:44:28.132061 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:28.131058    2553 patch_prober.go:28] interesting pod/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:54942->10.133.0.53:15021: read: connection reset by peer" start-of-body=
Jul 06 19:44:28.132061 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:28.131142    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:54942->10.133.0.53:15021: read: connection reset by peer"
Jul 06 19:44:29.154117 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.154077    2553 generic.go:356] "Generic (PLEG): container finished" podID="f7559170-eb20-4c87-81c2-0e1342957959" containerID="d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef" exitCode=0
Jul 06 19:44:29.154635 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.154141    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerDied","Data":"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"}
Jul 06 19:44:29.154635 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.154601    2553 scope.go:117] "RemoveContainer" containerID="d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"
Jul 06 19:44:29.156124 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.156084    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:29.156229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.156189    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:29.156294 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:29.156237    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:30.137785 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:30.137756    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:44:30.164134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:30.164067    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerStarted","Data":"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"}
Jul 06 19:44:30.604170 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:30.604124    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:30.604509 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:30.604486    2553 patch_prober.go:28] interesting pod/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 19:44:30.604606 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:30.604582    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 19:44:31.604043 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:31.603981    2553 patch_prober.go:28] interesting pod/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 19:44:31.604467 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:31.604065    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 19:44:32.604366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:32.604326    2553 patch_prober.go:28] interesting pod/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 19:44:32.604781 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:32.604393    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 19:44:33.186242 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.186213    2553 generic.go:356] "Generic (PLEG): container finished" podID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerID="f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5" exitCode=0
Jul 06 19:44:33.186447 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.186296    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerDied","Data":"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"}
Jul 06 19:44:33.186694 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.186680    2553 scope.go:117] "RemoveContainer" containerID="f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"
Jul 06 19:44:33.187686 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.187660    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:33.187735 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.187726    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:33.187782 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.187754    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:44:33.604045 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.604011    2553 patch_prober.go:28] interesting pod/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 19:44:33.604251 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:33.604077    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 19:44:34.199069 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.199025    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerStarted","Data":"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"}
Jul 06 19:44:34.396022 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.395968    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:44:34.399004 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.398967    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.401830 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.401796    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"default-dockercfg-4clmw\""
Jul 06 19:44:34.402033 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.401980    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"openshift-service-ca.crt\""
Jul 06 19:44:34.402033 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.402017    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"auth-test-model-f22821-kserve-self-signed-certs\""
Jul 06 19:44:34.402223 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.402080    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"kube-root-ca.crt\""
Jul 06 19:44:34.410703 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.410679    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:44:34.468658 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.468552    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.468947 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.468926    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.469118 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.469100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.469244 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.469227    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfppb\" (UniqueName: \"kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.469362 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.469348    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.469495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.469481    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.494959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.494920    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:34.496060 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.496036    2553 patch_prober.go:28] interesting pod/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:44:34.496120 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.496086    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:44:34.570257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570214    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570269    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfppb\" (UniqueName: \"kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570336    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570382    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570475 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570437    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.570935 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.570906    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.571263 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.571236    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.572108 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.572086    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.574572 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.574546    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.576132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.576110    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.583674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.583617    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfppb\" (UniqueName: \"kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb\") pod \"auth-test-model-f22821-kserve-668f6bb687-tzr97\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") " pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.607769 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.607740    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:34.608043 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.608012    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:34.608830 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.608811    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:44:34.708539 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.708507    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:34.883129 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:34.883095    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:44:35.206076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:35.206023    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" event={"ID":"37bf0e93-c04c-4ffd-81cc-02be2449a0ee","Type":"ContainerStarted","Data":"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"}
Jul 06 19:44:35.206076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:35.206088    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" event={"ID":"37bf0e93-c04c-4ffd-81cc-02be2449a0ee","Type":"ContainerStarted","Data":"fd33794a0b9ade106137bb0db92a671a2a285d2b8eeac58a61a3c8fc3e1655ce"}
Jul 06 19:44:35.228279 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:35.228229    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" podStartSLOduration=1.228213488 podStartE2EDuration="1.228213488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:35.225482932 +0000 UTC m=+2351.185925629" watchObservedRunningTime="2026-07-06 19:44:35.228213488 +0000 UTC m=+2351.188656183"
Jul 06 19:44:35.495075 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:35.494961    2553 patch_prober.go:28] interesting pod/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:44:35.495075 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:35.495064    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:44:36.109493 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:36.109466    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:36.495101 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:36.495058    2553 patch_prober.go:28] interesting pod/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:44:36.495525 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:36.495115    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:44:37.495233 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:37.495195    2553 patch_prober.go:28] interesting pod/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:44:37.495717 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:37.495259    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:44:38.499777 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:38.499744    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:38.500662 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:38.500644    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:44:44.709552 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:44.709497    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:44.709980 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:44.709578    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:44.722011 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:44.721967    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:44:45.270881 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:44:45.270847    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:47:08.654635 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:08.654596    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:47:23.674744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:23.674684    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" podUID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" containerName="main" containerID="cri-o://c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a" gracePeriod=45
Jul 06 19:47:23.928883 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:23.928816    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:47:24.034126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.034095    2553 generic.go:356] "Generic (PLEG): container finished" podID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" containerID="c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a" exitCode=0
Jul 06 19:47:24.034328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.034147    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"
Jul 06 19:47:24.034328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.034183    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" event={"ID":"37bf0e93-c04c-4ffd-81cc-02be2449a0ee","Type":"ContainerDied","Data":"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"}
Jul 06 19:47:24.034328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.034227    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97" event={"ID":"37bf0e93-c04c-4ffd-81cc-02be2449a0ee","Type":"ContainerDied","Data":"fd33794a0b9ade106137bb0db92a671a2a285d2b8eeac58a61a3c8fc3e1655ce"}
Jul 06 19:47:24.034328 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.034244    2553 scope.go:117] "RemoveContainer" containerID="c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"
Jul 06 19:47:24.042901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.042880    2553 scope.go:117] "RemoveContainer" containerID="c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"
Jul 06 19:47:24.043221 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:47:24.043198    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a\": container with ID starting with c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a not found: ID does not exist" containerID="c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"
Jul 06 19:47:24.043304 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.043232    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a"} err="failed to get container status \"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a\": rpc error: code = NotFound desc = could not find container \"c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a\": container with ID starting with c46af226d4de80203ddf9d1e958ca1bff69cb3c975c0b8d63cdd59727a92b13a not found: ID does not exist"
Jul 06 19:47:24.065684 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065650    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfppb\" (UniqueName: \"kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.065823 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065719    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.065823 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065754    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.065931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065848    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.065931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065907    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.066070 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.065944    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir\") pod \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\" (UID: \"37bf0e93-c04c-4ffd-81cc-02be2449a0ee\") "
Jul 06 19:47:24.066070 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066007    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home" (OuterVolumeSpecName: "home") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.066166 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066111    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.066215 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066180    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.066353 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066337    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-model-cache\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.066430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066355    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tmp-dir\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.066430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.066364    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-home\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.068050 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.068025    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:47:24.068050 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.068036    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm" (OuterVolumeSpecName: "dshm") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:47:24.068166 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.068035    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb" (OuterVolumeSpecName: "kube-api-access-mfppb") pod "37bf0e93-c04c-4ffd-81cc-02be2449a0ee" (UID: "37bf0e93-c04c-4ffd-81cc-02be2449a0ee"). InnerVolumeSpecName "kube-api-access-mfppb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:47:24.172818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.172770    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfppb\" (UniqueName: \"kubernetes.io/projected/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-kube-api-access-mfppb\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.172818 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.172824    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-tls-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.173126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.172877    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37bf0e93-c04c-4ffd-81cc-02be2449a0ee-dshm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:47:24.363891 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.363853    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:47:24.366160 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:24.366136    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/auth-test-model-f22821-kserve-668f6bb687-tzr97"]
Jul 06 19:47:25.542539 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:25.542505    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" path="/var/lib/kubelet/pods/37bf0e93-c04c-4ffd-81cc-02be2449a0ee/volumes"
Jul 06 19:47:47.017632 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.017589    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:47:47.018138 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.017902    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" containerName="main"
Jul 06 19:47:47.018138 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.017912    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" containerName="main"
Jul 06 19:47:47.018138 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.017968    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="37bf0e93-c04c-4ffd-81cc-02be2449a0ee" containerName="main"
Jul 06 19:47:47.020856 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.020840    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.024252 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.024225    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"kube-root-ca.crt\""
Jul 06 19:47:47.024434 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.024347    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"openshift-service-ca.crt\""
Jul 06 19:47:47.025417 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.025401    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"default-dockercfg-4clmw\""
Jul 06 19:47:47.025494 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.025438    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f22821\"/\"sub-test-model-f22821-kserve-self-signed-certs\""
Jul 06 19:47:47.041289 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.041255    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:47:47.066297 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066264    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.066505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066317    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.066505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066369    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.066505 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066398    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.066680 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066497    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqrgb\" (UniqueName: \"kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.066680 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.066540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.167944 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.167904    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168014    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqrgb\" (UniqueName: \"kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168045    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168100    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168145    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168174    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.168692 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168643    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.169011 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.168947    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.169296 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.169267    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.171671 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.171648    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.171923 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.171904    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.184337 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.184312    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqrgb\" (UniqueName: \"kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb\") pod \"sub-test-model-f22821-kserve-65996564bf-v6zrl\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") " pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.329799 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.329702    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:47.469691 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:47.469663    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:47:47.472348 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:47:47.472323    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c07f1b6_b0ba_4e55_b7af_7c163daa14bb.slice/crio-45e1f2083982fa733abfd00720c03b69a5e239939d9d8bf99544d94b4825a2bf WatchSource:0}: Error finding container 45e1f2083982fa733abfd00720c03b69a5e239939d9d8bf99544d94b4825a2bf: Status 404 returned error can't find the container with id 45e1f2083982fa733abfd00720c03b69a5e239939d9d8bf99544d94b4825a2bf
Jul 06 19:47:48.150098 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:48.150063    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" event={"ID":"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb","Type":"ContainerStarted","Data":"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"}
Jul 06 19:47:48.150478 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:48.150105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" event={"ID":"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb","Type":"ContainerStarted","Data":"45e1f2083982fa733abfd00720c03b69a5e239939d9d8bf99544d94b4825a2bf"}
Jul 06 19:47:48.172664 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:48.172613    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" podStartSLOduration=2.172597825 podStartE2EDuration="2.172597825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:47:48.169646129 +0000 UTC m=+2544.130088827" watchObservedRunningTime="2026-07-06 19:47:48.172597825 +0000 UTC m=+2544.133040521"
Jul 06 19:47:57.330836 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:57.330792    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:57.331447 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:57.330852    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:57.343657 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:57.343632    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:47:58.210570 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:47:58.210538    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:48:54.498795 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:48:54.498760    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:49:09.518159 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.518116    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" podUID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" containerName="main" containerID="cri-o://f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38" gracePeriod=45
Jul 06 19:49:09.769905 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.769835    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:49:09.898398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898363    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898398 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898414    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898456    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqrgb\" (UniqueName: \"kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898498    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898531    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898552    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs\") pod \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\" (UID: \"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb\") "
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898696    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home" (OuterVolumeSpecName: "home") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898742    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898723    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898847    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-home\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898860    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-model-cache\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:09.898871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.898870    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tmp-dir\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:09.900654 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.900621    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:49:09.900654 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.900636    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb" (OuterVolumeSpecName: "kube-api-access-mqrgb") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "kube-api-access-mqrgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:49:09.900808 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.900664    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm" (OuterVolumeSpecName: "dshm") pod "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" (UID: "7c07f1b6-b0ba-4e55-b7af-7c163daa14bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:49:09.999560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.999501    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqrgb\" (UniqueName: \"kubernetes.io/projected/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-kube-api-access-mqrgb\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:09.999560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.999551    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-dshm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:09.999560 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:09.999563    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb-tls-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:49:10.547394 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.547361    2553 generic.go:356] "Generic (PLEG): container finished" podID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" containerID="f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38" exitCode=0
Jul 06 19:49:10.547890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.547419    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"
Jul 06 19:49:10.547890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.547450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" event={"ID":"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb","Type":"ContainerDied","Data":"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"}
Jul 06 19:49:10.547890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.547497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl" event={"ID":"7c07f1b6-b0ba-4e55-b7af-7c163daa14bb","Type":"ContainerDied","Data":"45e1f2083982fa733abfd00720c03b69a5e239939d9d8bf99544d94b4825a2bf"}
Jul 06 19:49:10.547890 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.547516    2553 scope.go:117] "RemoveContainer" containerID="f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"
Jul 06 19:49:10.557120 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.557096    2553 scope.go:117] "RemoveContainer" containerID="f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"
Jul 06 19:49:10.557409 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:10.557390    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38\": container with ID starting with f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38 not found: ID does not exist" containerID="f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"
Jul 06 19:49:10.557447 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.557420    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38"} err="failed to get container status \"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38\": rpc error: code = NotFound desc = could not find container \"f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38\": container with ID starting with f3acbae8a55f72750f74999dfa6d796d0d2f3c14fcdce84e3197dd2312213c38 not found: ID does not exist"
Jul 06 19:49:10.575326 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.575287    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:49:10.581526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:10.581493    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f22821/sub-test-model-f22821-kserve-65996564bf-v6zrl"]
Jul 06 19:49:11.542668 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:11.542637    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" path="/var/lib/kubelet/pods/7c07f1b6-b0ba-4e55-b7af-7c163daa14bb/volumes"
Jul 06 19:49:34.922132 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.922093    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:49:34.924451 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.922404    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" containerName="main"
Jul 06 19:49:34.924451 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.922414    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" containerName="main"
Jul 06 19:49:34.924451 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.922473    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c07f1b6-b0ba-4e55-b7af-7c163daa14bb" containerName="main"
Jul 06 19:49:34.925318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.925302    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.936536 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.936509    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:49:34.998134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998095    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.998134 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998136    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88fs\" (UniqueName: \"kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.998366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998176    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.998366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.998366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998231    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:34.998366 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:34.998254    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099055 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.098980    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099055 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099059    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88fs\" (UniqueName: \"kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099367 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099102    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099367 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099367 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099150    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099367 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099175    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099570 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099547    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099601    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.099633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.099618    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:35.101499 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:35.101474    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:36.099419 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:36.099376    2553 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:36.099914 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:36.099497    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs podName:de3474a0-16db-437f-af97-0f442a7f364f nodeName:}" failed. No retries permitted until 2026-07-06 19:49:36.599471746 +0000 UTC m=+2652.559914436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs") pod "rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" (UID: "de3474a0-16db-437f-af97-0f442a7f364f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:36.618095 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:36.618052    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:37.619139 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:37.619094    2553 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:37.619556 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:37.619195    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs podName:de3474a0-16db-437f-af97-0f442a7f364f nodeName:}" failed. No retries permitted until 2026-07-06 19:49:38.619176455 +0000 UTC m=+2654.579619132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs") pod "rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" (UID: "de3474a0-16db-437f-af97-0f442a7f364f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:38.634419 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:38.634377    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:39.635051 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:39.634979    2553 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:39.635538 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:39.635123    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs podName:de3474a0-16db-437f-af97-0f442a7f364f nodeName:}" failed. No retries permitted until 2026-07-06 19:49:41.635100891 +0000 UTC m=+2657.595543577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs") pod "rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" (UID: "de3474a0-16db-437f-af97-0f442a7f364f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:41.660309 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:41.660266    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:42.660677 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:42.660637    2553 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:42.661092 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:42.660717    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs podName:de3474a0-16db-437f-af97-0f442a7f364f nodeName:}" failed. No retries permitted until 2026-07-06 19:49:46.66070065 +0000 UTC m=+2662.621143327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs") pod "rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" (UID: "de3474a0-16db-437f-af97-0f442a7f364f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:46.704747 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:46.704701    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:46.944257 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:46.944210    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:49:47.705103 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:47.705064    2553 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:47.705493 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:47.705143    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs podName:de3474a0-16db-437f-af97-0f442a7f364f nodeName:}" failed. No retries permitted until 2026-07-06 19:49:55.705127791 +0000 UTC m=+2671.665570469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs") pod "rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" (UID: "de3474a0-16db-437f-af97-0f442a7f364f") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:49:51.744126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.744092    2553 generic.go:356] "Generic (PLEG): container finished" podID="0dc2bc70-f30d-49a8-8b3e-01df978dc814" containerID="ac931d1570ca34e5aa552007533f4bedfbb2e3e6cd1355213624bbeefe763186" exitCode=1
Jul 06 19:49:51.744626 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.744163    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerDied","Data":"ac931d1570ca34e5aa552007533f4bedfbb2e3e6cd1355213624bbeefe763186"}
Jul 06 19:49:51.744626 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.744532    2553 scope.go:117] "RemoveContainer" containerID="ac931d1570ca34e5aa552007533f4bedfbb2e3e6cd1355213624bbeefe763186"
Jul 06 19:49:51.744910 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.744894    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:49:51.745825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.745738    2553 generic.go:356] "Generic (PLEG): container finished" podID="f1aa07ab-30d0-4aeb-8d29-d4953870e5f5" containerID="1d35a87362d6133cb9dd95e67e357c7f6e2b7bf32b49cb80b26e1037c71cc295" exitCode=1
Jul 06 19:49:51.745825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.745812    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs" event={"ID":"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5","Type":"ContainerDied","Data":"1d35a87362d6133cb9dd95e67e357c7f6e2b7bf32b49cb80b26e1037c71cc295"}
Jul 06 19:49:51.746141 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.746125    2553 scope.go:117] "RemoveContainer" containerID="1d35a87362d6133cb9dd95e67e357c7f6e2b7bf32b49cb80b26e1037c71cc295"
Jul 06 19:49:51.750097 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.748651    2553 generic.go:356] "Generic (PLEG): container finished" podID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerID="c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72" exitCode=1
Jul 06 19:49:51.750097 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.748714    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-rvpgm" event={"ID":"f319f225-5f5c-45e0-8e07-6ac6bd4f937d","Type":"ContainerDied","Data":"c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"}
Jul 06 19:49:51.750097 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:51.749127    2553 scope.go:117] "RemoveContainer" containerID="c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"
Jul 06 19:49:52.755949 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:52.755915    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl" event={"ID":"0dc2bc70-f30d-49a8-8b3e-01df978dc814","Type":"ContainerStarted","Data":"915cbde0052f0f2bc99e2dc21c62eca7bf3b2ba15514de1b45e175d46b080d21"}
Jul 06 19:49:52.756408 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:52.756240    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:49:52.757722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:52.757700    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs" event={"ID":"f1aa07ab-30d0-4aeb-8d29-d4953870e5f5","Type":"ContainerStarted","Data":"4e971b957d5f938f74fc7993cdd12f2660e4dd21e0069f6c289ecc99f75005e0"}
Jul 06 19:49:52.757887 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:52.757874    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:49:53.269069 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:53.269020    2553 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod maas-controller-57c97645c5-rvpgm_opendatahub(f319f225-5f5c-45e0-8e07-6ac6bd4f937d): CreateContainerConfigError: failed to sync configmap cache: timed out waiting for the condition" logger="UnhandledError"
Jul 06 19:49:53.269069 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:53.269080    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CreateContainerConfigError: \"failed to sync configmap cache: timed out waiting for the condition\"" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d"
Jul 06 19:49:53.389427 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:53.389397    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:49:53.762396 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:53.762359    2553 scope.go:117] "RemoveContainer" containerID="c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"
Jul 06 19:49:53.762828 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:53.762576    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-57c97645c5-rvpgm_opendatahub(f319f225-5f5c-45e0-8e07-6ac6bd4f937d)\"" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d"
Jul 06 19:49:55.752653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.752624    2553 trace.go:236] Trace[1064164757]: "Reflector ListAndWatch" name:object-"ai-tenant-e2e-shared-b-9293de"/"openshift-service-ca.crt" (06-Jul-2026 19:49:34.925) (total time: 20827ms):
Jul 06 19:49:55.752653 ip-10-0-139-205 kubenswrapper[2553]: Trace[1064164757]: ---"Objects listed" error:<nil> 20827ms (19:49:55.752)
Jul 06 19:49:55.752653 ip-10-0-139-205 kubenswrapper[2553]: Trace[1064164757]: [20.827021133s] [20.827021133s] END
Jul 06 19:49:55.752653 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.752649    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"openshift-service-ca.crt\""
Jul 06 19:49:55.753142 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.752700    2553 trace.go:236] Trace[910685835]: "Reflector ListAndWatch" name:object-"ai-tenant-e2e-shared-b-9293de"/"kube-root-ca.crt" (06-Jul-2026 19:49:34.925) (total time: 20827ms):
Jul 06 19:49:55.753142 ip-10-0-139-205 kubenswrapper[2553]: Trace[910685835]: ---"Objects listed" error:<nil> 20827ms (19:49:55.752)
Jul 06 19:49:55.753142 ip-10-0-139-205 kubenswrapper[2553]: Trace[910685835]: [20.827202398s] [20.827202398s] END
Jul 06 19:49:55.753142 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.752717    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"kube-root-ca.crt\""
Jul 06 19:49:55.753866 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.753843    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:49:55.759918 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.759902    2553 trace.go:236] Trace[82084917]: "Reflector ListAndWatch" name:object-"ai-tenant-e2e-shared-b-9293de"/"rate-test-model-9293de-kserve-self-signed-certs" (06-Jul-2026 19:49:34.925) (total time: 20834ms):
Jul 06 19:49:55.759918 ip-10-0-139-205 kubenswrapper[2553]: Trace[82084917]: ---"Objects listed" error:<nil> 20834ms (19:49:55.759)
Jul 06 19:49:55.759918 ip-10-0-139-205 kubenswrapper[2553]: Trace[82084917]: [20.834428246s] [20.834428246s] END
Jul 06 19:49:55.760063 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.759918    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"rate-test-model-9293de-kserve-self-signed-certs\""
Jul 06 19:49:55.788535 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.788493    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:55.791051 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.791027    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:55.942677 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.942647    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:49:55.943107 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:55.943090    2553 scope.go:117] "RemoveContainer" containerID="c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"
Jul 06 19:49:55.943279 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:49:55.943261    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-57c97645c5-rvpgm_opendatahub(f319f225-5f5c-45e0-8e07-6ac6bd4f937d)\"" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d"
Jul 06 19:49:56.038460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.038378    2553 trace.go:236] Trace[1832233289]: "Reflector ListAndWatch" name:object-"ai-tenant-e2e-shared-b-9293de"/"default-dockercfg-l648m" (06-Jul-2026 19:49:34.925) (total time: 21112ms):
Jul 06 19:49:56.038460 ip-10-0-139-205 kubenswrapper[2553]: Trace[1832233289]: ---"Objects listed" error:<nil> 21112ms (19:49:56.038)
Jul 06 19:49:56.038460 ip-10-0-139-205 kubenswrapper[2553]: Trace[1832233289]: [21.112909607s] [21.112909607s] END
Jul 06 19:49:56.038460 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.038403    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9293de\"/\"default-dockercfg-l648m\""
Jul 06 19:49:56.053603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.053575    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88fs\" (UniqueName: \"kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs\") pod \"rate-test-model-9293de-kserve-7dfc5b594c-ln4mt\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") " pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:56.233933 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.233898    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:49:56.625643 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.625618    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:49:56.627897 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:49:56.627865    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde3474a0_16db_437f_af97_0f442a7f364f.slice/crio-d99f9985ca24b13163ab95e9ca05fd88bd9c496ef3df40d9b1d6f984b6ecf85a WatchSource:0}: Error finding container d99f9985ca24b13163ab95e9ca05fd88bd9c496ef3df40d9b1d6f984b6ecf85a: Status 404 returned error can't find the container with id d99f9985ca24b13163ab95e9ca05fd88bd9c496ef3df40d9b1d6f984b6ecf85a
Jul 06 19:49:56.778642 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.778609    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" event={"ID":"de3474a0-16db-437f-af97-0f442a7f364f","Type":"ContainerStarted","Data":"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"}
Jul 06 19:49:56.778642 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.778649    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" event={"ID":"de3474a0-16db-437f-af97-0f442a7f364f","Type":"ContainerStarted","Data":"d99f9985ca24b13163ab95e9ca05fd88bd9c496ef3df40d9b1d6f984b6ecf85a"}
Jul 06 19:49:56.809902 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:49:56.809847    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" podStartSLOduration=25.809829691 podStartE2EDuration="25.809829691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:49:56.809349797 +0000 UTC m=+2672.769792495" watchObservedRunningTime="2026-07-06 19:49:56.809829691 +0000 UTC m=+2672.770272387"
Jul 06 19:50:03.764731 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:03.764700    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wp6vs"
Jul 06 19:50:03.765268 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:03.764786    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-2rxsl"
Jul 06 19:50:06.234821 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:06.234778    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:50:06.235354 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:06.234839    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:50:06.247478 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:06.247445    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:50:06.536748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:06.536655    2553 scope.go:117] "RemoveContainer" containerID="c4ab4dd999e39ff7659818d36c2d120e4419d589dd43a985f2067b2fd95fef72"
Jul 06 19:50:06.840555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:06.840470    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:50:07.835728 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:07.835687    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c97645c5-rvpgm" event={"ID":"f319f225-5f5c-45e0-8e07-6ac6bd4f937d","Type":"ContainerStarted","Data":"26cb8c924d97f5c4fa3121b743876c5c506aedcae87a21eca342166d73136492"}
Jul 06 19:50:07.836248 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:07.836038    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:50:19.842526 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:19.842478    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:50:28.846633 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:28.846598    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:50:35.077960 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.077919    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:50:35.078450 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.078209    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" podUID="b6b64260-7616-4e22-a4df-aeebc2827595" containerName="maas-api" containerID="cri-o://6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5" gracePeriod=30
Jul 06 19:50:35.323465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.323438    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:50:35.432492 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.432457    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgr9q\" (UniqueName: \"kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q\") pod \"b6b64260-7616-4e22-a4df-aeebc2827595\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") "
Jul 06 19:50:35.432685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.432535    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") pod \"b6b64260-7616-4e22-a4df-aeebc2827595\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") "
Jul 06 19:50:35.432685 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.432589    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca\") pod \"b6b64260-7616-4e22-a4df-aeebc2827595\" (UID: \"b6b64260-7616-4e22-a4df-aeebc2827595\") "
Jul 06 19:50:35.432955 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.432928    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6b64260-7616-4e22-a4df-aeebc2827595" (UID: "b6b64260-7616-4e22-a4df-aeebc2827595"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:50:35.434673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.434639    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q" (OuterVolumeSpecName: "kube-api-access-bgr9q") pod "b6b64260-7616-4e22-a4df-aeebc2827595" (UID: "b6b64260-7616-4e22-a4df-aeebc2827595"). InnerVolumeSpecName "kube-api-access-bgr9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:50:35.434673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.434646    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6b64260-7616-4e22-a4df-aeebc2827595" (UID: "b6b64260-7616-4e22-a4df-aeebc2827595"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:50:35.534084 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.534045    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b64260-7616-4e22-a4df-aeebc2827595-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:50:35.534084 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.534077    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgr9q\" (UniqueName: \"kubernetes.io/projected/b6b64260-7616-4e22-a4df-aeebc2827595-kube-api-access-bgr9q\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:50:35.534084 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.534087    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6b64260-7616-4e22-a4df-aeebc2827595-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:50:35.980581 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.980548    2553 generic.go:356] "Generic (PLEG): container finished" podID="b6b64260-7616-4e22-a4df-aeebc2827595" containerID="6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5" exitCode=0
Jul 06 19:50:35.980766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.980605    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"
Jul 06 19:50:35.980766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.980613    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" event={"ID":"b6b64260-7616-4e22-a4df-aeebc2827595","Type":"ContainerDied","Data":"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"}
Jul 06 19:50:35.980766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.980669    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24" event={"ID":"b6b64260-7616-4e22-a4df-aeebc2827595","Type":"ContainerDied","Data":"8ea8a5debf0aec86f72e8dd9159bcefd3a767f67ec925159e3e155494ad71cbc"}
Jul 06 19:50:35.980766 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.980692    2553 scope.go:117] "RemoveContainer" containerID="6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"
Jul 06 19:50:35.989901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.989871    2553 scope.go:117] "RemoveContainer" containerID="6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"
Jul 06 19:50:35.990226 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:50:35.990201    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5\": container with ID starting with 6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5 not found: ID does not exist" containerID="6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"
Jul 06 19:50:35.990330 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:35.990235    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5"} err="failed to get container status \"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5\": rpc error: code = NotFound desc = could not find container \"6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5\": container with ID starting with 6ecf9b15c73bff8bed5d9afb2124ead8be73df4a9e7e9b3f1c75287185113ed5 not found: ID does not exist"
Jul 06 19:50:48.172083 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:48.172048    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:50:48.179698 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:48.179666    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f22821-8f5497654-26f24"]
Jul 06 19:50:49.543008 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:50:49.542947    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b64260-7616-4e22-a4df-aeebc2827595" path="/var/lib/kubelet/pods/b6b64260-7616-4e22-a4df-aeebc2827595/volumes"
Jul 06 19:51:43.059400 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:43.059362    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:51:43.059910 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:43.059584    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy" containerID="cri-o://ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1" gracePeriod=30
Jul 06 19:51:44.779948 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:44.779903    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:51:44.780399 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:44.780155    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" podUID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" containerName="maas-api" containerID="cri-o://4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6" gracePeriod=30
Jul 06 19:51:45.027382 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.027355    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:51:45.147598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.147510    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wnq9\" (UniqueName: \"kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9\") pod \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") "
Jul 06 19:51:45.147598 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.147571    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls\") pod \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") "
Jul 06 19:51:45.147789 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.147609    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca\") pod \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\" (UID: \"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9\") "
Jul 06 19:51:45.148056 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.148033    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" (UID: "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:45.149748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.149713    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" (UID: "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:51:45.149748 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.149713    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9" (OuterVolumeSpecName: "kube-api-access-7wnq9") pod "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" (UID: "d9e92f5f-eac9-480a-98b2-bfa6162cfdf9"). InnerVolumeSpecName "kube-api-access-7wnq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:45.248972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.248929    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wnq9\" (UniqueName: \"kubernetes.io/projected/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-kube-api-access-7wnq9\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:45.248972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.248965    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-maas-api-tls\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:45.248972 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.248975    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9-openshift-service-ca\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:45.323429 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.323395    2553 generic.go:356] "Generic (PLEG): container finished" podID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" containerID="4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6" exitCode=0
Jul 06 19:51:45.323603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.323441    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" event={"ID":"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9","Type":"ContainerDied","Data":"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"}
Jul 06 19:51:45.323603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.323480    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq" event={"ID":"d9e92f5f-eac9-480a-98b2-bfa6162cfdf9","Type":"ContainerDied","Data":"af7a18fd010a8d0c6ad3e1b569a79cac41ea0ec69814d4a11ecb4207f482db71"}
Jul 06 19:51:45.323603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.323504    2553 scope.go:117] "RemoveContainer" containerID="4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"
Jul 06 19:51:45.323603 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.323442    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"
Jul 06 19:51:45.332884 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.332864    2553 scope.go:117] "RemoveContainer" containerID="4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"
Jul 06 19:51:45.333174 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:51:45.333146    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6\": container with ID starting with 4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6 not found: ID does not exist" containerID="4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"
Jul 06 19:51:45.333277 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.333180    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6"} err="failed to get container status \"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6\": rpc error: code = NotFound desc = could not find container \"4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6\": container with ID starting with 4dde1da7304242a798035c2ed2f0919e678e380a11ed35167ab85e86928b3ec6 not found: ID does not exist"
Jul 06 19:51:45.386959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.386918    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:51:45.392357 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.392328    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-9293de-5bf6f7f4-bbjnq"]
Jul 06 19:51:45.542048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:45.541979    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" path="/var/lib/kubelet/pods/d9e92f5f-eac9-480a-98b2-bfa6162cfdf9/volumes"
Jul 06 19:51:48.307327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.307295    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:51:48.340798 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.340713    2553 generic.go:356] "Generic (PLEG): container finished" podID="f7559170-eb20-4c87-81c2-0e1342957959" containerID="ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1" exitCode=0
Jul 06 19:51:48.340798 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.340761    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"
Jul 06 19:51:48.341048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.340789    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerDied","Data":"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"}
Jul 06 19:51:48.341048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.340849    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c" event={"ID":"f7559170-eb20-4c87-81c2-0e1342957959","Type":"ContainerDied","Data":"d2a3885713d8d95a810d5b5408c08243e168b207a12a2335a056d845ce9ddec9"}
Jul 06 19:51:48.341048 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.340879    2553 scope.go:117] "RemoveContainer" containerID="ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"
Jul 06 19:51:48.349830 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.349812    2553 scope.go:117] "RemoveContainer" containerID="d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"
Jul 06 19:51:48.359348 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.359328    2553 scope.go:117] "RemoveContainer" containerID="ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"
Jul 06 19:51:48.359685 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:51:48.359647    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1\": container with ID starting with ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1 not found: ID does not exist" containerID="ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"
Jul 06 19:51:48.359787 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.359690    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1"} err="failed to get container status \"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1\": rpc error: code = NotFound desc = could not find container \"ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1\": container with ID starting with ec3d7f83943e65be8613e3615dbfadd7d96a419b8bb1cc18214f2e819aff6ce1 not found: ID does not exist"
Jul 06 19:51:48.359787 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.359717    2553 scope.go:117] "RemoveContainer" containerID="d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"
Jul 06 19:51:48.360054 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:51:48.360032    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef\": container with ID starting with d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef not found: ID does not exist" containerID="d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"
Jul 06 19:51:48.360140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.360061    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef"} err="failed to get container status \"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef\": rpc error: code = NotFound desc = could not find container \"d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef\": container with ID starting with d88ebcb56a21eaf5674fb8d52b4078bbfe699af3327b74300a57cfc4a87b6eef not found: ID does not exist"
Jul 06 19:51:48.373938 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.373908    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.373979    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374031    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374057    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374082    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374102    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4rwq\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374137    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374327 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374230    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:48.374495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374374    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:48.374495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374448    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:48.374495 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374490    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374649 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374521    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs\") pod \"f7559170-eb20-4c87-81c2-0e1342957959\" (UID: \"f7559170-eb20-4c87-81c2-0e1342957959\") "
Jul 06 19:51:48.374871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374835    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:48.374871 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374843    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.375053 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374877    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.375053 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374894    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7559170-eb20-4c87-81c2-0e1342957959-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.375053 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.374980    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:48.376594 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.376571    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:51:48.376702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.376633    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq" (OuterVolumeSpecName: "kube-api-access-n4rwq") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "kube-api-access-n4rwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:48.376752 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.376712    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:48.376786 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.376749    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7559170-eb20-4c87-81c2-0e1342957959" (UID: "f7559170-eb20-4c87-81c2-0e1342957959"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:48.475364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475322    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.475364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475355    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4rwq\" (UniqueName: \"kubernetes.io/projected/f7559170-eb20-4c87-81c2-0e1342957959-kube-api-access-n4rwq\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.475364 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475368    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.475618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475380    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7559170-eb20-4c87-81c2-0e1342957959-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.475618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475392    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.475618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.475403    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7559170-eb20-4c87-81c2-0e1342957959-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:51:48.678304 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.678221    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:51:48.679284 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:48.679260    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f22821-openshift-default-fd55ff5b7-zv68c"]
Jul 06 19:51:49.087710 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:49.087664    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:51:49.542363 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:51:49.542325    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7559170-eb20-4c87-81c2-0e1342957959" path="/var/lib/kubelet/pods/f7559170-eb20-4c87-81c2-0e1342957959/volumes"
Jul 06 19:52:04.108006 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.107927    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" podUID="de3474a0-16db-437f-af97-0f442a7f364f" containerName="main" containerID="cri-o://b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd" gracePeriod=45
Jul 06 19:52:04.360374 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.360306    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:52:04.408371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408340    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.408371 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408376    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.408600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408410    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88fs\" (UniqueName: \"kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.408600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408435    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.408600 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408484    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.408765 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408665    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home" (OuterVolumeSpecName: "home") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:04.408765 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408710    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:04.408873 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.408815    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache" (OuterVolumeSpecName: "model-cache") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:04.410581 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.410560    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm" (OuterVolumeSpecName: "dshm") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:04.410696 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.410680    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs" (OuterVolumeSpecName: "kube-api-access-j88fs") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "kube-api-access-j88fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:52:04.419318 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.419292    2553 generic.go:356] "Generic (PLEG): container finished" podID="de3474a0-16db-437f-af97-0f442a7f364f" containerID="b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd" exitCode=0
Jul 06 19:52:04.419458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.419332    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"
Jul 06 19:52:04.419458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.419365    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" event={"ID":"de3474a0-16db-437f-af97-0f442a7f364f","Type":"ContainerDied","Data":"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"}
Jul 06 19:52:04.419458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.419410    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt" event={"ID":"de3474a0-16db-437f-af97-0f442a7f364f","Type":"ContainerDied","Data":"d99f9985ca24b13163ab95e9ca05fd88bd9c496ef3df40d9b1d6f984b6ecf85a"}
Jul 06 19:52:04.419458 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.419426    2553 scope.go:117] "RemoveContainer" containerID="b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"
Jul 06 19:52:04.427670 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.427647    2553 scope.go:117] "RemoveContainer" containerID="b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"
Jul 06 19:52:04.427973 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:52:04.427950    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd\": container with ID starting with b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd not found: ID does not exist" containerID="b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"
Jul 06 19:52:04.428057 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.428007    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd"} err="failed to get container status \"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd\": rpc error: code = NotFound desc = could not find container \"b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd\": container with ID starting with b702449268316d9daafc141d96c63f5cb47406c9577ec6fbf6fea13459aa10bd not found: ID does not exist"
Jul 06 19:52:04.509384 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509346    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") pod \"de3474a0-16db-437f-af97-0f442a7f364f\" (UID: \"de3474a0-16db-437f-af97-0f442a7f364f\") "
Jul 06 19:52:04.509554 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509529    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88fs\" (UniqueName: \"kubernetes.io/projected/de3474a0-16db-437f-af97-0f442a7f364f-kube-api-access-j88fs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.509605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509563    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-tmp-dir\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.509605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509573    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-model-cache\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.509605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509581    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-home\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.509605 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.509588    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3474a0-16db-437f-af97-0f442a7f364f-dshm\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.511373 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.511349    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de3474a0-16db-437f-af97-0f442a7f364f" (UID: "de3474a0-16db-437f-af97-0f442a7f364f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:52:04.610474 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.610371    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3474a0-16db-437f-af97-0f442a7f364f-tls-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:04.765591 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.765555    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:52:04.767737 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:04.767713    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9293de/rate-test-model-9293de-kserve-7dfc5b594c-ln4mt"]
Jul 06 19:52:05.541611 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:05.541578    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3474a0-16db-437f-af97-0f442a7f364f" path="/var/lib/kubelet/pods/de3474a0-16db-437f-af97-0f442a7f364f/volumes"
Jul 06 19:52:35.962749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:35.962708    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:52:35.963229 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:35.962954    2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" containerID="cri-o://d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888" gracePeriod=30
Jul 06 19:52:36.926397 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:36.926364    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64bb688f4b-f8j44_8d4d342e-ff05-4410-bf47-ac55b1717499/authorino/0.log"
Jul 06 19:52:38.502208 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:38.502172    2553 patch_prober.go:28] interesting pod/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:52:38.502578 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:38.502237    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:52:41.214679 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.214651    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:52:41.279587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279480    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279524    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279567    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279587 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279584    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279678    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7955j\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279709    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279758    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279792    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.279931 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.279880    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:41.280243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280073    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:41.280243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280201    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:41.280243 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280215    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert\") pod \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\" (UID: \"1b91d0f6-a7ca-45f1-bfea-25d4501c5327\") "
Jul 06 19:52:41.280507 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280457    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:41.280507 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280501    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:52:41.280693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280603    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-data\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.280693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280621    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.280693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280636    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-credential-socket\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.280693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280649    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-workload-certs\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.280693 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.280664    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istiod-ca-cert\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.282017 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.281968    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:52:41.282137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.282034    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:52:41.282137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.282010    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j" (OuterVolumeSpecName: "kube-api-access-7955j") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "kube-api-access-7955j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:52:41.282137 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.282093    2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b91d0f6-a7ca-45f1-bfea-25d4501c5327" (UID: "1b91d0f6-a7ca-45f1-bfea-25d4501c5327"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:52:41.381969 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.381929    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-podinfo\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.381969 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.381960    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-token\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.381969 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.381972    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-istio-envoy\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.382240 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.381980    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7955j\" (UniqueName: \"kubernetes.io/projected/1b91d0f6-a7ca-45f1-bfea-25d4501c5327-kube-api-access-7955j\") on node \"ip-10-0-139-205.ec2.internal\" DevicePath \"\""
Jul 06 19:52:41.593144 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.593111    2553 generic.go:356] "Generic (PLEG): container finished" podID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerID="d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888" exitCode=0
Jul 06 19:52:41.593321 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.593156    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"
Jul 06 19:52:41.593321 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.593159    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerDied","Data":"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"}
Jul 06 19:52:41.593321 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.593266    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f" event={"ID":"1b91d0f6-a7ca-45f1-bfea-25d4501c5327","Type":"ContainerDied","Data":"349beb799ebeb83a1d66310d12bdbfd82fbf62ea2e00c022f17fd8df868de70e"}
Jul 06 19:52:41.593321 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.593289    2553 scope.go:117] "RemoveContainer" containerID="d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"
Jul 06 19:52:41.601837 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.601818    2553 scope.go:117] "RemoveContainer" containerID="f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"
Jul 06 19:52:41.609909 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.609892    2553 scope.go:117] "RemoveContainer" containerID="d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"
Jul 06 19:52:41.610223 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:52:41.610201    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888\": container with ID starting with d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888 not found: ID does not exist" containerID="d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"
Jul 06 19:52:41.610301 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.610232    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888"} err="failed to get container status \"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888\": rpc error: code = NotFound desc = could not find container \"d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888\": container with ID starting with d8ec7684a09ac23ebc0cd4af572fcccc53aff2f64c652aca7874c3da8a9cd888 not found: ID does not exist"
Jul 06 19:52:41.610301 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.610250    2553 scope.go:117] "RemoveContainer" containerID="f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"
Jul 06 19:52:41.610488 ip-10-0-139-205 kubenswrapper[2553]: E0706 19:52:41.610470    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5\": container with ID starting with f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5 not found: ID does not exist" containerID="f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"
Jul 06 19:52:41.610544 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.610499    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5"} err="failed to get container status \"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5\": rpc error: code = NotFound desc = could not find container \"f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5\": container with ID starting with f17043c1a0796cc1770cd7adb0e3c9d9536dcd11d4f5a5dd574d9140c5f32dc5 not found: ID does not exist"
Jul 06 19:52:41.629639 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.629603    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:52:41.631625 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:41.631605    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9293de-openshift-default-6b8b5cdd7-bj68f"]
Jul 06 19:52:42.675465 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:42.675423    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57c97645c5-rvpgm_f319f225-5f5c-45e0-8e07-6ac6bd4f937d/manager/1.log"
Jul 06 19:52:42.944076 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:42.944042    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wp6vs_f1aa07ab-30d0-4aeb-8d29-d4953870e5f5/manager/1.log"
Jul 06 19:52:43.057618 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:43.057594    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-2rxsl_0dc2bc70-f30d-49a8-8b3e-01df978dc814/copy-manifests/0.log"
Jul 06 19:52:43.067483 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:43.067441    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-2rxsl_0dc2bc70-f30d-49a8-8b3e-01df978dc814/manager/1.log"
Jul 06 19:52:43.541878 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:43.541847    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" path="/var/lib/kubelet/pods/1b91d0f6-a7ca-45f1-bfea-25d4501c5327/volumes"
Jul 06 19:52:44.235932 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.235899    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/util/0.log"
Jul 06 19:52:44.245543 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.245515    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/pull/0.log"
Jul 06 19:52:44.255527 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.255504    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/extract/0.log"
Jul 06 19:52:44.376457 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.376423    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/util/0.log"
Jul 06 19:52:44.385112 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.385087    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/pull/0.log"
Jul 06 19:52:44.393746 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.393724    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/extract/0.log"
Jul 06 19:52:44.515529 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.515450    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/util/0.log"
Jul 06 19:52:44.524913 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.524882    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/pull/0.log"
Jul 06 19:52:44.535102 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.535073    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/extract/0.log"
Jul 06 19:52:44.645434 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.645401    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/util/0.log"
Jul 06 19:52:44.654081 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.654049    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/pull/0.log"
Jul 06 19:52:44.662292 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.662270    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/extract/0.log"
Jul 06 19:52:44.789500 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:44.789412    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64bb688f4b-f8j44_8d4d342e-ff05-4410-bf47-ac55b1717499/authorino/0.log"
Jul 06 19:52:46.243873 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:46.243845    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48xhkb_89e42ab3-f7f7-4bf4-972e-574e5ee33b40/istio-proxy/0.log"
Jul 06 19:52:46.602735 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:46.602651    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-tfwlf_b66ada90-5c83-4fae-910a-e841dd6a3fcf/kube-auth-proxy/0.log"
Jul 06 19:52:47.819886 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:47.819856    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p2hrk_301b22d5-5ea6-43d6-97a8-e04dfed40123/main/0.log"
Jul 06 19:52:55.865792 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.865760    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mrhbq/must-gather-n4hx4"]
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866050    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866063    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866073    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b64260-7616-4e22-a4df-aeebc2827595" containerName="maas-api"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866079    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b64260-7616-4e22-a4df-aeebc2827595" containerName="maas-api"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866086    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866092    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866105    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866111    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866118    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" containerName="maas-api"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866124    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" containerName="maas-api"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866131    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3474a0-16db-437f-af97-0f442a7f364f" containerName="main"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866136    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3474a0-16db-437f-af97-0f442a7f364f" containerName="main"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866145    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866150    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866198    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866206    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866213    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e92f5f-eac9-480a-98b2-bfa6162cfdf9" containerName="maas-api"
Jul 06 19:52:55.866212 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866218    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7559170-eb20-4c87-81c2-0e1342957959" containerName="istio-proxy"
Jul 06 19:52:55.866756 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866224    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b64260-7616-4e22-a4df-aeebc2827595" containerName="maas-api"
Jul 06 19:52:55.866756 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866230    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3474a0-16db-437f-af97-0f442a7f364f" containerName="main"
Jul 06 19:52:55.866756 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.866309    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b91d0f6-a7ca-45f1-bfea-25d4501c5327" containerName="istio-proxy"
Jul 06 19:52:55.870674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.870653    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:55.878674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.878652    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mrhbq\"/\"default-dockercfg-8w4wr\""
Jul 06 19:52:55.878825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.878708    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"kube-root-ca.crt\""
Jul 06 19:52:55.878825 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:55.878743    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"openshift-service-ca.crt\""
Jul 06 19:52:56.003320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.003261    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdx5\" (UniqueName: \"kubernetes.io/projected/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-kube-api-access-wrdx5\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.003320 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.003335    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-must-gather-output\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.104577 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.104518    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdx5\" (UniqueName: \"kubernetes.io/projected/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-kube-api-access-wrdx5\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.104784 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.104687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-must-gather-output\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.105083 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.105063    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-must-gather-output\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.115608 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.115580    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdx5\" (UniqueName: \"kubernetes.io/projected/eb1a8fbc-3e62-4a21-ae8e-d68b1194e704-kube-api-access-wrdx5\") pod \"must-gather-n4hx4\" (UID: \"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704\") " pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:56.179610 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:56.179520    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/must-gather-n4hx4"
Jul 06 19:52:58.748151 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:58.748116    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/must-gather-n4hx4"]
Jul 06 19:52:58.927875 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:58.927848    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/must-gather-n4hx4"]
Jul 06 19:52:58.929927 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:52:58.929901    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb1a8fbc_3e62_4a21_ae8e_d68b1194e704.slice/crio-711ecf7587bf6b16a71d3c25c42a43854aa49a51dab355ad0a64bd31cd21abc3 WatchSource:0}: Error finding container 711ecf7587bf6b16a71d3c25c42a43854aa49a51dab355ad0a64bd31cd21abc3: Status 404 returned error can't find the container with id 711ecf7587bf6b16a71d3c25c42a43854aa49a51dab355ad0a64bd31cd21abc3
Jul 06 19:52:59.680126 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:52:59.680090    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/must-gather-n4hx4" event={"ID":"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704","Type":"ContainerStarted","Data":"711ecf7587bf6b16a71d3c25c42a43854aa49a51dab355ad0a64bd31cd21abc3"}
Jul 06 19:53:00.686672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:00.686635    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/must-gather-n4hx4" event={"ID":"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704","Type":"ContainerStarted","Data":"83c369d67326f8ce67f13e6bbfa08b127c3778a1c83a4d1d2ed2bcff4941b378"}
Jul 06 19:53:00.686672 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:00.686683    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/must-gather-n4hx4" event={"ID":"eb1a8fbc-3e62-4a21-ae8e-d68b1194e704","Type":"ContainerStarted","Data":"26fbd3235c6f2a1b7d0bca09e993a3f32f29302c6717354f8607080c1eac4101"}
Jul 06 19:53:00.708032 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:00.707967    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mrhbq/must-gather-n4hx4" podStartSLOduration=6.93378939 podStartE2EDuration="7.707950387s" totalImagesPullingTime="774.160997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:53:00.706226649 +0000 UTC m=+2856.666669338" watchObservedRunningTime="2026-07-06 19:53:00.707950387 +0000 UTC m=+2856.668393092"
Jul 06 19:53:20.485401 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:20.485368    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b2tnr_baa3ecdd-36fb-4ccb-8a59-f6e9031a26af/global-pull-secret-syncer/0.log"
Jul 06 19:53:20.710422 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:20.710356    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s7ckj_2d0947be-97f3-47ba-82df-f223cb340477/konnectivity-agent/0.log"
Jul 06 19:53:24.084555 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:24.084520    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-205.ec2.internal_fd9d432a42d5b3ab5cf95848f892c920/haproxy/0.log"
Jul 06 19:53:39.842507 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:39.842456    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:53:47.913901 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:47.913861    2553 generic.go:356] "Generic (PLEG): container finished" podID="e9bcac1f-130e-420e-9c2d-d7f4a42590f6" containerID="256bc47e86f047a9ec1a497e93b3b4837f7bb956fea3a7427088ffb89285ef5e" exitCode=1
Jul 06 19:53:47.914322 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:47.913934    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq" event={"ID":"e9bcac1f-130e-420e-9c2d-d7f4a42590f6","Type":"ContainerDied","Data":"256bc47e86f047a9ec1a497e93b3b4837f7bb956fea3a7427088ffb89285ef5e"}
Jul 06 19:53:47.914322 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:47.914294    2553 scope.go:117] "RemoveContainer" containerID="256bc47e86f047a9ec1a497e93b3b4837f7bb956fea3a7427088ffb89285ef5e"
Jul 06 19:53:48.920277 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:48.920243    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq" event={"ID":"e9bcac1f-130e-420e-9c2d-d7f4a42590f6","Type":"ContainerStarted","Data":"e956d8518bec98c45d71a327d2d6bd9cca18daaad4d1820b17743b67581a0918"}
Jul 06 19:53:48.920682 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:48.920456    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:53:59.842729 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:59.842681    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:53:59.926765 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:53:59.926733    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-ktnqq"
Jul 06 19:54:07.019674 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:07.019610    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/extract/0.log"
Jul 06 19:54:09.842702 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:09.842657    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:54:12.555332 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:12.555295    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/util/0.log"
Jul 06 19:54:13.184432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:13.184400    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978bgq_5f4245be-8853-4638-91e5-74504d7d86a1/pull/0.log"
Jul 06 19:54:13.711507 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:13.711472    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/extract/0.log"
Jul 06 19:54:14.116810 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:14.116728    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/util/0.log"
Jul 06 19:54:19.842673 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:19.842618    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-57c97645c5-rvpgm" podUID="f319f225-5f5c-45e0-8e07-6ac6bd4f937d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:54:19.843202 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:19.842760    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:54:19.868125 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:19.868087    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c97645c5-rvpgm"
Jul 06 19:54:26.719001 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.718955    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"]
Jul 06 19:54:26.724140 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.724118    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.757335 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.757297    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"]
Jul 06 19:54:26.770415 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.770380    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md6nh\" (UniqueName: \"kubernetes.io/projected/126c8391-6687-4b20-8492-e4ba895dc02b-kube-api-access-md6nh\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.770604 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.770433    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-sys\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.770604 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.770489    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-lib-modules\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.770604 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.770514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-podres\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.770604 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.770539    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-proc\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871520 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871485    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-sys\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871540    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-lib-modules\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-podres\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871595    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-proc\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871666    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md6nh\" (UniqueName: \"kubernetes.io/projected/126c8391-6687-4b20-8492-e4ba895dc02b-kube-api-access-md6nh\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871722 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871690    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-podres\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871713    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-proc\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871764    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-lib-modules\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.871959 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.871772    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126c8391-6687-4b20-8492-e4ba895dc02b-sys\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:26.910489 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:26.910453    2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md6nh\" (UniqueName: \"kubernetes.io/projected/126c8391-6687-4b20-8492-e4ba895dc02b-kube-api-access-md6nh\") pod \"perf-node-gather-daemonset-qxrrh\" (UID: \"126c8391-6687-4b20-8492-e4ba895dc02b\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:27.036432 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.036348    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:27.111666 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.111630    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jc6f4_086f8e56-8631-47c8-b356-f383cf6f25bf/pull/0.log"
Jul 06 19:54:27.342730 ip-10-0-139-205 kubenswrapper[2553]: W0706 19:54:27.342695    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod126c8391_6687_4b20_8492_e4ba895dc02b.slice/crio-d5fe84174ab425f24a5d976b86d7aa8ac82d7debaf560442e6915b4b6797a179 WatchSource:0}: Error finding container d5fe84174ab425f24a5d976b86d7aa8ac82d7debaf560442e6915b4b6797a179: Status 404 returned error can't find the container with id d5fe84174ab425f24a5d976b86d7aa8ac82d7debaf560442e6915b4b6797a179
Jul 06 19:54:27.350442 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.350419    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"]
Jul 06 19:54:27.390430 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.390396    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/extract/0.log"
Jul 06 19:54:27.629819 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.629720    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/util/0.log"
Jul 06 19:54:27.694422 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.694387    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7365w25_c0627a33-bd5b-4a1d-a9b8-991b2bf721e4/pull/0.log"
Jul 06 19:54:27.870099 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.870062    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/extract/0.log"
Jul 06 19:54:27.982588 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:27.982552    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/util/0.log"
Jul 06 19:54:28.059080 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.059044    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w52zm_2962b1c2-ef12-45bd-bfe2-3b5b2af6c5f0/pull/0.log"
Jul 06 19:54:28.130251 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.130216    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh" event={"ID":"126c8391-6687-4b20-8492-e4ba895dc02b","Type":"ContainerStarted","Data":"6d79f0f8d8213680c4779f68eb48b4d92bbdece7359d7aa2a565791b2ae84e2a"}
Jul 06 19:54:28.130436 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.130278    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh" event={"ID":"126c8391-6687-4b20-8492-e4ba895dc02b","Type":"ContainerStarted","Data":"d5fe84174ab425f24a5d976b86d7aa8ac82d7debaf560442e6915b4b6797a179"}
Jul 06 19:54:28.130436 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.130310    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:28.182006 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.181929    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh" podStartSLOduration=6.181912404 podStartE2EDuration="6.181912404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:28.181690682 +0000 UTC m=+2944.142133392" watchObservedRunningTime="2026-07-06 19:54:28.181912404 +0000 UTC m=+2944.142355099"
Jul 06 19:54:28.821042 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:28.821006    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64bb688f4b-f8j44_8d4d342e-ff05-4410-bf47-ac55b1717499/authorino/0.log"
Jul 06 19:54:33.347962 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:33.347914    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcqxn_8d28d30a-8ee5-40f1-9169-4b90b03a945c/node-exporter/0.log"
Jul 06 19:54:33.386830 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:33.386800    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcqxn_8d28d30a-8ee5-40f1-9169-4b90b03a945c/kube-rbac-proxy/0.log"
Jul 06 19:54:33.425102 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:33.425070    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcqxn_8d28d30a-8ee5-40f1-9169-4b90b03a945c/init-textfile/0.log"
Jul 06 19:54:34.145946 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:34.145919    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-qxrrh"
Jul 06 19:54:38.294360 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:38.294329    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48xhkb_89e42ab3-f7f7-4bf4-972e-574e5ee33b40/istio-proxy/0.log"
Jul 06 19:54:38.531436 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:38.531397    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-tfwlf_b66ada90-5c83-4fae-910a-e841dd6a3fcf/kube-auth-proxy/0.log"
Jul 06 19:54:40.343031 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:40.342919    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48xhkb_89e42ab3-f7f7-4bf4-972e-574e5ee33b40/istio-proxy/0.log"
Jul 06 19:54:40.555749 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:40.555716    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-tfwlf_b66ada90-5c83-4fae-910a-e841dd6a3fcf/kube-auth-proxy/0.log"
Jul 06 19:54:41.678051 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:41.678019    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rxvlr_d82b552b-ffc3-445e-a031-16f12723ce1e/dns/0.log"
Jul 06 19:54:41.753663 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:41.753630    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rxvlr_d82b552b-ffc3-445e-a031-16f12723ce1e/kube-rbac-proxy/0.log"
Jul 06 19:54:41.927808 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:41.927773    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcbj4_76c488b3-de9c-459b-988f-b516c8a7994a/dns-node-resolver/0.log"
Jul 06 19:54:42.895619 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:42.895588    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zh59_19932c8f-4f2e-4d20-9e78-b5a05eeb0184/node-ca/0.log"
Jul 06 19:54:44.068744 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:44.068712    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48xhkb_89e42ab3-f7f7-4bf4-972e-574e5ee33b40/istio-proxy/0.log"
Jul 06 19:54:44.352386 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:44.352280    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9b6c5cb8-tfwlf_b66ada90-5c83-4fae-910a-e841dd6a3fcf/kube-auth-proxy/0.log"
Jul 06 19:54:45.446486 ip-10-0-139-205 kubenswrapper[2553]: I0706 19:54:45.446450    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvz4b_92f8eab0-7d31-41a8-8713-9423b9b05017/serve-healthcheck-canary/0.log"