Jul 06 23:56:09.432697 ip-10-0-141-102 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.857926    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861870    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861883    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861887    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861890    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861893    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861896    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861899    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:09.868242 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861902    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861904    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861907    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861909    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861912    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861914    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861917    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861920    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861922    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861925    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861930    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861935    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861938    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861941    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861944    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861947    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861950    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861953    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861956    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:09.871684 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861958    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861962    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861965    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861968    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861971    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861973    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861976    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861979    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861981    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861984    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861987    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861990    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861993    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861995    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.861998    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862001    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862003    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862005    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862008    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:09.875690 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862010    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862014    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862018    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862021    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862024    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862035    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862038    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862042    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862046    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862049    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862052    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862055    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862058    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862060    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862063    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862066    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862068    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862071    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862073    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:09.878598 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862076    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862078    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862081    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862084    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862086    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862089    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862091    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862095    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862098    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862100    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862103    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862105    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862108    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862110    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862113    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862115    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862118    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862121    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862123    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862126    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:09.882120 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862128    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862131    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862134    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862136    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862139    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862141    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862145    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862147    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862149    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862152    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862155    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862157    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862160    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862163    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862165    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862878    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862885    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862888    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862891    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862893    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:09.885131 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862903    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862906    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862911    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862915    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862918    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862921    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862925    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862928    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862931    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862934    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862937    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862940    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862943    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862946    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862950    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862953    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862956    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862960    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862962    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:09.889373 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862965    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862967    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862972    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862976    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862979    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862982    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862985    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862993    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862996    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.862998    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863001    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863004    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863006    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863009    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863011    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863014    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863017    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863020    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863023    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863025    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:09.892691 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863028    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863031    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863034    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863037    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863039    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863042    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863044    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863046    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863049    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863051    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863054    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863057    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863059    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863062    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863065    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863067    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863070    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863072    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863075    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863077    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:09.896755 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863080    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863082    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863084    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863087    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863090    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863092    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863095    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863098    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863101    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863104    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863106    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863110    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863113    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863116    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863118    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863120    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863123    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863125    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863128    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863131    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:09.899834 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863134    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863137    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863139    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863142    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863144    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863146    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863149    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863151    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863154    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863157    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863160    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863162    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863164    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863167    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863170    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863548    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863554    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863556    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863559    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:09.904294 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863562    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863565    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863568    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863571    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863575    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863578    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863580    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863583    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863585    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863588    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863590    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863593    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863596    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863598    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863601    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863603    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863607    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863610    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863612    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863615    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:09.907161 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863617    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863620    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863622    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863625    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863629    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863632    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863635    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863638    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863640    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863643    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863646    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863649    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863652    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863655    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863657    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863660    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863664    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863667    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863669    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863672    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:09.910714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863674    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863677    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863679    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863682    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863684    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863687    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863691    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863695    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863699    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863701    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863704    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863707    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863710    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863712    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863716    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863718    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863721    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863723    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863726    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:09.913536 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863728    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863731    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863733    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863736    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863739    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863741    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863744    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863746    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863749    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863753    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863755    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863758    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863760    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863763    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863765    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863768    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863771    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863774    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863776    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863779    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863782    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:09.917529 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863786    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863788    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863791    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863793    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863796    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863798    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863801    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863803    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863806    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863809    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863812    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863815    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863817    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863820    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.863822    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863889    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863896    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863901    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863905    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863910    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863914    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:56:09.920454 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863918    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863922    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863925    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863928    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863932    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863935    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863938    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863941    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863944    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863947    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863950    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863954    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863959    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863962    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863965    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863968    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863971    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863975    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863978    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863981    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863984    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863987    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863990    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863993    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:56:09.924325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863996    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.863998    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864002    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864005    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864008    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864011    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864014    2574 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864019    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864023    2574 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864026    2574 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864029    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864032    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864034    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864038    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864041    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864044    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864047    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864050    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864053    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864058    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864061    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864063    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864066    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864069    2574 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864073    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:56:09.927921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864076    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864079    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864082    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864085    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864088    2574 flags.go:64] FLAG: --help="false"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864090    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-102.ec2.internal"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864094    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864097    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864100    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864103    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864106    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864109    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864112    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864115    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864120    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864123    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864126    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864128    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864131    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864134    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864137    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864140    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864143    2574 flags.go:64] FLAG: --lock-file=""
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864145    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:56:09.932800 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864148    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:56:09.930285 ip-10-0-141-102 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864151    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864158    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864161    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864163    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864166    2574 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864169    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864172    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864175    2574 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864177    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864182    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864184    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864189    2574 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864192    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864195    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864198    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864201    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864203    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864206    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864209    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864216    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864219    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864223    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:56:10.135474 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864226    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864229    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864234    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864237    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864241    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864244    2574 flags.go:64] FLAG: --port="10250"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864247    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864249    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b6dfaa912593c2ba"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864253    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864256    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864259    2574 flags.go:64] FLAG: --register-node="true"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864263    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864266    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864269    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864272    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864274    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864278    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864281    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864284    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864287    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864290    2574 flags.go:64] FLAG: --runonce="false"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864293    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864296    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864299    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864302    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:56:10.160280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864304    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864307    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864310    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864313    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864316    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864318    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864321    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864327    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864330    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864334    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864337    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864342    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864345    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864348    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864352    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864355    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864358    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864361    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864368    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864371    2574 flags.go:64] FLAG: --v="2"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864374    2574 flags.go:64] FLAG: --version="false"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864378    2574 flags.go:64] FLAG: --vmodule=""
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864382    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.864385    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864511    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:10.170981 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864515    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864518    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864521    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864524    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864527    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864529    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864532    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864535    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864537    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864540    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864542    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864545    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864548    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864551    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864555    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864558    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864560    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864564    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864567    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864569    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:10.172162 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864572    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864574    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864577    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864579    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864582    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864586    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864589    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864591    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864594    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864597    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864599    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864602    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864604    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864607    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864610    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864612    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864615    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864617    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864620    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864623    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:10.172919 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864625    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864628    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864630    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864633    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864636    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864638    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864643    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864646    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864649    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864651    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864654    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864657    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864659    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864662    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864665    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864667    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864670    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864674    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864676    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864678    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:10.173714 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864681    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864683    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864686    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864690    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864693    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864696    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864699    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864702    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864705    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864708    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864711    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864714    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864718    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864721    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864724    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864727    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864729    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864732    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864736    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864738    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:10.174896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864741    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864743    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864746    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864749    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864752    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864754    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864757    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864759    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864762    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864765    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864768    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864770    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864773    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864777    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864780    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864783    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864785    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:10.175674 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.864788    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.865306    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.873390    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.873422    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.873443    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.873450    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873508    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873513    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873516    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873519    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873523    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873526    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873528    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873532    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873535    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:10.176486 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873538    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873541    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873544    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873547    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873550    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873553    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873556    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873558    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873560    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873563    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873566    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873569    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873571    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873574    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873576    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873578    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873582    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873585    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873588    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873591    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:10.177283 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873594    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873596    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873599    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873601    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873605    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873610    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873613    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873616    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873619    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873621    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873624    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873627    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873629    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873632    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873634    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873637    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873640    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873642    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873645    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:10.178052 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873647    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873650    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873652    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873655    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873657    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873660    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873663    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873666    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873669    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873671    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873674    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873679    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873683    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873686    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873689    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873692    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873695    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873698    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873702    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873705    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:10.178889 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873708    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873711    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873714    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873717    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873719    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873722    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873725    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873729    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873733    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873736    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873739    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873742    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873744    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873747    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873749    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873752    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873754    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873757    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873760    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873762    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:10.179617 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873765    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873767    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873770    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873776    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873778    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873781    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873784    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873786    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873789    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873792    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873795    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.873800    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873910    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873916    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873919    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:56:10.180367 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873922    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873925    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873928    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873931    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873934    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873937    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873939    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873942    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873945    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873948    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873951    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873954    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873956    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873959    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873961    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873964    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873966    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873969    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873971    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873974    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:56:10.181158 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873977    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873980    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873983    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873985    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873988    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873990    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873993    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873995    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.873999    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874002    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874004    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874007    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874009    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874012    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874014    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874017    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874019    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874022    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874024    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874034    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:56:10.181914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874037    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874039    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874043    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874046    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874048    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874051    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874053    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874056    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874059    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874062    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874066    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874069    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874073    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874075    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874078    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874081    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874083    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874085    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874088    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:56:10.182708 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874091    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874095    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874097    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874100    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874102    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874105    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874108    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874110    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874113    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874115    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874118    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874120    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874123    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874125    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874128    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874130    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874133    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874137    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874140    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:56:10.183590 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874143    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874145    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874148    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874151    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874153    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874157    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874161    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874164    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874167    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874169    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874172    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874175    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874178    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874181    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874185    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874187    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874190    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:56:10.184336 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:09.874193    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.874198    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.874302    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.876317    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.877734    2574 server.go:1019] "Starting client certificate rotation"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.877828    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.877863    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.880159    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.881331    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.891221    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.896032    2574 log.go:25] "Validated CRI v1 image API"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.896813    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:56:10.185178 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.898964    2574 fs.go:135] Filesystem UUIDs: map[0cdb9570-cb91-4d50-9083-981551d63094:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f984dfc0-ee14-45f6-ab27-645ce1532748:/dev/nvme0n1p4]
Jul 06 23:56:10.185576 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.898979    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.904810    2574 manager.go:216] Machine: {Timestamp:2026-07-06 23:56:09.904318692 +0000 UTC m=+0.357746281 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102235 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1525e010be2dc57b91201bec37ae SystemUUID:ec2d1525-e010-be2d-c57b-91201bec37ae BootID:4f0e7b8f-6c01-4193-8d5f-5fbffb33aee6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:6a:b8:eb:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:6a:b8:eb:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:25:fe:3a:d6:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.904911    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.904990    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.907790    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.907823    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.908618    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.908627    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:56:10.185996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.908635    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.909713    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.910214    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.911517    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915379    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915506    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915534    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915543    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915557    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915566    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915574    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915896    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.915923    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.920470    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.922515    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.922553    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924104    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924122    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924130    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924139    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924151    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924158    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924170    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924178    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924187    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924194    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924207    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.924215    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.925275    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.925593    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.925607    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.928234    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.929476    2574 server.go:1268] "Started kubelet"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.929647    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.929708    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.930245    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.931534    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.931718    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.937639    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-87jt5"
Jul 06 23:56:10.289008 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.939118    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.940018    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.940918    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-87jt5"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.940032    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-102.ec2.internal.18bfd8a28168ea18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-102.ec2.internal,UID:ip-10-0-141-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-102.ec2.internal,},FirstTimestamp:2026-07-06 23:56:09.929443864 +0000 UTC m=+0.382871451,LastTimestamp:2026-07-06 23:56:09.929443864 +0000 UTC m=+0.382871451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-102.ec2.internal,}"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.942514    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.942520    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.942889    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.943219    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.943235    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.943351    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.943447    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.943454    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946480    2574 factory.go:55] Registering systemd factory
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946496    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946688    2574 factory.go:153] Registering CRI-O factory
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946698    2574 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946748    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946774    2574 factory.go:103] Registering Raw factory
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.946788    2574 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.947185    2574 manager.go:349] Starting recovery of all containers
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.950101    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:09.955393    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-102.ec2.internal\" not found" node="ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.957082    2574 manager.go:354] Recovery completed
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.962632    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964332    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964364    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964378    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964888    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964899    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964903    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.964918    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.965615    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.965641    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.965654    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.966967    2574 policy_none.go:49] "None policy: Start"
Jul 06 23:56:10.290983 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.966980    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.966990    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.968963    2574 policy_none.go:47] "Start"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:09.999986    2574 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.000014    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000026    2574 server.go:87] "Starting device plugin registration server"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000258    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000271    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000375    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000485    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.000494    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.000856    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.000906    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.080601    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.081808    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.081846    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.081871    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.081904    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.084680    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.100983    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.101950    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.101983    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.101993    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.102016    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.110983    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.111005    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-102.ec2.internal\": node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.129551    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.182892    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"]
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.182966    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.184756    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.184783    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.184793    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.186859    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.186960    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.186988    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.187523    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.187550    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.301306 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.187566    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.188154    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.188179    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.188190    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.189533    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.189557    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.190207    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.190227    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.190239    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.230303    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.244627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.244653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.302502 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.244671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/669e63d0e24cd24225c0314e3e07d651-config\") pod \"kube-apiserver-proxy-ip-10-0-141-102.ec2.internal\" (UID: \"669e63d0e24cd24225c0314e3e07d651\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.331376    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/669e63d0e24cd24225c0314e3e07d651-config\") pod \"kube-apiserver-proxy-ip-10-0-141-102.ec2.internal\" (UID: \"669e63d0e24cd24225c0314e3e07d651\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345772    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345776    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cade813ad6c67610171daf5ad175751e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" (UID: \"cade813ad6c67610171daf5ad175751e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.401943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.345776    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/669e63d0e24cd24225c0314e3e07d651-config\") pod \"kube-apiserver-proxy-ip-10-0-141-102.ec2.internal\" (UID: \"669e63d0e24cd24225c0314e3e07d651\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:10.514977 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.432053    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.631995 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.532511    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.633606 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.632965    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.744264 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.733413    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.853785 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.833788    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.877102    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.877261    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.877265    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:10.933965    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-102.ec2.internal\" not found"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.947288    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:51:09 +0000 UTC" deadline="2028-03-18 15:56:07.330245126 +0000 UTC"
Jul 06 23:56:10.965791 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.947313    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14895h59m56.382934606s"
Jul 06 23:56:11.088034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:10.989270    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:11.088034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.043703    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.088034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.052941    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:56:11.088034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.054443    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.088034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.063830    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:56:11.220270 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.219324    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.223532 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.222800    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.231436    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:11.231477    2574 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.231600    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:11.231639    2574 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-102.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.232846    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.234419    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal"
Jul 06 23:56:11.323443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.258150    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:11.916604 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.916344    2574 apiserver.go:52] "Watching apiserver"
Jul 06 23:56:11.926147 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.926123    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:56:11.926487 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.926468    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-94mm4","kube-system/konnectivity-agent-ccs99","kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal","openshift-image-registry/node-ca-x6k8g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-wnt6x","openshift-network-operator/iptables-alerter-fl2ls","openshift-ovn-kubernetes/ovnkube-node-krvhq","kube-system/global-pull-secret-syncer-g79jh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4","openshift-cluster-node-tuning-operator/tuned-m9286","openshift-dns/node-resolver-wvbt9","openshift-multus/multus-dqd92","openshift-multus/network-metrics-daemon-wbx2j"]
Jul 06 23:56:11.928820 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.928803    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:11.930801 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.930784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.931300 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.931276    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.931422 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.931303    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:56:11.931422 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.931280    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hcl9l\""
Jul 06 23:56:11.931422 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.931275    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.932782 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.932762    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.932872 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.932815    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:11.932872 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.932847    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dsjpt\""
Jul 06 23:56:11.932980 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:11.932874    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:11.933258 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.933243    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.934702 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.934687    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:11.936733 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.936714    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.936827 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.936781    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.937043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.937025    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:56:11.937121 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.937097    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.937182 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.937153    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-llfkr\""
Jul 06 23:56:11.938796 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.938771    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:56:11.938873 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.938861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.940227 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.939911    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dwxvx\""
Jul 06 23:56:11.940227 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940170    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.940227 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940183    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:56:11.940394 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940321    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.940394 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940327    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:56:11.940491 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940468    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:56:11.940802 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940790    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:56:11.940881 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940869    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:56:11.940952 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.940939    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.941078 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.941064    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:56:11.941152 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.941135    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vjxhh\""
Jul 06 23:56:11.941243 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.941230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.942199 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.942182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:11.942280 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:11.942259    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:11.942632 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.942616    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:56:11.944350 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.944334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.946384 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.946367    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:56:11.946490 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.946432    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:11.946490 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.946456    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bsc6f\""
Jul 06 23:56:11.948331 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.948317    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:56:11.948646 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.948628    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:56:11.948845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.948828    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xxfhz\""
Jul 06 23:56:11.949145 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.949128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:11.951154 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.951044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:56:11.951501 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.951485    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.951854    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-dbus\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-log-socket\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-tuned\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-node-log\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952223    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkwdr\""
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-daemon-config\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:11.952277    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4241f42-0fec-4c55-b899-2a0e3340032b-iptables-alerter-script\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-sys\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-tmp\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvhl\" (UniqueName: \"kubernetes.io/projected/f08d4da7-4eb7-456b-a086-831798d8e938-kube-api-access-ftvhl\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.952672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-var-lib-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-etc-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-env-overrides\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952865    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-script-lib\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cnibin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.952981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-kubelet\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9zb\" (UniqueName: \"kubernetes.io/projected/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-kube-api-access-rl9zb\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-system-cni-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-cnibin\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.953263 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmhk\" (UniqueName: \"kubernetes.io/projected/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-kube-api-access-ggmhk\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953281    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-lib-modules\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq66m\" (UniqueName: \"kubernetes.io/projected/06b39bed-9d98-4db1-8b61-5804382e47dc-kube-api-access-sq66m\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zml7\" (UniqueName: \"kubernetes.io/projected/2f736d39-4899-47e1-b662-cd7f285ab88e-kube-api-access-4zml7\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-systemd-units\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953493    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-bin\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysconfig\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-kubelet-config\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cni-binary-copy\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-netns\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.953813 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psptw\" (UniqueName: \"kubernetes.io/projected/d4241f42-0fec-4c55-b899-2a0e3340032b-kube-api-access-psptw\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-run\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953759    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-systemd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-system-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953859    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-os-release\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4241f42-0fec-4c55-b899-2a0e3340032b-host-slash\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.953927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-conf\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-netns\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-netd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-etc-kubernetes\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-host\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:11.954294 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-ovn\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954228    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-multus\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-hostroot\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-modprobe-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-systemd\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-var-lib-kubelet\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-multus-certs\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-config\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-bin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4mm\" (UniqueName: \"kubernetes.io/projected/9afe82ac-b0e3-4672-8737-922343ce7e96-kube-api-access-pl4mm\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.954845 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954845    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06b39bed-9d98-4db1-8b61-5804382e47dc-host\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-kubelet\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-k8s-cni-cncf-io\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.954982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-conf-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-slash\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955031    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-kubernetes\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06b39bed-9d98-4db1-8b61-5804382e47dc-serviceca\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-os-release\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:11.955203 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.955110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-socket-dir-parent\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:11.957002 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.956988    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bz4s5\""
Jul 06 23:56:11.957164 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.957148    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:56:11.957273 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.957257    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:56:11.979920 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.979900    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j6nds"
Jul 06 23:56:11.986553 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:11.986532    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j6nds"
Jul 06 23:56:12.044262 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.044241    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:56:12.055510 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4mm\" (UniqueName: \"kubernetes.io/projected/9afe82ac-b0e3-4672-8737-922343ce7e96-kube-api-access-pl4mm\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.055510 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06b39bed-9d98-4db1-8b61-5804382e47dc-host\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-kubelet\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-k8s-cni-cncf-io\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055578    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-conf-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055601    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-kubelet\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055631    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-k8s-cni-cncf-io\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-slash\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055672    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06b39bed-9d98-4db1-8b61-5804382e47dc-host\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055673    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-slash\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.055704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-kubernetes\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06b39bed-9d98-4db1-8b61-5804382e47dc-serviceca\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055716    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-conf-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055731    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055755    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-kubernetes\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-os-release\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-socket-dir-parent\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe27f5d-5983-4afd-8fce-081e37d7fbea-hosts-file\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055851    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-os-release\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-dbus\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-log-socket\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055887    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-dbus\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-registration-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe27f5d-5983-4afd-8fce-081e37d7fbea-tmp-dir\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055857    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-socket-dir-parent\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.056174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1570fc8-58c0-437f-bf05-8024712c3edb-konnectivity-ca\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055944    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-log-socket\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-tuned\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.055983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-node-log\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-daemon-config\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-node-log\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p86zl\" (UniqueName: \"kubernetes.io/projected/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kube-api-access-p86zl\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4241f42-0fec-4c55-b899-2a0e3340032b-iptables-alerter-script\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-sys\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-tmp\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvhl\" (UniqueName: \"kubernetes.io/projected/f08d4da7-4eb7-456b-a086-831798d8e938-kube-api-access-ftvhl\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.057043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056234    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-sys\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056255    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06b39bed-9d98-4db1-8b61-5804382e47dc-serviceca\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056258    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056275    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-var-lib-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.056350    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-etc-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056453    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056491    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-etc-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056538    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-var-lib-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.056564    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:12.556392256 +0000 UTC m=+3.009819849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056580    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-multus-daemon-config\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.057766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-env-overrides\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-script-lib\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056707    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056723    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4241f42-0fec-4c55-b899-2a0e3340032b-iptables-alerter-script\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cnibin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-kubelet\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9zb\" (UniqueName: \"kubernetes.io/projected/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-kube-api-access-rl9zb\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-system-cni-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-cnibin\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056903    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-kubelet\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmhk\" (UniqueName: \"kubernetes.io/projected/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-kube-api-access-ggmhk\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058388 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.056994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxqp\" (UniqueName: \"kubernetes.io/projected/0fe27f5d-5983-4afd-8fce-081e37d7fbea-kube-api-access-pmxqp\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057005    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cnibin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-lib-modules\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057038    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-env-overrides\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq66m\" (UniqueName: \"kubernetes.io/projected/06b39bed-9d98-4db1-8b61-5804382e47dc-kube-api-access-sq66m\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-system-cni-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zml7\" (UniqueName: \"kubernetes.io/projected/2f736d39-4899-47e1-b662-cd7f285ab88e-kube-api-access-4zml7\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-systemd-units\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-bin\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-socket-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysconfig\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057230    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-script-lib\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.058949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-kubelet-config\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cni-binary-copy\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-netns\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057298    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-cnibin\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psptw\" (UniqueName: \"kubernetes.io/projected/d4241f42-0fec-4c55-b899-2a0e3340032b-kube-api-access-psptw\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-run\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-systemd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057352    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysconfig\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057372    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057380    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-lib-modules\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-system-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057399    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-systemd-units\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-os-release\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057462    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-bin\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.059459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4241f42-0fec-4c55-b899-2a0e3340032b-host-slash\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-conf\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057516    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-run\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-netns\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-netd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057647    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08d4da7-4eb7-456b-a086-831798d8e938-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057659    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-cni-netd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057673    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-os-release\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057705    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4241f42-0fec-4c55-b899-2a0e3340032b-host-slash\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057725    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-systemd\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-etc-kubernetes\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057759    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d2aa0af-89af-448c-a456-d15cdcf16afc-kubelet-config\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-device-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057802    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-sysctl-conf\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.060126 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-host\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057861    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-etc-kubernetes\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057867    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-ovn\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057916    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-host-run-netns\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-ovn\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057949    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-system-cni-dir\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057973    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-host\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-run-openvswitch\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.057982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-multus\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.058006    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058016    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-multus\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-hostroot\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.058049    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:12.558034042 +0000 UTC m=+3.011461626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058063    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.060663 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-netns\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058065    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-cni-binary-copy\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-sys-fs\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-hostroot\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-modprobe-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-systemd\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058187    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-systemd\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-var-lib-kubelet\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058263    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-var-lib-kubelet\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058228    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-modprobe-d\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058289    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08d4da7-4eb7-456b-a086-831798d8e938-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-multus-certs\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1570fc8-58c0-437f-bf05-8024712c3edb-agent-certs\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.061077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058304    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-run-multus-certs\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-config\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-bin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.058554    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-host-var-lib-cni-bin\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.059126    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovnkube-config\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.059815    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-tmp\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.059899    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9afe82ac-b0e3-4672-8737-922343ce7e96-etc-tuned\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.061524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.060201    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.073925 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.073892    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zml7\" (UniqueName: \"kubernetes.io/projected/2f736d39-4899-47e1-b662-cd7f285ab88e-kube-api-access-4zml7\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:12.075930 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.075903    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq66m\" (UniqueName: \"kubernetes.io/projected/06b39bed-9d98-4db1-8b61-5804382e47dc-kube-api-access-sq66m\") pod \"node-ca-x6k8g\" (UID: \"06b39bed-9d98-4db1-8b61-5804382e47dc\") " pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.076655 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.076638    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4mm\" (UniqueName: \"kubernetes.io/projected/9afe82ac-b0e3-4672-8737-922343ce7e96-kube-api-access-pl4mm\") pod \"tuned-m9286\" (UID: \"9afe82ac-b0e3-4672-8737-922343ce7e96\") " pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.077010 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.076995    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9zb\" (UniqueName: \"kubernetes.io/projected/c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b-kube-api-access-rl9zb\") pod \"multus-dqd92\" (UID: \"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b\") " pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.077954 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.077930    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvhl\" (UniqueName: \"kubernetes.io/projected/f08d4da7-4eb7-456b-a086-831798d8e938-kube-api-access-ftvhl\") pod \"multus-additional-cni-plugins-wnt6x\" (UID: \"f08d4da7-4eb7-456b-a086-831798d8e938\") " pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.078040 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.077974    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psptw\" (UniqueName: \"kubernetes.io/projected/d4241f42-0fec-4c55-b899-2a0e3340032b-kube-api-access-psptw\") pod \"iptables-alerter-fl2ls\" (UID: \"d4241f42-0fec-4c55-b899-2a0e3340032b\") " pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.078179 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.078162    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmhk\" (UniqueName: \"kubernetes.io/projected/d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b-kube-api-access-ggmhk\") pod \"ovnkube-node-krvhq\" (UID: \"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.099102 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.099079    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:12.113591 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.113561    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:56:12.159550 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe27f5d-5983-4afd-8fce-081e37d7fbea-hosts-file\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.159550 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-registration-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe27f5d-5983-4afd-8fce-081e37d7fbea-tmp-dir\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1570fc8-58c0-437f-bf05-8024712c3edb-konnectivity-ca\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p86zl\" (UniqueName: \"kubernetes.io/projected/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kube-api-access-p86zl\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159661    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe27f5d-5983-4afd-8fce-081e37d7fbea-hosts-file\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159661    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-registration-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxqp\" (UniqueName: \"kubernetes.io/projected/0fe27f5d-5983-4afd-8fce-081e37d7fbea-kube-api-access-pmxqp\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-socket-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159737    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-device-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.159775 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159760    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159810    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-device-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-sys-fs\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1570fc8-58c0-437f-bf05-8024712c3edb-agent-certs\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159886    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe27f5d-5983-4afd-8fce-081e37d7fbea-tmp-dir\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159906    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-socket-dir\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.159937    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-sys-fs\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.160297 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.160184    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1570fc8-58c0-437f-bf05-8024712c3edb-konnectivity-ca\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.161992 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.161976    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1570fc8-58c0-437f-bf05-8024712c3edb-agent-certs\") pod \"konnectivity-agent-ccs99\" (UID: \"e1570fc8-58c0-437f-bf05-8024712c3edb\") " pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.165441 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.165419    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:12.165441 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.165441    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:12.165612 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.165451    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:12.165612 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.165515    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:12.665500212 +0000 UTC m=+3.118927809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:12.167331 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.167281    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxqp\" (UniqueName: \"kubernetes.io/projected/0fe27f5d-5983-4afd-8fce-081e37d7fbea-kube-api-access-pmxqp\") pod \"node-resolver-wvbt9\" (UID: \"0fe27f5d-5983-4afd-8fce-081e37d7fbea\") " pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.167439 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.167394    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p86zl\" (UniqueName: \"kubernetes.io/projected/2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5-kube-api-access-p86zl\") pod \"aws-ebs-csi-driver-node-nqzz4\" (UID: \"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.199326 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.199287    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669e63d0e24cd24225c0314e3e07d651.slice/crio-036d72814b5b258dc5730e63db4ae75255052fa841224a3d0db98786272f36f1 WatchSource:0}: Error finding container 036d72814b5b258dc5730e63db4ae75255052fa841224a3d0db98786272f36f1: Status 404 returned error can't find the container with id 036d72814b5b258dc5730e63db4ae75255052fa841224a3d0db98786272f36f1
Jul 06 23:56:12.199664 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.199630    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcade813ad6c67610171daf5ad175751e.slice/crio-7d9d0fbd82b3e0d8d0fcae480f1feff95006d8634fd44968b49c0839b1dd2d2d WatchSource:0}: Error finding container 7d9d0fbd82b3e0d8d0fcae480f1feff95006d8634fd44968b49c0839b1dd2d2d: Status 404 returned error can't find the container with id 7d9d0fbd82b3e0d8d0fcae480f1feff95006d8634fd44968b49c0839b1dd2d2d
Jul 06 23:56:12.205312 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.205296    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:56:12.251965 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.251929    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fl2ls"
Jul 06 23:56:12.262447 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.262424    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4241f42_0fec_4c55_b899_2a0e3340032b.slice/crio-87eb96b2aface34c7840776678144c58c18ea743cc25b7a207490a7b0fd2efc9 WatchSource:0}: Error finding container 87eb96b2aface34c7840776678144c58c18ea743cc25b7a207490a7b0fd2efc9: Status 404 returned error can't find the container with id 87eb96b2aface34c7840776678144c58c18ea743cc25b7a207490a7b0fd2efc9
Jul 06 23:56:12.275246 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.275224    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9286"
Jul 06 23:56:12.282896 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.282872    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afe82ac_b0e3_4672_8737_922343ce7e96.slice/crio-6f7b24533df6ff7aff1adb620e1453e403998e7e8366d0709ee0e21617e8588c WatchSource:0}: Error finding container 6f7b24533df6ff7aff1adb620e1453e403998e7e8366d0709ee0e21617e8588c: Status 404 returned error can't find the container with id 6f7b24533df6ff7aff1adb620e1453e403998e7e8366d0709ee0e21617e8588c
Jul 06 23:56:12.295398 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.295381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x6k8g"
Jul 06 23:56:12.304239 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.304219    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b39bed_9d98_4db1_8b61_5804382e47dc.slice/crio-261d807d087069144dfa795b4103f3057ec0237bc057d2ca3b04309758c3e0d5 WatchSource:0}: Error finding container 261d807d087069144dfa795b4103f3057ec0237bc057d2ca3b04309758c3e0d5: Status 404 returned error can't find the container with id 261d807d087069144dfa795b4103f3057ec0237bc057d2ca3b04309758c3e0d5
Jul 06 23:56:12.315500 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.315473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:12.323973 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.323950    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aac35b_8788_4cd4_8e95_d5ff9cf22f9b.slice/crio-5e1d2f50db9e3d3c2cfb3f14fbec3c554c730e6ac488c1f20cc4c502bcccad0e WatchSource:0}: Error finding container 5e1d2f50db9e3d3c2cfb3f14fbec3c554c730e6ac488c1f20cc4c502bcccad0e: Status 404 returned error can't find the container with id 5e1d2f50db9e3d3c2cfb3f14fbec3c554c730e6ac488c1f20cc4c502bcccad0e
Jul 06 23:56:12.329919 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.329901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wnt6x"
Jul 06 23:56:12.338913 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.338891    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08d4da7_4eb7_456b_a086_831798d8e938.slice/crio-12f96b585e04b1b4746a492f665328aee8f250a0ac9981c557ab8488e83963f4 WatchSource:0}: Error finding container 12f96b585e04b1b4746a492f665328aee8f250a0ac9981c557ab8488e83963f4: Status 404 returned error can't find the container with id 12f96b585e04b1b4746a492f665328aee8f250a0ac9981c557ab8488e83963f4
Jul 06 23:56:12.343933 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.343917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dqd92"
Jul 06 23:56:12.351610 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.351591    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c2bf5f_3d63_47cf_8d1a_1d95a1dc3c9b.slice/crio-63657826c43269a159700329e9f6fd51e988620492e304df97541ee55838517e WatchSource:0}: Error finding container 63657826c43269a159700329e9f6fd51e988620492e304df97541ee55838517e: Status 404 returned error can't find the container with id 63657826c43269a159700329e9f6fd51e988620492e304df97541ee55838517e
Jul 06 23:56:12.367380 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.367361    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:12.375284 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.375267    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4"
Jul 06 23:56:12.375652 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.375631    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1570fc8_58c0_437f_bf05_8024712c3edb.slice/crio-f7f000f9dd86dac24e1d134e5dd1c208d37895b83bee373cd6dd1663a51b9424 WatchSource:0}: Error finding container f7f000f9dd86dac24e1d134e5dd1c208d37895b83bee373cd6dd1663a51b9424: Status 404 returned error can't find the container with id f7f000f9dd86dac24e1d134e5dd1c208d37895b83bee373cd6dd1663a51b9424
Jul 06 23:56:12.382390 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.382371    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wvbt9"
Jul 06 23:56:12.382978 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.382959    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbd9fa0_971c_46d0_8ae1_e96ea0aa03e5.slice/crio-33522c1ee51672645a7db85381615bce2a28b96661140065a546305ebe7a7142 WatchSource:0}: Error finding container 33522c1ee51672645a7db85381615bce2a28b96661140065a546305ebe7a7142: Status 404 returned error can't find the container with id 33522c1ee51672645a7db85381615bce2a28b96661140065a546305ebe7a7142
Jul 06 23:56:12.391175 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:12.391154    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe27f5d_5983_4afd_8fce_081e37d7fbea.slice/crio-5d4bac36db8d092688301488fae6abe862a425edb57dd7e472b64d6977071f1f WatchSource:0}: Error finding container 5d4bac36db8d092688301488fae6abe862a425edb57dd7e472b64d6977071f1f: Status 404 returned error can't find the container with id 5d4bac36db8d092688301488fae6abe862a425edb57dd7e472b64d6977071f1f
Jul 06 23:56:12.392921 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.392901    2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-wvbt9_openshift-dns(0fe27f5d-5983-4afd-8fce-081e37d7fbea): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 06 23:56:12.393003 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.392939    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-wvbt9" podUID="0fe27f5d-5983-4afd-8fce-081e37d7fbea"
Jul 06 23:56:12.563835 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.563764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:12.563835 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.563820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:12.564039 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.563909    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:12.564039 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.563907    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:12.564039 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.563958    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.563943318 +0000 UTC m=+4.017370896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:12.564039 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.563995    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.563975671 +0000 UTC m=+4.017403245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:12.617376 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.617313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"5e1d2f50db9e3d3c2cfb3f14fbec3c554c730e6ac488c1f20cc4c502bcccad0e"}
Jul 06 23:56:12.618799 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.618768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal" event={"ID":"669e63d0e24cd24225c0314e3e07d651","Type":"ContainerStarted","Data":"036d72814b5b258dc5730e63db4ae75255052fa841224a3d0db98786272f36f1"}
Jul 06 23:56:12.620392 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.620366    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal" event={"ID":"cade813ad6c67610171daf5ad175751e","Type":"ContainerStarted","Data":"7d9d0fbd82b3e0d8d0fcae480f1feff95006d8634fd44968b49c0839b1dd2d2d"}
Jul 06 23:56:12.622087 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.622060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvbt9" event={"ID":"0fe27f5d-5983-4afd-8fce-081e37d7fbea","Type":"ContainerStarted","Data":"5d4bac36db8d092688301488fae6abe862a425edb57dd7e472b64d6977071f1f"}
Jul 06 23:56:12.624648 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.624267    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-wvbt9" podUID="0fe27f5d-5983-4afd-8fce-081e37d7fbea"
Jul 06 23:56:12.625117 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.625093    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4" event={"ID":"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5","Type":"ContainerStarted","Data":"33522c1ee51672645a7db85381615bce2a28b96661140065a546305ebe7a7142"}
Jul 06 23:56:12.633832 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.633796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccs99" event={"ID":"e1570fc8-58c0-437f-bf05-8024712c3edb","Type":"ContainerStarted","Data":"f7f000f9dd86dac24e1d134e5dd1c208d37895b83bee373cd6dd1663a51b9424"}
Jul 06 23:56:12.636001 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.635958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dqd92" event={"ID":"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b","Type":"ContainerStarted","Data":"63657826c43269a159700329e9f6fd51e988620492e304df97541ee55838517e"}
Jul 06 23:56:12.637510 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.637451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerStarted","Data":"12f96b585e04b1b4746a492f665328aee8f250a0ac9981c557ab8488e83963f4"}
Jul 06 23:56:12.640366 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.640298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x6k8g" event={"ID":"06b39bed-9d98-4db1-8b61-5804382e47dc","Type":"ContainerStarted","Data":"261d807d087069144dfa795b4103f3057ec0237bc057d2ca3b04309758c3e0d5"}
Jul 06 23:56:12.642150 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.642094    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9286" event={"ID":"9afe82ac-b0e3-4672-8737-922343ce7e96","Type":"ContainerStarted","Data":"6f7b24533df6ff7aff1adb620e1453e403998e7e8366d0709ee0e21617e8588c"}
Jul 06 23:56:12.644216 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.644192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fl2ls" event={"ID":"d4241f42-0fec-4c55-b899-2a0e3340032b","Type":"ContainerStarted","Data":"87eb96b2aface34c7840776678144c58c18ea743cc25b7a207490a7b0fd2efc9"}
Jul 06 23:56:12.764859 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.764823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:12.765061 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.765036    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:12.765133 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.765072    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:12.765133 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.765088    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:12.765239 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:12.765153    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.765132691 +0000 UTC m=+4.218560268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:12.989288 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.989159    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:51:11 +0000 UTC" deadline="2027-12-17 09:40:40.986415847 +0000 UTC"
Jul 06 23:56:12.989288 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:12.989237    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12681h44m27.99718299s"
Jul 06 23:56:13.083375 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.082624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:13.083375 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.082861    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:13.083375 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.082942    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:13.083375 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.083040    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:13.569797 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.569763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:13.569985 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.569835    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:13.569985 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.569953    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:13.570098 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.570022    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:15.569994164 +0000 UTC m=+6.023421755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:13.570098 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.570092    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:13.570201 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.570129    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:15.570116185 +0000 UTC m=+6.023543774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:13.771392 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.771355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:13.771589 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.771567    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:13.771653 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.771592    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:13.771653 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.771605    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:13.771759 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:13.771662    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:15.771645358 +0000 UTC m=+6.225072947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:13.990468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.990364    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:51:11 +0000 UTC" deadline="2028-02-21 13:49:09.197563122 +0000 UTC"
Jul 06 23:56:13.990468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:13.990419    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14269h52m55.207149617s"
Jul 06 23:56:14.082760 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:14.082217    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:14.082760 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:14.082349    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:15.082487 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:15.082452    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:15.083061 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.082586    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:15.083061 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:15.082651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:15.083061 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.082730    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:15.586119 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:15.586081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:15.586298 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:15.586159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:15.586298 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.586273    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:15.586440 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.586333    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.586314773 +0000 UTC m=+10.039742362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:15.586440 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.586273    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:15.586566 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.586440    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.586419355 +0000 UTC m=+10.039846948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:15.789110 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:15.788441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:15.789110 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.788680    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:15.789110 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.788699    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:15.789110 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.788712    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:15.789110 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:15.788769    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.788751225 +0000 UTC m=+10.242178819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:16.084290 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:16.084257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:16.084780 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:16.084395    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:17.082184 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:17.082144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:17.082334 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:17.082276    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:17.082735 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:17.082703    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:17.082833 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:17.082814    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:18.083225 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:18.083190    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:18.083695 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:18.083331    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:19.082184 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:19.082149    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:19.082352 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:19.082206    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:19.082352 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.082289    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:19.082509 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.082477    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:19.622348 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:19.622315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:19.622852 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:19.622386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:19.622852 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.622482    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:19.622852 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.622518    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:19.622852 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.622539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:27.622522423 +0000 UTC m=+18.075950001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:19.622852 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.622586    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:27.622569326 +0000 UTC m=+18.075996921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:19.824160 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:19.824121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:19.824350 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.824328    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:19.824350 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.824351    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:19.824568 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.824365    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:19.824568 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:19.824450    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:27.824429805 +0000 UTC m=+18.277857383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:20.084261 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:20.084228    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:20.084457 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:20.084363    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:21.082313 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:21.082277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:21.082739 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:21.082485    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:21.082939 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:21.082921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:21.083027 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:21.083010    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:22.082529 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:22.082497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:22.082964 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:22.082625    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:23.082374 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:23.082334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:23.082539 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:23.082372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:23.082539 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:23.082486    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:23.082948 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:23.082627    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:24.082832 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:24.082794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:24.083292 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:24.082914    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:25.082588 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:25.082547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:25.082783 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:25.082553    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:25.082783 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:25.082669    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:25.082887 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:25.082788    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:26.082892 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:26.082855    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:26.083350 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:26.082989    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:27.082735 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:27.082696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:27.082901 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:27.082696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:27.082901 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.082820    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:27.082901 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.082875    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:27.684859 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:27.684823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:27.685061 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:27.684993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:27.685061 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.685021    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:27.685158 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.685102    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:43.685078578 +0000 UTC m=+34.138506218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:27.685158 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.685128    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:27.685253 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.685179    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:43.685164705 +0000 UTC m=+34.138592285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:27.887381 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:27.887346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:27.887556 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.887521    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:27.887556 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.887539    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:27.887556 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.887549    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:27.887723 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:27.887600    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:43.88758388 +0000 UTC m=+34.341011674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:28.083070 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:28.083013    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:28.083512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:28.083156    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:29.082949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:29.082915    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:29.083123 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:29.082919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:29.083123 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:29.083044    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:29.083557 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:29.083138    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:30.083720 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:30.083681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:30.084156 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:30.083805    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:31.083109 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:31.083068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:31.083301 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:31.083067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:31.083301 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:31.083203    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:31.083397 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:31.083302    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:32.083133 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.082971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:32.083464 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:32.083206    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:32.693276 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.692944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dqd92" event={"ID":"c2c2bf5f-3d63-47cf-8d1a-1d95a1dc3c9b","Type":"ContainerStarted","Data":"714048969a96365fee98a771aaea75b8306bd580d5beefc31d184d9bb2721f64"}
Jul 06 23:56:32.694543 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.694520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9286" event={"ID":"9afe82ac-b0e3-4672-8737-922343ce7e96","Type":"ContainerStarted","Data":"1d578cd586e9c8fceb3b9c76a668263266e49e913d769543cecbf39ed56a562c"}
Jul 06 23:56:32.698100 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.697938    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 06 23:56:32.698532 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.698503    2574 generic.go:356] "Generic (PLEG): container finished" podID="d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b" containerID="f524e452a20619a152554380e2d0b09fcdd540e44d981a9e27fdc83c6b0ddb03" exitCode=1
Jul 06 23:56:32.698677 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.698647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"f41c55395bd63db7b1fef60a4d2f03e39d0587a1248150097024ec70dd98748d"}
Jul 06 23:56:32.700771 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.700392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"7d67da36d5bebaba713c25dd62c81ca2ba1a571672bd30a7bd0832226a35a840"}
Jul 06 23:56:32.700771 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.700565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"a5e7b5fcb4edbb3805b3e177cb9a698a8730fdfa76711c325f5f56e0dceda341"}
Jul 06 23:56:32.700771 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.700652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"19286ee057caa8853b2b5efbdb0a5fc3e3454396ec5c7bb6cc16264f1540b7fb"}
Jul 06 23:56:32.700771 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.700767    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerDied","Data":"f524e452a20619a152554380e2d0b09fcdd540e44d981a9e27fdc83c6b0ddb03"}
Jul 06 23:56:32.700958 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.700859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"853f8940b2c49912fea9f7a33db9254c9e0ef617b1ed14f0bcbf36c29a05bc55"}
Jul 06 23:56:32.703046 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.703009    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal" event={"ID":"669e63d0e24cd24225c0314e3e07d651","Type":"ContainerStarted","Data":"62fdcc2474034d1d0043f422223533fd59bdcd478c230432901af28424d5fc52"}
Jul 06 23:56:32.716960 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.716917    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dqd92" podStartSLOduration=3.339234214 podStartE2EDuration="22.716903098s" totalImagesPullingTime="19.377668884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:32.716548245 +0000 UTC m=+23.169975835" watchObservedRunningTime="2026-07-06 23:56:32.716903098 +0000 UTC m=+23.170330694"
Jul 06 23:56:32.734797 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.734755    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-102.ec2.internal" podStartSLOduration=21.734739924 podStartE2EDuration="21.734739924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:32.734217775 +0000 UTC m=+23.187645370" watchObservedRunningTime="2026-07-06 23:56:32.734739924 +0000 UTC m=+23.188167520"
Jul 06 23:56:32.754034 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:32.753498    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9286" podStartSLOduration=3.368475684 podStartE2EDuration="22.753382685s" totalImagesPullingTime="19.384907001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:32.752641553 +0000 UTC m=+23.206069152" watchObservedRunningTime="2026-07-06 23:56:32.753382685 +0000 UTC m=+23.206810282"
Jul 06 23:56:33.082957 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.082928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:33.083125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.082930    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:33.083165 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:33.083125    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:33.083165 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:33.083023    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:33.706134 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.706090    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fl2ls" event={"ID":"d4241f42-0fec-4c55-b899-2a0e3340032b","Type":"ContainerStarted","Data":"2d331e950231a43f4c48f4f0aadf1912121dc1a6d04d08ceefa693e421821a60"}
Jul 06 23:56:33.707657 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.707475    2574 generic.go:356] "Generic (PLEG): container finished" podID="cade813ad6c67610171daf5ad175751e" containerID="dae5342e8ac217a322e4d1e70e684d5224f1bb0aca50e900dd8c0ec74be228f3" exitCode=0
Jul 06 23:56:33.707765 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.707565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal" event={"ID":"cade813ad6c67610171daf5ad175751e","Type":"ContainerDied","Data":"dae5342e8ac217a322e4d1e70e684d5224f1bb0aca50e900dd8c0ec74be228f3"}
Jul 06 23:56:33.709154 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.709130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wvbt9" event={"ID":"0fe27f5d-5983-4afd-8fce-081e37d7fbea","Type":"ContainerStarted","Data":"da7353d531961c02a4306ece6e44287ebe2f8aed1b2f3cf690e4eb6cf166fedc"}
Jul 06 23:56:33.710612 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.710592    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4" event={"ID":"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5","Type":"ContainerStarted","Data":"d03334f068623101bc9c54d466f8024487a59fe254afee889279f684c70d04e0"}
Jul 06 23:56:33.711853 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.711831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ccs99" event={"ID":"e1570fc8-58c0-437f-bf05-8024712c3edb","Type":"ContainerStarted","Data":"662cb885fddfa7e00fcbc7975a8f786e05aad8ec5f37966b9108c83116759a48"}
Jul 06 23:56:33.713125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.713099    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="547982f4157e98634fa57b12eafdd0d0ab436a15a3ec88c2717d8d76486b59ac" exitCode=0
Jul 06 23:56:33.713214 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.713162    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"547982f4157e98634fa57b12eafdd0d0ab436a15a3ec88c2717d8d76486b59ac"}
Jul 06 23:56:33.714003 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.713982    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:33.714695 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.714668    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x6k8g" event={"ID":"06b39bed-9d98-4db1-8b61-5804382e47dc","Type":"ContainerStarted","Data":"80bd29439b2175ff2e70d73abe9267e62c6d6b307d529f9eac6e31b92ade4ef8"}
Jul 06 23:56:33.715231 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.715215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:33.721290 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.721242    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fl2ls" podStartSLOduration=4.318122995 podStartE2EDuration="23.72122913s" totalImagesPullingTime="19.403106135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:33.720690928 +0000 UTC m=+24.174118524" watchObservedRunningTime="2026-07-06 23:56:33.72122913 +0000 UTC m=+24.174656725"
Jul 06 23:56:33.761885 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.761830    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wvbt9" podStartSLOduration=23.761815164 podStartE2EDuration="23.761815164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 23:56:33.747966857 +0000 UTC m=+24.201394454" watchObservedRunningTime="2026-07-06 23:56:33.761815164 +0000 UTC m=+24.215242761"
Jul 06 23:56:33.762214 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.762177    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x6k8g" podStartSLOduration=4.40036975 podStartE2EDuration="23.76216683s" totalImagesPullingTime="19.36179708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:33.761935275 +0000 UTC m=+24.215362871" watchObservedRunningTime="2026-07-06 23:56:33.76216683 +0000 UTC m=+24.215594427"
Jul 06 23:56:33.799327 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:33.799282    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ccs99" podStartSLOduration=4.508895376 podStartE2EDuration="23.799265801s" totalImagesPullingTime="19.290370425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:33.798926798 +0000 UTC m=+24.252354395" watchObservedRunningTime="2026-07-06 23:56:33.799265801 +0000 UTC m=+24.252693398"
Jul 06 23:56:34.083163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:34.083136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:34.083547 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:34.083240    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:34.106560 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:34.106526    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:56:34.719757 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:34.719712    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal" event={"ID":"cade813ad6c67610171daf5ad175751e","Type":"ContainerStarted","Data":"292ad011546885f1fb1c685c9e47dff1182d051f8435a3a902631745ae48e042"}
Jul 06 23:56:34.723010 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:34.722742    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4" event={"ID":"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5","Type":"ContainerStarted","Data":"e3a5819029a83c7fc1fc7f06e45f138dec32c4698284b838a2aabc0fa6cf7cce"}
Jul 06 23:56:34.735498 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:34.735455    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-102.ec2.internal" podStartSLOduration=23.735441095 podStartE2EDuration="23.735441095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:34.734577388 +0000 UTC m=+25.188004986" watchObservedRunningTime="2026-07-06 23:56:34.735441095 +0000 UTC m=+25.188868691"
Jul 06 23:56:35.013619 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.013462    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:56:34.106548464Z","UUID":"54ea9c46-1548-48ca-9f6f-e9628550f17e","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:56:35.015043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.015022    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:56:35.015173 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.015057    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:56:35.082158 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.082122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:35.082325 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:35.082246    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:35.082325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.082301    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:35.082473 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:35.082447    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:35.728042 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.727950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4" event={"ID":"2fbd9fa0-971c-46d0-8ae1-e96ea0aa03e5","Type":"ContainerStarted","Data":"c0277ee3c68bd4b5d065969c9c46cf7b4440439782658a2426cbbc182fb503c5"}
Jul 06 23:56:35.731322 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.731301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 06 23:56:35.731752 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.731729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"33915cc2108c63fd854e95f32d2eca15ea247de070506025d0c2f5eb8c7b15f8"}
Jul 06 23:56:35.732020 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.731999    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:56:35.747080 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:35.747025    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqzz4" podStartSLOduration=4.0270181 podStartE2EDuration="25.747009838s" totalImagesPullingTime="21.719991738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:35.746612825 +0000 UTC m=+26.200040435" watchObservedRunningTime="2026-07-06 23:56:35.747009838 +0000 UTC m=+26.200437434"
Jul 06 23:56:36.082516 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.082485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:36.082685 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:36.082660    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:36.674238 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.674201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:36.761235 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.761195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:36.974302 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.974226    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:36.974482 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.974398    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:56:36.975018 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:36.974994    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ccs99"
Jul 06 23:56:37.038936 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:37.038896    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:37.082996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:37.082956    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:37.082996 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:37.082976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:37.083231 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:37.083107    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:37.083231 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:37.083213    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:38.082624 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.082464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:38.083130 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:38.082733    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:38.463435 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.463392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:38.563459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.563427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:38.739274 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.739197    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="13f22bd4ecff868a02fe326836e5a25dbf422f8669d2a270e1a35af94a1ed7a1" exitCode=0
Jul 06 23:56:38.739435 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.739280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"13f22bd4ecff868a02fe326836e5a25dbf422f8669d2a270e1a35af94a1ed7a1"}
Jul 06 23:56:38.742682 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.742663    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 06 23:56:38.743025 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.743005    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"09741b7e98e4f80df7790eeb4435bb0d122dd6b336c407dde36085a791ad9bb8"}
Jul 06 23:56:38.743280 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.743266    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:38.743445 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.743429    2574 scope.go:117] "RemoveContainer" containerID="f524e452a20619a152554380e2d0b09fcdd540e44d981a9e27fdc83c6b0ddb03"
Jul 06 23:56:38.758754 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:38.758736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:39.082945 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.082914    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:39.083467 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.082914    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:39.083467 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:39.083060    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:39.083467 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:39.083080    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:39.750472 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.750389    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 06 23:56:39.750970 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.750937    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" event={"ID":"d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b","Type":"ContainerStarted","Data":"60288dd7960d42f60509dead18fbc52fb67428b28a56c416ced68af6996c7018"}
Jul 06 23:56:39.751253 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.751230    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:56:39.751556 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.751536    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:39.764964 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.764932    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94mm4"]
Jul 06 23:56:39.765094 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.765027    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:39.765156 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:39.765135    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:39.767945 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.767918    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g79jh"]
Jul 06 23:56:39.768082 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.768023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:39.768182 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:39.768130    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:39.768557 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.768536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wbx2j"]
Jul 06 23:56:39.768641 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.768627    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:39.769060 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:39.768733    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:39.770959 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.770939    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:39.784498 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:39.784451    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" podStartSLOduration=10.391077284 podStartE2EDuration="29.784433986s" totalImagesPullingTime="19.393356702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:39.78407693 +0000 UTC m=+30.237504526" watchObservedRunningTime="2026-07-06 23:56:39.784433986 +0000 UTC m=+30.237861582"
Jul 06 23:56:40.579459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:40.579429    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:40.668374 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:40.668345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:40.754737 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:40.754698    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="36213b0ba33d1ab12c1021f3f54e46bb34fb2b81fa94e8c566214b1e3dc44bf7" exitCode=0
Jul 06 23:56:40.754893 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:40.754775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"36213b0ba33d1ab12c1021f3f54e46bb34fb2b81fa94e8c566214b1e3dc44bf7"}
Jul 06 23:56:40.754893 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:40.754867    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:56:41.023035 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.023004    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:41.082133 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.082105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:41.082281 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:41.082198    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:41.096909 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.096883    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:41.513697 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.513661    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:56:41.759062 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.759035    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="cba3b87878d44c06c947970fc34fd02114219c65c49b07860706ecc2687f355d" exitCode=0
Jul 06 23:56:41.759378 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:41.759111    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"cba3b87878d44c06c947970fc34fd02114219c65c49b07860706ecc2687f355d"}
Jul 06 23:56:42.082940 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:42.082906    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:42.083102 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:42.082949    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:42.083102 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:42.083026    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:42.083186 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:42.083150    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:42.420717 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:42.420640    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:42.779882 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:42.779830    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq" podUID="d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 06 23:56:43.082947 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:43.082707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:43.083084 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.083050    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g79jh" podUID="3d2aa0af-89af-448c-a456-d15cdcf16afc"
Jul 06 23:56:43.704583 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:43.704544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:43.704781 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:43.704603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:43.704781 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.704713    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:43.704781 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.704782    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs podName:2f736d39-4899-47e1-b662-cd7f285ab88e nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.704763807 +0000 UTC m=+66.158191386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs") pod "network-metrics-daemon-wbx2j" (UID: "2f736d39-4899-47e1-b662-cd7f285ab88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:43.704964 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.704713    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:43.704964 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.704855    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret podName:3d2aa0af-89af-448c-a456-d15cdcf16afc nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.704841632 +0000 UTC m=+66.158269218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret") pod "global-pull-secret-syncer-g79jh" (UID: "3d2aa0af-89af-448c-a456-d15cdcf16afc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:43.906684 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:43.906650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:43.907154 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.906797    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:43.907154 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.906816    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:43.907154 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.906830    2574 projected.go:196] Error preparing data for projected volume kube-api-access-jjqml for pod openshift-network-diagnostics/network-check-target-94mm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:43.907154 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:43.906900    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml podName:37b98d7d-00bd-4398-b43d-bfd358d36732 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.906882323 +0000 UTC m=+66.360309896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjqml" (UniqueName: "kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml") pod "network-check-target-94mm4" (UID: "37b98d7d-00bd-4398-b43d-bfd358d36732") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:44.086468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.086442    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:44.086630 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.086476    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:44.086630 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:44.086548    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbx2j" podUID="2f736d39-4899-47e1-b662-cd7f285ab88e"
Jul 06 23:56:44.086740 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:44.086674    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mm4" podUID="37b98d7d-00bd-4398-b43d-bfd358d36732"
Jul 06 23:56:44.844529 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.844444    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-102.ec2.internal" event="NodeReady"
Jul 06 23:56:44.844782 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.844604    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:56:44.878635 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.878601    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:56:44.908972 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.908936    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c9rlm"]
Jul 06 23:56:44.909434 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.909087    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:44.913032 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.913003    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:56:44.913176 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.913055    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:56:44.913381 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.913358    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:56:44.913381 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.913373    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgl2r\""
Jul 06 23:56:44.923124 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.923099    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jds7x"]
Jul 06 23:56:44.923262 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.923197    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:44.927943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.927921    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c6s9h\""
Jul 06 23:56:44.928060 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.927921    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:56:44.928060 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.927962    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:56:44.929608 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.929589    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:56:44.939035 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.939016    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:56:44.939144 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.939043    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9rlm"]
Jul 06 23:56:44.939144 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.939059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jds7x"]
Jul 06 23:56:44.939254 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.939148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:44.941942 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.941889    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:56:44.941942 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.941905    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:56:44.942266 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.942250    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:56:44.942367 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:44.942347    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5xctx\""
Jul 06 23:56:45.015553 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmcj\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.015718 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/530cea56-1c2e-4f0c-926e-5a9ef670686c-config-volume\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.015718 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.015718 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.015718 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc175706-bf36-48d4-9e4b-0ed310eb0c49-cert\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.015918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfvxf\" (UniqueName: \"kubernetes.io/projected/fc175706-bf36-48d4-9e4b-0ed310eb0c49-kube-api-access-lfvxf\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.015918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530cea56-1c2e-4f0c-926e-5a9ef670686c-tmp-dir\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.015918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.015918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.015918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7dj\" (UniqueName: \"kubernetes.io/projected/530cea56-1c2e-4f0c-926e-5a9ef670686c-kube-api-access-4b7dj\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.016081 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.016081 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.015974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.016081 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.016031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.016223 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.016140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.052534 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.052497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:45.082493 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.082462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:56:45.085177 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.085154    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:56:45.116694 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116629    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.116694 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmcj\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.116862 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/530cea56-1c2e-4f0c-926e-5a9ef670686c-config-volume\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.116862 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.116862 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.116862 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc175706-bf36-48d4-9e4b-0ed310eb0c49-cert\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfvxf\" (UniqueName: \"kubernetes.io/projected/fc175706-bf36-48d4-9e4b-0ed310eb0c49-kube-api-access-lfvxf\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530cea56-1c2e-4f0c-926e-5a9ef670686c-tmp-dir\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.116993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7dj\" (UniqueName: \"kubernetes.io/projected/530cea56-1c2e-4f0c-926e-5a9ef670686c-kube-api-access-4b7dj\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.117064 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.117332 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.117332 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.117332 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117228    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530cea56-1c2e-4f0c-926e-5a9ef670686c-tmp-dir\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.117332 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/530cea56-1c2e-4f0c-926e-5a9ef670686c-config-volume\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117339    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.117435    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.117456    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6955c9b64d-p9nzj: secret "image-registry-tls" not found
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.117495    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.117539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls podName:59ce4fd8-b48a-4f7f-94ae-75797dadd999 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:45.617519866 +0000 UTC m=+36.070947455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls") pod "image-registry-6955c9b64d-p9nzj" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999") : secret "image-registry-tls" not found
Jul 06 23:56:45.117583 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.117559    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls podName:530cea56-1c2e-4f0c-926e-5a9ef670686c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:45.617549354 +0000 UTC m=+36.070976929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls") pod "dns-default-c9rlm" (UID: "530cea56-1c2e-4f0c-926e-5a9ef670686c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:45.117850 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.117709    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.118293 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.118159    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.121320 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.121300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.121440 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.121394    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.121487 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.121475    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc175706-bf36-48d4-9e4b-0ed310eb0c49-cert\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.126121 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.126093    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.126223 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.126130    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfvxf\" (UniqueName: \"kubernetes.io/projected/fc175706-bf36-48d4-9e4b-0ed310eb0c49-kube-api-access-lfvxf\") pod \"ingress-canary-jds7x\" (UID: \"fc175706-bf36-48d4-9e4b-0ed310eb0c49\") " pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.126223 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.126201    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7dj\" (UniqueName: \"kubernetes.io/projected/530cea56-1c2e-4f0c-926e-5a9ef670686c-kube-api-access-4b7dj\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.126331 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.126292    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmcj\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.153289 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.153249    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:45.249494 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.249441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jds7x"
Jul 06 23:56:45.621516 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.621474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:45.621713 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.621566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:45.621713 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.621648    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:45.621713 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.621671    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6955c9b64d-p9nzj: secret "image-registry-tls" not found
Jul 06 23:56:45.621876 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.621730    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:45.621876 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.621743    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls podName:59ce4fd8-b48a-4f7f-94ae-75797dadd999 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:46.621726179 +0000 UTC m=+37.075153759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls") pod "image-registry-6955c9b64d-p9nzj" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999") : secret "image-registry-tls" not found
Jul 06 23:56:45.621876 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:45.621770    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls podName:530cea56-1c2e-4f0c-926e-5a9ef670686c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:46.621759172 +0000 UTC m=+37.075186751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls") pod "dns-default-c9rlm" (UID: "530cea56-1c2e-4f0c-926e-5a9ef670686c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:45.959546 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:45.959519    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jds7x"]
Jul 06 23:56:46.027965 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:46.027932    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc175706_bf36_48d4_9e4b_0ed310eb0c49.slice/crio-331831a093e0b22f57f15f892a06b35e087e74ef863c182828d04b482fd831e8 WatchSource:0}: Error finding container 331831a093e0b22f57f15f892a06b35e087e74ef863c182828d04b482fd831e8: Status 404 returned error can't find the container with id 331831a093e0b22f57f15f892a06b35e087e74ef863c182828d04b482fd831e8
Jul 06 23:56:46.086505 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.086269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:56:46.086607 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.086331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:56:46.089357 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.089277    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m54k2\""
Jul 06 23:56:46.090233 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.090213    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:56:46.090233 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.090227    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:56:46.090383 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.090297    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v6rl\""
Jul 06 23:56:46.090383 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.090301    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:56:46.628635 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.628603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:46.628803 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.628666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:46.628803 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:46.628779    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:46.628873 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:46.628837    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls podName:530cea56-1c2e-4f0c-926e-5a9ef670686c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:48.628822865 +0000 UTC m=+39.082250439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls") pod "dns-default-c9rlm" (UID: "530cea56-1c2e-4f0c-926e-5a9ef670686c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:46.628913 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:46.628875    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:46.628947 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:46.628911    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6955c9b64d-p9nzj: secret "image-registry-tls" not found
Jul 06 23:56:46.628980 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:46.628959    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls podName:59ce4fd8-b48a-4f7f-94ae-75797dadd999 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:48.628945498 +0000 UTC m=+39.082373080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls") pod "image-registry-6955c9b64d-p9nzj" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999") : secret "image-registry-tls" not found
Jul 06 23:56:46.773173 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.773137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jds7x" event={"ID":"fc175706-bf36-48d4-9e4b-0ed310eb0c49","Type":"ContainerStarted","Data":"331831a093e0b22f57f15f892a06b35e087e74ef863c182828d04b482fd831e8"}
Jul 06 23:56:46.776340 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.776306    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="531aae0b4c7f5a59f535d12943c54f68eef0031af61901697a55b6c2694baa1c" exitCode=0
Jul 06 23:56:46.776477 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:46.776361    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"531aae0b4c7f5a59f535d12943c54f68eef0031af61901697a55b6c2694baa1c"}
Jul 06 23:56:47.285551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:47.285519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:47.349005 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:47.348967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:47.782618 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:47.782572    2574 generic.go:356] "Generic (PLEG): container finished" podID="f08d4da7-4eb7-456b-a086-831798d8e938" containerID="9ab6088e9939f3199e9761fe42465af0d5e85d6985ec1bd13d6cb32f2f43c70c" exitCode=0
Jul 06 23:56:47.782796 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:47.782641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerDied","Data":"9ab6088e9939f3199e9761fe42465af0d5e85d6985ec1bd13d6cb32f2f43c70c"}
Jul 06 23:56:48.370576 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.370547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:48.466770 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.466747    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:48.647114 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.647034    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:48.647260 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.647112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:48.647260 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.647192    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:48.647260 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.647248    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls podName:530cea56-1c2e-4f0c-926e-5a9ef670686c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.647233058 +0000 UTC m=+43.100660637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls") pod "dns-default-c9rlm" (UID: "530cea56-1c2e-4f0c-926e-5a9ef670686c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:48.647391 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.647266    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:48.647391 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.647283    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6955c9b64d-p9nzj: secret "image-registry-tls" not found
Jul 06 23:56:48.647391 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.647324    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls podName:59ce4fd8-b48a-4f7f-94ae-75797dadd999 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.647311428 +0000 UTC m=+43.100739003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls") pod "image-registry-6955c9b64d-p9nzj" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999") : secret "image-registry-tls" not found
Jul 06 23:56:48.716575 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.716541    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:48.739200 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.739171    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dd58t"]
Jul 06 23:56:48.745670 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.745648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.748119 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.748092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:56:48.748119 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.748109    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:56:48.748304 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.748173    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:56:48.748304 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.748186    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:56:48.748304 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.748195    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phqcp\""
Jul 06 23:56:48.755352 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.755329    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd58t"]
Jul 06 23:56:48.789375 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.789342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:48.790421 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.790381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jds7x" event={"ID":"fc175706-bf36-48d4-9e4b-0ed310eb0c49","Type":"ContainerStarted","Data":"25512c31935348db3c625e8cfeaf0d0fda865e6c298340d36a75cf2dbdcc1cb6"}
Jul 06 23:56:48.794316 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.794289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" event={"ID":"f08d4da7-4eb7-456b-a086-831798d8e938","Type":"ContainerStarted","Data":"738376f56fdf8b430c0004b1f9a5ce1160e0a5ce35a551f9c5400061f5bdfbfe"}
Jul 06 23:56:48.806673 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.806630    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jds7x" podStartSLOduration=2.310571623 podStartE2EDuration="4.806616505s" totalImagesPullingTime="2.496044882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:48.805991646 +0000 UTC m=+39.259419241" watchObservedRunningTime="2026-07-06 23:56:48.806616505 +0000 UTC m=+39.260044100"
Jul 06 23:56:48.833353 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.833306    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wnt6x" podStartSLOduration=9.131988838 podStartE2EDuration="38.833293921s" totalImagesPullingTime="29.701305083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:48.832783654 +0000 UTC m=+39.286211276" watchObservedRunningTime="2026-07-06 23:56:48.833293921 +0000 UTC m=+39.286721627"
Jul 06 23:56:48.849109 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.849080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77aeb02d-199a-4819-a7b2-ed13e805863b-data-volume\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.849213 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.849121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.849213 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.849206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.849278 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.849250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2pj\" (UniqueName: \"kubernetes.io/projected/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-api-access-qg2pj\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.849314 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.849278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77aeb02d-199a-4819-a7b2-ed13e805863b-crio-socket\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.950757 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.950650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77aeb02d-199a-4819-a7b2-ed13e805863b-data-volume\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.950757 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.950700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.950973 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.950761    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:48.950973 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.950830    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:49.450810678 +0000 UTC m=+39.904238257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:48.950973 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.950918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.951131 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.950982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2pj\" (UniqueName: \"kubernetes.io/projected/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-api-access-qg2pj\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.951131 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.951026    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77aeb02d-199a-4819-a7b2-ed13e805863b-data-volume\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.951131 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.951044    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:48.951131 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.951030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77aeb02d-199a-4819-a7b2-ed13e805863b-crio-socket\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.951131 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:48.951086    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:49.451073354 +0000 UTC m=+39.904500938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:48.951278 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.951182    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77aeb02d-199a-4819-a7b2-ed13e805863b-crio-socket\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.976833 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.976715    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2pj\" (UniqueName: \"kubernetes.io/projected/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-api-access-qg2pj\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:48.988742 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:48.988718    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:49.141574 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.141542    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:49.241949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.241876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:49.413605 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.413570    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"]
Jul 06 23:56:49.439485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.439456    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"]
Jul 06 23:56:49.439625 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.439565    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"
Jul 06 23:56:49.442360 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.442337    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 23:56:49.443229 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.443207    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n445r\""
Jul 06 23:56:49.443229 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.443227    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:49.456005 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.455979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:49.456125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.456039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:49.456125 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:49.456101    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:49.456243 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:49.456152    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:49.456243 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:49.456167    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:50.456150992 +0000 UTC m=+40.909578569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:49.456243 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:49.456203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:50.456186547 +0000 UTC m=+40.909614135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:49.465962 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.465937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:49.557043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.557013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5w8\" (UniqueName: \"kubernetes.io/projected/372d38c1-a408-4a43-95bb-7109bc54da62-kube-api-access-rj5w8\") pod \"migrator-d57d58cc9-j7dks\" (UID: \"372d38c1-a408-4a43-95bb-7109bc54da62\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"
Jul 06 23:56:49.572483 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.572447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:49.657882 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.657851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5w8\" (UniqueName: \"kubernetes.io/projected/372d38c1-a408-4a43-95bb-7109bc54da62-kube-api-access-rj5w8\") pod \"migrator-d57d58cc9-j7dks\" (UID: \"372d38c1-a408-4a43-95bb-7109bc54da62\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"
Jul 06 23:56:49.667739 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.667708    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5w8\" (UniqueName: \"kubernetes.io/projected/372d38c1-a408-4a43-95bb-7109bc54da62-kube-api-access-rj5w8\") pod \"migrator-d57d58cc9-j7dks\" (UID: \"372d38c1-a408-4a43-95bb-7109bc54da62\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"
Jul 06 23:56:49.748652 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.748613    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"
Jul 06 23:56:49.889619 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:49.889585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks"]
Jul 06 23:56:49.893387 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:56:49.893365    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372d38c1_a408_4a43_95bb_7109bc54da62.slice/crio-1bdd6265cc0bc565b95e0446733fc72e2674a5494a15a0abbe1743c4ca4206c1 WatchSource:0}: Error finding container 1bdd6265cc0bc565b95e0446733fc72e2674a5494a15a0abbe1743c4ca4206c1: Status 404 returned error can't find the container with id 1bdd6265cc0bc565b95e0446733fc72e2674a5494a15a0abbe1743c4ca4206c1
Jul 06 23:56:50.252450 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.252354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:50.316595 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.316565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:50.322530 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.322505    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvbt9_0fe27f5d-5983-4afd-8fce-081e37d7fbea/dns-node-resolver/0.log"
Jul 06 23:56:50.382230 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.382200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:50.442755 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.442715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:50.466727 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.466690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:50.466953 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:50.466777    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:50.466953 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.466786    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:50.466953 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:50.466855    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.466832134 +0000 UTC m=+42.920259712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:50.466953 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:50.466914    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:50.467165 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:50.466977    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.466960841 +0000 UTC m=+42.920388420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:50.800631 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:50.800598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks" event={"ID":"372d38c1-a408-4a43-95bb-7109bc54da62","Type":"ContainerStarted","Data":"1bdd6265cc0bc565b95e0446733fc72e2674a5494a15a0abbe1743c4ca4206c1"}
Jul 06 23:56:51.069149 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.068869    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.138909 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.138878    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.200581 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.200550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.262032 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.262001    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.522557 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.522541    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x6k8g_06b39bed-9d98-4db1-8b61-5804382e47dc/node-ca/0.log"
Jul 06 23:56:51.629625 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.629590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.805244 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.805215    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks" event={"ID":"372d38c1-a408-4a43-95bb-7109bc54da62","Type":"ContainerStarted","Data":"ab3e9ffe2f1bc22e039254af1156da56dfaba571cdfb7ed0584be905f06fd986"}
Jul 06 23:56:51.805426 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.805267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks" event={"ID":"372d38c1-a408-4a43-95bb-7109bc54da62","Type":"ContainerStarted","Data":"764566ac73026ca4610c2028a442109c907dccc7dc32a1bbc8d6c2978f70f354"}
Jul 06 23:56:51.824354 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.824303    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j7dks" podStartSLOduration=1.247170414 podStartE2EDuration="2.824287667s" totalImagesPullingTime="1.577117253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:51.823482911 +0000 UTC m=+42.276910507" watchObservedRunningTime="2026-07-06 23:56:51.824287667 +0000 UTC m=+42.277715264"
Jul 06 23:56:51.919867 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.919839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:51.924928 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:51.924905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jds7x_fc175706-bf36-48d4-9e4b-0ed310eb0c49/serve-healthcheck-canary/0.log"
Jul 06 23:56:52.052357 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.052328    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:52.179968 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.179889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:52.485501 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.485417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:52.485501 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.485486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:52.485694 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.485487    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:52.485694 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.485549    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:52.485694 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.485595    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:56.485579924 +0000 UTC m=+46.939007501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:52.485694 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.485609    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:56.485602902 +0000 UTC m=+46.939030476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:52.687085 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.687050    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:52.687118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.687201    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.687223    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6955c9b64d-p9nzj: secret "image-registry-tls" not found
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.687270    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls podName:59ce4fd8-b48a-4f7f-94ae-75797dadd999 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:00.687255357 +0000 UTC m=+51.140682935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls") pod "image-registry-6955c9b64d-p9nzj" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999") : secret "image-registry-tls" not found
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.687204    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:52.687512 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:52.687333    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls podName:530cea56-1c2e-4f0c-926e-5a9ef670686c nodeName:}" failed. No retries permitted until 2026-07-06 23:57:00.68732123 +0000 UTC m=+51.140748807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls") pod "dns-default-c9rlm" (UID: "530cea56-1c2e-4f0c-926e-5a9ef670686c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:53.677905 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:53.677870    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:54.534912 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:54.534879    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:54.633613 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:54.633585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:55.658896 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:55.658862    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:55.787500 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:55.787462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:55.896575 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:55.896544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:55.999076 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:55.999002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:56.312921 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.312892    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:56.427278 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.427247    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:56.516125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.516089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:56.516284 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.516145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:56.516284 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:56.516262    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:56.516360 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:56:56.516314    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls podName:77aeb02d-199a-4819-a7b2-ed13e805863b nodeName:}" failed. No retries permitted until 2026-07-06 23:57:04.516301132 +0000 UTC m=+54.969728707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd58t" (UID: "77aeb02d-199a-4819-a7b2-ed13e805863b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:56.516756 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.516738    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77aeb02d-199a-4819-a7b2-ed13e805863b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:56:56.845450 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:56.845417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:57.308596 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:57.308564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:57.686046 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:57.685970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:57.887691 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:57.887660    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:58.093636 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:58.093606    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:58.489099 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:58.489025    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:59.101077 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:59.101043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:59.290557 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:59.290527    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:59.540467 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:59.540425    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:59.705124 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:59.705094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:59.897943 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:56:59.897857    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.299670 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.299641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.369776 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.369744    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.490469 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.490439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.749982 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.749892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:00.749982 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.749962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:57:00.752575 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.752547    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/530cea56-1c2e-4f0c-926e-5a9ef670686c-metrics-tls\") pod \"dns-default-c9rlm\" (UID: \"530cea56-1c2e-4f0c-926e-5a9ef670686c\") " pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:57:00.752699 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.752645    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"image-registry-6955c9b64d-p9nzj\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") " pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:00.824985 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.824950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:00.835109 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.835085    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:57:00.959216 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.959182    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:57:00.963337 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:00.963311    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ce4fd8_b48a_4f7f_94ae_75797dadd999.slice/crio-89dfaa147b2a4f13093a68485f65f421641d1726d12541ca5c8ea78476f674fd WatchSource:0}: Error finding container 89dfaa147b2a4f13093a68485f65f421641d1726d12541ca5c8ea78476f674fd: Status 404 returned error can't find the container with id 89dfaa147b2a4f13093a68485f65f421641d1726d12541ca5c8ea78476f674fd
Jul 06 23:57:00.975191 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:00.975169    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9rlm"]
Jul 06 23:57:00.978554 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:00.978529    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530cea56_1c2e_4f0c_926e_5a9ef670686c.slice/crio-8c774e0f2cc4cda90324174b54fa767ddceecc435a748de53be09a16f5db2cd6 WatchSource:0}: Error finding container 8c774e0f2cc4cda90324174b54fa767ddceecc435a748de53be09a16f5db2cd6: Status 404 returned error can't find the container with id 8c774e0f2cc4cda90324174b54fa767ddceecc435a748de53be09a16f5db2cd6
Jul 06 23:57:01.093609 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.093582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:01.290140 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.290094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:01.811479 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.811440    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:01.831182 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.831133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" event={"ID":"59ce4fd8-b48a-4f7f-94ae-75797dadd999","Type":"ContainerStarted","Data":"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"}
Jul 06 23:57:01.831364 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.831211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" event={"ID":"59ce4fd8-b48a-4f7f-94ae-75797dadd999","Type":"ContainerStarted","Data":"89dfaa147b2a4f13093a68485f65f421641d1726d12541ca5c8ea78476f674fd"}
Jul 06 23:57:01.831364 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.831241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:01.832650 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.832626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9rlm" event={"ID":"530cea56-1c2e-4f0c-926e-5a9ef670686c","Type":"ContainerStarted","Data":"8c774e0f2cc4cda90324174b54fa767ddceecc435a748de53be09a16f5db2cd6"}
Jul 06 23:57:01.857018 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.856970    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" podStartSLOduration=45.856953547 podStartE2EDuration="45.856953547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:01.856625817 +0000 UTC m=+52.310053413" watchObservedRunningTime="2026-07-06 23:57:01.856953547 +0000 UTC m=+52.310381144"
Jul 06 23:57:01.888693 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:01.888660    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:02.297002 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.296964    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:02.720740 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.720642    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:02.838600 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.838561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9rlm" event={"ID":"530cea56-1c2e-4f0c-926e-5a9ef670686c","Type":"ContainerStarted","Data":"875812fdf0816265032b7f42fdb0200a36563c28bd181eb30c209f615bac7f64"}
Jul 06 23:57:02.838987 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.838623    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9rlm" event={"ID":"530cea56-1c2e-4f0c-926e-5a9ef670686c","Type":"ContainerStarted","Data":"cb85cf6196a8d45470509f6e3bb2033d00c2bb842279ab5fb452bf73eb6c0587"}
Jul 06 23:57:02.838987 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.838766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:57:02.936704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:02.936662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:03.282466 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:03.282426    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:03.369296 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:03.369269    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:03.909646 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:03.909618    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:04.487042 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.487013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:04.582545 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.582515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:57:04.584761 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.584731    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77aeb02d-199a-4819-a7b2-ed13e805863b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd58t\" (UID: \"77aeb02d-199a-4819-a7b2-ed13e805863b\") " pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:57:04.655906 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.655874    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd58t"
Jul 06 23:57:04.687720 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.687687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:04.778460 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.777900    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c9rlm" podStartSLOduration=19.435029046 podStartE2EDuration="20.777876001s" totalImagesPullingTime="1.342846955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:02.876765607 +0000 UTC m=+53.330193202" watchObservedRunningTime="2026-07-06 23:57:04.777876001 +0000 UTC m=+55.231303599"
Jul 06 23:57:04.778460 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.778432    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd58t"]
Jul 06 23:57:04.781914 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:04.781890    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77aeb02d_199a_4819_a7b2_ed13e805863b.slice/crio-c8c75bb0476fbeca7acb032cc11f443f8a6164d00b7b549db335f62e1bdee28b WatchSource:0}: Error finding container c8c75bb0476fbeca7acb032cc11f443f8a6164d00b7b549db335f62e1bdee28b: Status 404 returned error can't find the container with id c8c75bb0476fbeca7acb032cc11f443f8a6164d00b7b549db335f62e1bdee28b
Jul 06 23:57:04.849966 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.849932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd58t" event={"ID":"77aeb02d-199a-4819-a7b2-ed13e805863b","Type":"ContainerStarted","Data":"c8c75bb0476fbeca7acb032cc11f443f8a6164d00b7b549db335f62e1bdee28b"}
Jul 06 23:57:04.892204 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:04.892173    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:05.288821 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:05.288751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:05.418670 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:05.418593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:05.518325 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:05.518246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:05.890853 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:05.890819    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:06.084817 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:06.084778    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:06.280600 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:06.280565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:08.868649 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:08.868624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd58t" event={"ID":"77aeb02d-199a-4819-a7b2-ed13e805863b","Type":"ContainerStarted","Data":"15a20b6a1e00d8feb8cdf7f4c0d5951c60c725a73a5f435f073cee9f2ee04bad"}
Jul 06 23:57:09.873934 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:09.873896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd58t" event={"ID":"77aeb02d-199a-4819-a7b2-ed13e805863b","Type":"ContainerStarted","Data":"ec377cf160387896255a55a833856085505b37edc30d9118e76ab82dac3a9622"}
Jul 06 23:57:12.771788 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:12.771762    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krvhq"
Jul 06 23:57:12.843872 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:12.843840    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c9rlm"
Jul 06 23:57:12.889788 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:12.889752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd58t" event={"ID":"77aeb02d-199a-4819-a7b2-ed13e805863b","Type":"ContainerStarted","Data":"b72b345d3d483fd7f2fffcc0776b3fce0231ab842ddd57a65d32c900088aacd2"}
Jul 06 23:57:12.913901 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:12.913837    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dd58t" podStartSLOduration=17.927256724 podStartE2EDuration="24.913818959s" totalImagesPullingTime="6.986562235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:12.91327771 +0000 UTC m=+63.366705308" watchObservedRunningTime="2026-07-06 23:57:12.913818959 +0000 UTC m=+63.367246557"
Jul 06 23:57:13.473881 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.473851    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:57:13.477348 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.477309    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"]
Jul 06 23:57:13.479940 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.479913    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"]
Jul 06 23:57:13.480079 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.480058    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.481884 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.481865    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.486427 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.486388    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 23:57:13.486731 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.486711    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 23:57:13.486833 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.486732    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 23:57:13.487243 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.487230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.487299 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.487248    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 23:57:13.487555 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.487538    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 23:57:13.487643 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.487560    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.487643 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.487582    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 23:57:13.501949 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.501916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"]
Jul 06 23:57:13.502714 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.502693    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"]
Jul 06 23:57:13.548261 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548225    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltsz\" (UniqueName: \"kubernetes.io/projected/95bb57ac-1234-4827-a903-0d73398aed31-kube-api-access-wltsz\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.548261 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0b77ea1-621a-49eb-8213-b7f10126e3ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0b77ea1-621a-49eb-8213-b7f10126e3ea-tmp\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95bb57ac-1234-4827-a903-0d73398aed31-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxt7\" (UniqueName: \"kubernetes.io/projected/c0b77ea1-621a-49eb-8213-b7f10126e3ea-kube-api-access-6vxt7\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.548485 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.548688 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.548505    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649376 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649338    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0b77ea1-621a-49eb-8213-b7f10126e3ea-tmp\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.649551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649388    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95bb57ac-1234-4827-a903-0d73398aed31-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxt7\" (UniqueName: \"kubernetes.io/projected/c0b77ea1-621a-49eb-8213-b7f10126e3ea-kube-api-access-6vxt7\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.649551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649747 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649747 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltsz\" (UniqueName: \"kubernetes.io/projected/95bb57ac-1234-4827-a903-0d73398aed31-kube-api-access-wltsz\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649747 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.649747 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0b77ea1-621a-49eb-8213-b7f10126e3ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.649932 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.649850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0b77ea1-621a-49eb-8213-b7f10126e3ea-tmp\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.650184 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.650156    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95bb57ac-1234-4827-a903-0d73398aed31-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.652154 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.652130    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.652279 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.652244    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.652522 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.652500    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0b77ea1-621a-49eb-8213-b7f10126e3ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.652604 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.652549    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-hub\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.652604 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.652553    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95bb57ac-1234-4827-a903-0d73398aed31-ca\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.676309 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.676282    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxt7\" (UniqueName: \"kubernetes.io/projected/c0b77ea1-621a-49eb-8213-b7f10126e3ea-kube-api-access-6vxt7\") pod \"klusterlet-addon-workmgr-9c69586d-k95hv\" (UID: \"c0b77ea1-621a-49eb-8213-b7f10126e3ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.686870 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.686846    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltsz\" (UniqueName: \"kubernetes.io/projected/95bb57ac-1234-4827-a903-0d73398aed31-kube-api-access-wltsz\") pod \"cluster-proxy-proxy-agent-8559464486-nxgr7\" (UID: \"95bb57ac-1234-4827-a903-0d73398aed31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.713457 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.713428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:13.808007 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.807973    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"
Jul 06 23:57:13.813417 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.813376    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:13.910828 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.910800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:13.951499 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.951470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7"]
Jul 06 23:57:13.955143 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:13.955116    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95bb57ac_1234_4827_a903_0d73398aed31.slice/crio-09a3ccc755ca9991380632b1269c6292a26ae6c50f24efa705a23c2c08f00ef9 WatchSource:0}: Error finding container 09a3ccc755ca9991380632b1269c6292a26ae6c50f24efa705a23c2c08f00ef9: Status 404 returned error can't find the container with id 09a3ccc755ca9991380632b1269c6292a26ae6c50f24efa705a23c2c08f00ef9
Jul 06 23:57:13.956667 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:13.956645    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"]
Jul 06 23:57:13.959073 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:13.959055    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b77ea1_621a_49eb_8213_b7f10126e3ea.slice/crio-8de08aedeb4181c52530e1a3c3b923991c6a6c57c03da20c3ca698b6ca56bccf WatchSource:0}: Error finding container 8de08aedeb4181c52530e1a3c3b923991c6a6c57c03da20c3ca698b6ca56bccf: Status 404 returned error can't find the container with id 8de08aedeb4181c52530e1a3c3b923991c6a6c57c03da20c3ca698b6ca56bccf
Jul 06 23:57:14.012418 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:14.012364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:14.902469 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:14.902377    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7" event={"ID":"95bb57ac-1234-4827-a903-0d73398aed31","Type":"ContainerStarted","Data":"09a3ccc755ca9991380632b1269c6292a26ae6c50f24efa705a23c2c08f00ef9"}
Jul 06 23:57:14.904582 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:14.904512    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv" event={"ID":"c0b77ea1-621a-49eb-8213-b7f10126e3ea","Type":"ContainerStarted","Data":"8de08aedeb4181c52530e1a3c3b923991c6a6c57c03da20c3ca698b6ca56bccf"}
Jul 06 23:57:15.522901 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.522853    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:15.622430 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.622295    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:15.723806 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.723762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:15.770524 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.770475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:57:15.770703 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.770538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:57:15.773455 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.773374    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:57:15.774245 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.774226    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:57:15.784165 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.784136    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d2aa0af-89af-448c-a456-d15cdcf16afc-original-pull-secret\") pod \"global-pull-secret-syncer-g79jh\" (UID: \"3d2aa0af-89af-448c-a456-d15cdcf16afc\") " pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:57:15.784483 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.784463    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f736d39-4899-47e1-b662-cd7f285ab88e-metrics-certs\") pod \"network-metrics-daemon-wbx2j\" (UID: \"2f736d39-4899-47e1-b662-cd7f285ab88e\") " pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:57:15.809373 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.809339    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v6rl\""
Jul 06 23:57:15.817673 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.817648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbx2j"
Jul 06 23:57:15.972667 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.972617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:57:15.976098 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.976051    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:57:15.985867 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.985845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:57:15.993798 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.993473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g79jh"
Jul 06 23:57:15.996927 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:15.996897    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqml\" (UniqueName: \"kubernetes.io/projected/37b98d7d-00bd-4398-b43d-bfd358d36732-kube-api-access-jjqml\") pod \"network-check-target-94mm4\" (UID: \"37b98d7d-00bd-4398-b43d-bfd358d36732\") " pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:57:16.035174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.035075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.102613 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.102386    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m54k2\""
Jul 06 23:57:16.110443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.110387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:57:16.129214 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.129182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.223114 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.223059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.551194 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.551162    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wbx2j"]
Jul 06 23:57:16.554663 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:16.554625    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f736d39_4899_47e1_b662_cd7f285ab88e.slice/crio-e82d1173a2bf27ed2608b4e36dd8cb14be5626fc995a6b441f79e79f9cadef41 WatchSource:0}: Error finding container e82d1173a2bf27ed2608b4e36dd8cb14be5626fc995a6b441f79e79f9cadef41: Status 404 returned error can't find the container with id e82d1173a2bf27ed2608b4e36dd8cb14be5626fc995a6b441f79e79f9cadef41
Jul 06 23:57:16.570875 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.570845    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94mm4"]
Jul 06 23:57:16.572269 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:16.572243    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b98d7d_00bd_4398_b43d_bfd358d36732.slice/crio-39126e84c2d176b1b185a5c426fb8588b5e09db09711fcfec38e5f11662c9f07 WatchSource:0}: Error finding container 39126e84c2d176b1b185a5c426fb8588b5e09db09711fcfec38e5f11662c9f07: Status 404 returned error can't find the container with id 39126e84c2d176b1b185a5c426fb8588b5e09db09711fcfec38e5f11662c9f07
Jul 06 23:57:16.574775 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:16.574436    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2aa0af_89af_448c_a456_d15cdcf16afc.slice/crio-4ea117735c45cffd7be6d64c7f9931be982560a9872696308d9c1516041dd74a WatchSource:0}: Error finding container 4ea117735c45cffd7be6d64c7f9931be982560a9872696308d9c1516041dd74a: Status 404 returned error can't find the container with id 4ea117735c45cffd7be6d64c7f9931be982560a9872696308d9c1516041dd74a
Jul 06 23:57:16.584811 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.584787    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g79jh"]
Jul 06 23:57:16.633647 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.633615    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.762255 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.762221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.858130 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.858048    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.912803 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.912759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbx2j" event={"ID":"2f736d39-4899-47e1-b662-cd7f285ab88e","Type":"ContainerStarted","Data":"e82d1173a2bf27ed2608b4e36dd8cb14be5626fc995a6b441f79e79f9cadef41"}
Jul 06 23:57:16.914066 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.914035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g79jh" event={"ID":"3d2aa0af-89af-448c-a456-d15cdcf16afc","Type":"ContainerStarted","Data":"4ea117735c45cffd7be6d64c7f9931be982560a9872696308d9c1516041dd74a"}
Jul 06 23:57:16.915239 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.915200    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94mm4" event={"ID":"37b98d7d-00bd-4398-b43d-bfd358d36732","Type":"ContainerStarted","Data":"39126e84c2d176b1b185a5c426fb8588b5e09db09711fcfec38e5f11662c9f07"}
Jul 06 23:57:16.953897 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:16.953859    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:17.070172 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:17.070125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:17.275146 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:17.275106    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:17.469643 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:17.469599    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:17.577254 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:17.577175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:17.992590 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:17.992497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:18.089199 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:18.089132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:18.656469 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:18.656374    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:18.756874 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:18.756777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:18.867743 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:18.867650    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.140459 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:19.140418    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.242672 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:19.242592    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.381948 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:19.381915    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.456998 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:19.456920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:20.376886 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:20.376854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:20.432594 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:20.432539    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:21.519651 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:21.519598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:22.665725 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.665690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:22.941710 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.941656    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv" event={"ID":"c0b77ea1-621a-49eb-8213-b7f10126e3ea","Type":"ContainerStarted","Data":"c65a8f36d5ff4b0a82cbc632a2497df203567e2753bf58cebec81ed8a9e71456"}
Jul 06 23:57:22.943307 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.943251    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:22.944923 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.944850    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7" event={"ID":"95bb57ac-1234-4827-a903-0d73398aed31","Type":"ContainerStarted","Data":"3d070dcb739132b87d5428437b78f5a8ecfd097be37d95f507fb93dea5654c1e"}
Jul 06 23:57:22.945042 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.944993    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv" podUID="c0b77ea1-621a-49eb-8213-b7f10126e3ea" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.12:8000/readyz\": dial tcp 10.133.0.12:8000: connect: connection refused"
Jul 06 23:57:22.948759 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.948701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94mm4" event={"ID":"37b98d7d-00bd-4398-b43d-bfd358d36732","Type":"ContainerStarted","Data":"bbe3d3f7d0d45f59bfc17cfec69ad723db77afb59a80efcd0922af3297eedae1"}
Jul 06 23:57:22.948955 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.948915    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:57:22.968255 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:22.968008    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv" podStartSLOduration=1.096669171 podStartE2EDuration="9.967986174s" totalImagesPullingTime="8.871317003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:22.967127202 +0000 UTC m=+73.420554800" watchObservedRunningTime="2026-07-06 23:57:22.967986174 +0000 UTC m=+73.421413771"
Jul 06 23:57:23.015436 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.014879    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94mm4" podStartSLOduration=66.746299841 podStartE2EDuration="1m13.014857737s" totalImagesPullingTime="6.268557896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:23.014711286 +0000 UTC m=+73.468138873" watchObservedRunningTime="2026-07-06 23:57:23.014857737 +0000 UTC m=+73.468285335"
Jul 06 23:57:23.479188 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.479161    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:23.543393 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.543355    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:23.782918 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.782889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:23.950443 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.950393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:23.953579 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.953546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g79jh" event={"ID":"3d2aa0af-89af-448c-a456-d15cdcf16afc","Type":"ContainerStarted","Data":"7a17169a5e802dd3fe3abd6dc96c4c728454b136254e5c291257fe1d33f4f30b"}
Jul 06 23:57:23.955434 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.955394    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7" event={"ID":"95bb57ac-1234-4827-a903-0d73398aed31","Type":"ContainerStarted","Data":"2a641a71ac2b2f05b7d3e10f6cd9a6bbe0daecdf92fb43a242e6c7c264670e22"}
Jul 06 23:57:23.955551 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.955443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7" event={"ID":"95bb57ac-1234-4827-a903-0d73398aed31","Type":"ContainerStarted","Data":"11ca1a83a5d7359ef15d5b449d37112121fe8cec4517af6f92d6162bf4318055"}
Jul 06 23:57:23.957005 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.956984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbx2j" event={"ID":"2f736d39-4899-47e1-b662-cd7f285ab88e","Type":"ContainerStarted","Data":"b355f5efebabc36c53c8894373d35c89e5eb5ab02462da48bfd2e8a5498d8c85"}
Jul 06 23:57:23.957097 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.957032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbx2j" event={"ID":"2f736d39-4899-47e1-b662-cd7f285ab88e","Type":"ContainerStarted","Data":"36dadb0e97f16c26b7a4dbf36168c934ab0ade69ee348723c8a1489595404690"}
Jul 06 23:57:23.957785 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.957769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c69586d-k95hv"
Jul 06 23:57:23.988347 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:23.988293    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g79jh" podStartSLOduration=67.714231052 podStartE2EDuration="1m13.98827599s" totalImagesPullingTime="6.274044938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:23.987513633 +0000 UTC m=+74.440941234" watchObservedRunningTime="2026-07-06 23:57:23.98827599 +0000 UTC m=+74.441703631"
Jul 06 23:57:24.011052 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.011003    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wbx2j" podStartSLOduration=67.732604767 podStartE2EDuration="1m14.010988764s" totalImagesPullingTime="6.278383997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:24.010489762 +0000 UTC m=+74.463917360" watchObservedRunningTime="2026-07-06 23:57:24.010988764 +0000 UTC m=+74.464416361"
Jul 06 23:57:24.050731 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.050601    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8559464486-nxgr7" podStartSLOduration=2.175668721 podStartE2EDuration="11.050581864s" totalImagesPullingTime="8.874913143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:24.046579439 +0000 UTC m=+74.500007031" watchObservedRunningTime="2026-07-06 23:57:24.050581864 +0000 UTC m=+74.504009461"
Jul 06 23:57:24.078805 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.078771    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.102641 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.102610    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-849gj"]
Jul 06 23:57:24.104796 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.104775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.108075 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:57:24.108193 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108175    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ptknx\""
Jul 06 23:57:24.108267 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108179    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:57:24.108480 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:57:24.108946 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108926    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:57:24.108946 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108943    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:57:24.109061 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.108958    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:57:24.207519 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.207475    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.238966 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.238939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.238977    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmdn\" (UniqueName: \"kubernetes.io/projected/ec1e829c-4541-4162-89c8-032437a7f1cb-kube-api-access-xfmdn\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.238997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-sys\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-metrics-client-ca\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-tls\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239163 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-textfile\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239353 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239353 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-root\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.239353 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.239223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-wtmp\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340319 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340319 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-root\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340319 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-wtmp\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340355    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-root\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmdn\" (UniqueName: \"kubernetes.io/projected/ec1e829c-4541-4162-89c8-032437a7f1cb-kube-api-access-xfmdn\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-sys\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-metrics-client-ca\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340506    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-wtmp\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-tls\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-textfile\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340623 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340572    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec1e829c-4541-4162-89c8-032437a7f1cb-sys\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.340932 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.340867    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-textfile\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.341082 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.341056    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-metrics-client-ca\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.341208 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.341056    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.342745 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.342722    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-tls\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.342745 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.342739    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1e829c-4541-4162-89c8-032437a7f1cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.346946 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.346911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.354677 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.354650    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmdn\" (UniqueName: \"kubernetes.io/projected/ec1e829c-4541-4162-89c8-032437a7f1cb-kube-api-access-xfmdn\") pod \"node-exporter-849gj\" (UID: \"ec1e829c-4541-4162-89c8-032437a7f1cb\") " pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.414605 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.414573    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-849gj"
Jul 06 23:57:24.424206 ip-10-0-141-102 kubenswrapper[2574]: W0706 23:57:24.424172    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1e829c_4541_4162_89c8_032437a7f1cb.slice/crio-47850bafd4adaaf7da500a00b6772c95838e9e3c6c593ccf2031590bddf1a4ea WatchSource:0}: Error finding container 47850bafd4adaaf7da500a00b6772c95838e9e3c6c593ccf2031590bddf1a4ea: Status 404 returned error can't find the container with id 47850bafd4adaaf7da500a00b6772c95838e9e3c6c593ccf2031590bddf1a4ea
Jul 06 23:57:24.464526 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.464472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.577129 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.577098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.678173 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.678076    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.777893 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.777865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.867022 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.866980    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:24.962982 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:24.962888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-849gj" event={"ID":"ec1e829c-4541-4162-89c8-032437a7f1cb","Type":"ContainerStarted","Data":"47850bafd4adaaf7da500a00b6772c95838e9e3c6c593ccf2031590bddf1a4ea"}
Jul 06 23:57:25.191125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.191084    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.290129 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.290104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.391950 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.391912    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.490127 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.490095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.968371 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.968339    2574 generic.go:356] "Generic (PLEG): container finished" podID="ec1e829c-4541-4162-89c8-032437a7f1cb" containerID="c2fc9ed62c4c47449f17796b4efcdcd4dbcbc6837b3ebc59c19399719b099bb6" exitCode=0
Jul 06 23:57:25.968766 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:25.968419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-849gj" event={"ID":"ec1e829c-4541-4162-89c8-032437a7f1cb","Type":"ContainerDied","Data":"c2fc9ed62c4c47449f17796b4efcdcd4dbcbc6837b3ebc59c19399719b099bb6"}
Jul 06 23:57:26.623005 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.622967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.874542 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.874455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.941709 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.941667    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.973832 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.973802    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-849gj" event={"ID":"ec1e829c-4541-4162-89c8-032437a7f1cb","Type":"ContainerStarted","Data":"99e1d33a020584f6f522a031fa97b4a85e6e6c2d96e0dfa964d3e5782a0a56da"}
Jul 06 23:57:26.974212 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.973855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-849gj" event={"ID":"ec1e829c-4541-4162-89c8-032437a7f1cb","Type":"ContainerStarted","Data":"c67bc8972b828a1ed4212ecd09e8bf091deaa51fd5ad7236ac2ee875189629be"}
Jul 06 23:57:26.998733 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:26.998669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-849gj" podStartSLOduration=2.096855546 podStartE2EDuration="2.998654029s" totalImagesPullingTime="837.24126ms" totalInitContainerRuntime="64.557223ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:26.997601598 +0000 UTC m=+77.451029203" watchObservedRunningTime="2026-07-06 23:57:26.998654029 +0000 UTC m=+77.452081625"
Jul 06 23:57:27.408356 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:27.408313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:27.981783 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:27.981738    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.210969 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:28.210937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.307376 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:28.307339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.509041 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:28.508995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.589027 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:28.588939    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.742523 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:28.742497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:30.134667 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:30.134635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:31.421826 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:31.421794    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:31.482374 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:31.482345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:32.658561 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:32.658423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:32.762708 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:32.762674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:32.833841 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:32.833811    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:33.078530 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:33.078489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:35.446461 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:35.446421    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:35.642005 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:35.641969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:35.742493 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:35.742391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:37.487847 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:37.487813    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:37.600423 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:37.600367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:38.497096 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.497054    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" podUID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" containerName="registry" containerID="cri-o://a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f" gracePeriod=30
Jul 06 23:57:38.768704 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.768679    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:38.848553 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848521    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.848734 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848570    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbmcj\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.848734 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848621    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.848734 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848655    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.848734 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848678    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.848927 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848758    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.849624 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.848808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.849729 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.849675    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted\") pod \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\" (UID: \"59ce4fd8-b48a-4f7f-94ae-75797dadd999\") "
Jul 06 23:57:38.850125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.849997    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:38.850125 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.850022    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:38.851799 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.851778    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-certificates\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.852054 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.852035    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59ce4fd8-b48a-4f7f-94ae-75797dadd999-trusted-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.852684 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.852581    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj" (OuterVolumeSpecName: "kube-api-access-vbmcj") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "kube-api-access-vbmcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:38.856009 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.855978    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:38.856009 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.855979    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:38.856181 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.856153    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:38.856373 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.856342    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:38.861621 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.861557    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "59ce4fd8-b48a-4f7f-94ae-75797dadd999" (UID: "59ce4fd8-b48a-4f7f-94ae-75797dadd999"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:57:38.953286 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953245    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbmcj\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-kube-api-access-vbmcj\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.953286 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953275    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-registry-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.953286 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953286    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59ce4fd8-b48a-4f7f-94ae-75797dadd999-bound-sa-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.953286 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953295    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-image-registry-private-configuration\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.953541 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953305    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59ce4fd8-b48a-4f7f-94ae-75797dadd999-installation-pull-secrets\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:38.953541 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:38.953313    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59ce4fd8-b48a-4f7f-94ae-75797dadd999-ca-trust-extracted\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.015319 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.015288    2574 generic.go:356] "Generic (PLEG): container finished" podID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" containerID="a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f" exitCode=0
Jul 06 23:57:39.015468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.015339    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" event={"ID":"59ce4fd8-b48a-4f7f-94ae-75797dadd999","Type":"ContainerDied","Data":"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"}
Jul 06 23:57:39.015468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.015347    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj"
Jul 06 23:57:39.015468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.015419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6955c9b64d-p9nzj" event={"ID":"59ce4fd8-b48a-4f7f-94ae-75797dadd999","Type":"ContainerDied","Data":"89dfaa147b2a4f13093a68485f65f421641d1726d12541ca5c8ea78476f674fd"}
Jul 06 23:57:39.015468 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.015442    2574 scope.go:117] "RemoveContainer" containerID="a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"
Jul 06 23:57:39.023479 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.023458    2574 scope.go:117] "RemoveContainer" containerID="a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"
Jul 06 23:57:39.023752 ip-10-0-141-102 kubenswrapper[2574]: E0706 23:57:39.023730    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f\": container with ID starting with a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f not found: ID does not exist" containerID="a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"
Jul 06 23:57:39.023821 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.023759    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f"} err="failed to get container status \"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f\": rpc error: code = NotFound desc = could not find container \"a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f\": container with ID starting with a50c12375e25b8d0a548c540aed827e6bad5dd47346311976724f0206765c63f not found: ID does not exist"
Jul 06 23:57:39.036342 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.036321    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:57:39.041498 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.041475    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6955c9b64d-p9nzj"]
Jul 06 23:57:39.514180 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.514099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:39.611168 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:39.611133    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:40.086602 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:40.086570    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" path="/var/lib/kubelet/pods/59ce4fd8-b48a-4f7f-94ae-75797dadd999/volumes"
Jul 06 23:57:40.208174 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:40.208146    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:40.309621 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:40.309567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:41.330043 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:41.330008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:41.418199 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:41.418166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:43.094851 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:43.094819    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:43.195526 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:43.195486    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:44.879358 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:44.879323    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:44.937986 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:44.937955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:50.387132 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:50.387096    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:50.465970 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:50.465935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:53.959714 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:53.959684    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94mm4"
Jul 06 23:57:55.688307 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:55.688270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:56.286769 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:57:56.286737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:05.387796 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:05.387741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:05.455571 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:05.455542    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:39.997008 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:39.996975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:40.055123 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:40.055092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:43.783728 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:43.783697    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:43.864929 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:43.864890    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:51.875380 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:51.875344    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:51.936219 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:51.936186    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:54.950853 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:54.950814    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:55.046643 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:55.046614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:55.103237 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:58:55.103202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:05.387218 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:05.387143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:05.488688 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:05.488656    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:05.743220 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:05.743143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:05.898909 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:05.898876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:13.441632 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:13.441597    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:29.171210 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:29.171177    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:32.201363 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:32.201332    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:32.301543 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:32.301505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:54.137550 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:54.137507    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:54.943079 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:54.943050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:57.765460 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:57.765423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:57.887667 ip-10-0-141-102 kubenswrapper[2574]: I0706 23:59:57.887625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:00.414919 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:00.414890    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:00.573394 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:00.573359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:00.762807 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:00.762712    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:00.890387 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:00.890357    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:03.226628 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:03.226595    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:03.302501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:03.302465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:04.687311 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:04.687263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:04.760451 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:04.760419    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:10.709878 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:10.709830    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:11.379257 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.379224    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fc4wb"]
Jul 07 00:00:11.379499 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.379487    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" containerName="registry"
Jul 07 00:00:11.379547 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.379501    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" containerName="registry"
Jul 07 00:00:11.379582 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.379547    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ce4fd8-b48a-4f7f-94ae-75797dadd999" containerName="registry"
Jul 07 00:00:11.381488 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.381473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.383739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.383714    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 00:00:11.383850 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.383717    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 00:00:11.384610 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.384591    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zczwp\""
Jul 07 00:00:11.394885 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.394862    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fc4wb"]
Jul 07 00:00:11.395290 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.395270    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4jx\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-kube-api-access-gs4jx\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.395363 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.395324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-bound-sa-token\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.495987 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.495952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4jx\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-kube-api-access-gs4jx\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.496152 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.496029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-bound-sa-token\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.504556 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.504523    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-bound-sa-token\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.504740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.504720    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4jx\" (UniqueName: \"kubernetes.io/projected/0c53edab-0211-434b-be7e-d5b63e74385f-kube-api-access-gs4jx\") pod \"cert-manager-55b4d954d5-fc4wb\" (UID: \"0c53edab-0211-434b-be7e-d5b63e74385f\") " pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.689691 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.689610    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fc4wb"
Jul 07 00:00:11.806661 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:11.806632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fc4wb"]
Jul 07 00:00:11.809581 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:00:11.809547    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c53edab_0211_434b_be7e_d5b63e74385f.slice/crio-4a396845160e8be1dea4ceacd016e2770a8b7c4b92557ee152c258df4c7c7777 WatchSource:0}: Error finding container 4a396845160e8be1dea4ceacd016e2770a8b7c4b92557ee152c258df4c7c7777: Status 404 returned error can't find the container with id 4a396845160e8be1dea4ceacd016e2770a8b7c4b92557ee152c258df4c7c7777
Jul 07 00:00:12.499184 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:12.499150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fc4wb" event={"ID":"0c53edab-0211-434b-be7e-d5b63e74385f","Type":"ContainerStarted","Data":"4a396845160e8be1dea4ceacd016e2770a8b7c4b92557ee152c258df4c7c7777"}
Jul 07 00:00:20.529814 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:20.529781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fc4wb" event={"ID":"0c53edab-0211-434b-be7e-d5b63e74385f","Type":"ContainerStarted","Data":"dc754078099b58db4ec972851c6517b6e0e2fa23764e2bcdbe52abf4649e83e9"}
Jul 07 00:00:20.545495 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:20.545445    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fc4wb" podStartSLOduration=1.728316349 podStartE2EDuration="9.54543033s" totalImagesPullingTime="7.817113981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:20.544538492 +0000 UTC m=+250.997966088" watchObservedRunningTime="2026-07-07 00:00:20.54543033 +0000 UTC m=+250.998857927"
Jul 07 00:00:20.609042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:20.609011    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:20.673747 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:20.673716    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:36.753911 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:36.753832    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:36.855296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:36.855266    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:41.998738 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:41.998706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:42.092916 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:42.092886    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:44.163987 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:44.163952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:54.413472 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.413433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:54.494248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.494221    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"]
Jul 07 00:00:54.498620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.498600    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.502735 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.502710    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 00:00:54.502977 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.502964    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 00:00:54.503734 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.503705    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m2qsk\""
Jul 07 00:00:54.503861 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.503741    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 00:00:54.503861 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.503741    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 00:00:54.503861 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.503822    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 00:00:54.508686 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.508666    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"]
Jul 07 00:00:54.521435 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.521394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:54.605312 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.605279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-metrics-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.605511 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.605319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kh5\" (UniqueName: \"kubernetes.io/projected/4cd65381-0108-4dcb-b407-c3711a205b4e-kube-api-access-54kh5\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.605511 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.605346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.605511 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.605440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd65381-0108-4dcb-b407-c3711a205b4e-manager-config\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.706310 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.706228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd65381-0108-4dcb-b407-c3711a205b4e-manager-config\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.706310 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.706275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-metrics-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.706531 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.706316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54kh5\" (UniqueName: \"kubernetes.io/projected/4cd65381-0108-4dcb-b407-c3711a205b4e-kube-api-access-54kh5\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.706531 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.706349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.707003 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.706965    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cd65381-0108-4dcb-b407-c3711a205b4e-manager-config\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.708743 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.708721    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-metrics-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.708843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.708792    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cd65381-0108-4dcb-b407-c3711a205b4e-cert\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.715872 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.715851    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kh5\" (UniqueName: \"kubernetes.io/projected/4cd65381-0108-4dcb-b407-c3711a205b4e-kube-api-access-54kh5\") pod \"lws-controller-manager-59b45dbd94-zgmbp\" (UID: \"4cd65381-0108-4dcb-b407-c3711a205b4e\") " pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.807101 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.807062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:54.952301 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:54.952272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"]
Jul 07 00:00:54.952782 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:00:54.952758    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd65381_0108_4dcb_b407_c3711a205b4e.slice/crio-a17b29249244e7e8f3d46bb9826a0904c8b8e05a49de76bd311998f95a4f96b9 WatchSource:0}: Error finding container a17b29249244e7e8f3d46bb9826a0904c8b8e05a49de76bd311998f95a4f96b9: Status 404 returned error can't find the container with id a17b29249244e7e8f3d46bb9826a0904c8b8e05a49de76bd311998f95a4f96b9
Jul 07 00:00:55.642619 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:55.642582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp" event={"ID":"4cd65381-0108-4dcb-b407-c3711a205b4e","Type":"ContainerStarted","Data":"a17b29249244e7e8f3d46bb9826a0904c8b8e05a49de76bd311998f95a4f96b9"}
Jul 07 00:00:55.930457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:55.930331    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:56.031154 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.031113    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:56.536865 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.536825    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:56.793252 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.793168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:56.899727 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.899692    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:56.987644 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.987614    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"]
Jul 07 00:00:56.993743 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.993723    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:56.998797 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.998774    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 00:00:56.999236 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.999215    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 00:00:56.999236 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.999215    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 00:00:56.999392 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.999237    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p27dv\""
Jul 07 00:00:56.999392 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:56.999264    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 00:00:57.069036 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.068955    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"]
Jul 07 00:00:57.125413 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.125380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lb4d\" (UniqueName: \"kubernetes.io/projected/2325653a-30e7-4988-8454-29c9ba011d51-kube-api-access-7lb4d\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.125584 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.125435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.125584 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.125502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.125584 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.125532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.125584 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.125574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.152282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.152221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.226593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.226560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.226787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.226598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.226787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.226638    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.226787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.226671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lb4d\" (UniqueName: \"kubernetes.io/projected/2325653a-30e7-4988-8454-29c9ba011d51-kube-api-access-7lb4d\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.226787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.226690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.227066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.227043    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.229224 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.229195    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2325653a-30e7-4988-8454-29c9ba011d51-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.229515 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.229479    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.229654 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.229538    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2325653a-30e7-4988-8454-29c9ba011d51-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.238921 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.238892    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lb4d\" (UniqueName: \"kubernetes.io/projected/2325653a-30e7-4988-8454-29c9ba011d51-kube-api-access-7lb4d\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-jzlvc\" (UID: \"2325653a-30e7-4988-8454-29c9ba011d51\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.297712 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.297680    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.305524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.305497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:00:57.393584 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.393503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.495582 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.495541    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.626465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.626431    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.804297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.804272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:57.828890 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.828865    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"]
Jul 07 00:00:57.831095 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:00:57.831067    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2325653a_30e7_4988_8454_29c9ba011d51.slice/crio-99131def101abae28c3e6d80dedc4c89773a1083700dbe44ba109e4042a0f2ea WatchSource:0}: Error finding container 99131def101abae28c3e6d80dedc4c89773a1083700dbe44ba109e4042a0f2ea: Status 404 returned error can't find the container with id 99131def101abae28c3e6d80dedc4c89773a1083700dbe44ba109e4042a0f2ea
Jul 07 00:00:57.901539 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:57.901503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:58.656229 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:58.656187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp" event={"ID":"4cd65381-0108-4dcb-b407-c3711a205b4e","Type":"ContainerStarted","Data":"bf947accbcffc2b43ea0b07b29778c8303dd5d3023da7c6bcf7cb25707902ab1"}
Jul 07 00:00:58.656488 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:58.656451    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:00:58.657933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:58.657904    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc" event={"ID":"2325653a-30e7-4988-8454-29c9ba011d51","Type":"ContainerStarted","Data":"99131def101abae28c3e6d80dedc4c89773a1083700dbe44ba109e4042a0f2ea"}
Jul 07 00:00:58.690181 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:00:58.688291    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp" podStartSLOduration=1.906061751 podStartE2EDuration="4.688271398s" totalImagesPullingTime="2.782209647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:58.685756492 +0000 UTC m=+289.139184089" watchObservedRunningTime="2026-07-07 00:00:58.688271398 +0000 UTC m=+289.141698996"
Jul 07 00:01:01.669990 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:01.669950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc" event={"ID":"2325653a-30e7-4988-8454-29c9ba011d51","Type":"ContainerStarted","Data":"be63635cb3db621cacc434f5e1fa3256cb8ececada85ee407b3a66e9f7407f1d"}
Jul 07 00:01:02.674965 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:02.674927    2574 generic.go:356] "Generic (PLEG): container finished" podID="2325653a-30e7-4988-8454-29c9ba011d51" containerID="be63635cb3db621cacc434f5e1fa3256cb8ececada85ee407b3a66e9f7407f1d" exitCode=0
Jul 07 00:01:02.675470 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:02.674974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc" event={"ID":"2325653a-30e7-4988-8454-29c9ba011d51","Type":"ContainerDied","Data":"be63635cb3db621cacc434f5e1fa3256cb8ececada85ee407b3a66e9f7407f1d"}
Jul 07 00:01:03.679777 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:03.679739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc" event={"ID":"2325653a-30e7-4988-8454-29c9ba011d51","Type":"ContainerStarted","Data":"92a13898287b603023911d972c704d4c5d6c6ea5830731d69da31255e32ffc1f"}
Jul 07 00:01:03.680156 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:03.679879    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:01:03.705716 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:03.705669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc" podStartSLOduration=3.342407365 podStartE2EDuration="7.705649938s" totalImagesPullingTime="3.31643947s" totalInitContainerRuntime="1.046803103s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:03.703586518 +0000 UTC m=+294.157014115" watchObservedRunningTime="2026-07-07 00:01:03.705649938 +0000 UTC m=+294.159077537"
Jul 07 00:01:09.664064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:09.664032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59b45dbd94-zgmbp"
Jul 07 00:01:09.958433 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:09.958335    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:01:09.962320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:09.962295    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 00:01:09.971288 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:09.967196    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:01:14.686199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:14.686174    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-jzlvc"
Jul 07 00:01:17.236423 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:17.236367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:20.245514 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:20.245478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:21.187038 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:21.186995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:26.394599 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:26.394564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:26.529816 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:26.529784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:27.362399 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.362363    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"]
Jul 07 00:01:27.365466 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.365450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.367757 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.367733    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 00:01:27.367937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.367921    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ft49l\""
Jul 07 00:01:27.369717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.369699    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 00:01:27.369841 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.369732    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 00:01:27.369841 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.369774    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 00:01:27.369952 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.369933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 00:01:27.370816 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.370799    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 00:01:27.389853 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.389830    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"]
Jul 07 00:01:27.548978 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.548943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.548987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjwt\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-kube-api-access-ppjwt\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.549048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.549093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.549124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.549155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.549376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.549175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.568384 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.568358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:27.650041 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.649964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650041 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.649997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650041 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650250 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650250 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650329 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjwt\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-kube-api-access-ppjwt\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.650329 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.651001 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.650974    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.652489 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.652469    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.652608 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.652571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.652692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.652673    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.652812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.652799    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.675707 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.675681    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjwt\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-kube-api-access-ppjwt\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.680704 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.680681    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c068c77-b940-4a08-9f33-ef7b6f8c45d9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jc7gz\" (UID: \"6c068c77-b940-4a08-9f33-ef7b6f8c45d9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:27.869840 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.869801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:27.974029 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:27.973945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:28.137635 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:28.137596    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"]
Jul 07 00:01:28.141757 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:01:28.141726    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c068c77_b940_4a08_9f33_ef7b6f8c45d9.slice/crio-c28f1f9fb1c059a0c4472eccb2824841047101c61a5fe7b36f21c9f8552eb318 WatchSource:0}: Error finding container c28f1f9fb1c059a0c4472eccb2824841047101c61a5fe7b36f21c9f8552eb318: Status 404 returned error can't find the container with id c28f1f9fb1c059a0c4472eccb2824841047101c61a5fe7b36f21c9f8552eb318
Jul 07 00:01:28.143633 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:28.143618    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:01:28.170646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:28.170615    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:28.763579 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:28.763548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz" event={"ID":"6c068c77-b940-4a08-9f33-ef7b6f8c45d9","Type":"ContainerStarted","Data":"c28f1f9fb1c059a0c4472eccb2824841047101c61a5fe7b36f21c9f8552eb318"}
Jul 07 00:01:30.697754 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:30.697715    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:01:30.698006 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:30.697789    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:01:30.773155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:30.773127    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz" event={"ID":"6c068c77-b940-4a08-9f33-ef7b6f8c45d9","Type":"ContainerStarted","Data":"bc219ca96635b368e96a1c99632c51192c0f631bccb6d9593b2aed1d2ecc5a71"}
Jul 07 00:01:30.773287 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:30.773228    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:31.779460 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:31.779423    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jc7gz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:01:31.779939 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:31.779560    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz" podUID="6c068c77-b940-4a08-9f33-ef7b6f8c45d9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:01:31.930008 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:31.929970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:32.065592 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:32.065494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:32.336121 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:32.336042    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:32.978042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:32.978001    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:34.779386 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:34.779347    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz"
Jul 07 00:01:34.843668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:01:34.843614    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jc7gz" podStartSLOduration=5.289869681 podStartE2EDuration="7.843598626s" totalImagesPullingTime="2.553728945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:30.810782018 +0000 UTC m=+321.264209614" watchObservedRunningTime="2026-07-07 00:01:34.843598626 +0000 UTC m=+325.297026222"
Jul 07 00:02:18.564553 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:18.564507    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:18.660860 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:18.660827    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:18.770740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:18.770700    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:19.488468 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:19.488434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:19.693565 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:19.693530    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:47.506581 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:47.506544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:50.960199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:50.960167    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:52.544176 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:52.544142    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:52.967873 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:52.967792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:54.029109 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:54.029075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:54.207586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:54.207551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:54.958174 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:54.958142    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:55.583765 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:55.583734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:55.724978 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:55.724948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:57.747889 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:57.747854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:59.646325 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:02:59.646294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:01.561517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:01.561482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:01.667954 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:01.667922    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:02.372123 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:02.372090    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:02.501932 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:02.501900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:05.370174 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:05.370138    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:05.472159 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:05.472128    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:05.670980 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:05.670897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:10.523166 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:10.523132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:10.624240 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:10.624213    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:10.923552 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:10.923467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:11.000979 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:11.000946    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:13.214498 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:13.214461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:13.429550 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:13.429513    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:17.620721 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:17.620680    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:17.717986 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:17.717953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:21.662206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:21.662178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:22.445444 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:22.445392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:30.747227 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:30.747192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:30.851395 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:30.851366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:31.190517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:31.190482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:32.819201 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:32.819124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:32.920419 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:32.920377    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:37.534080 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:37.534051    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:37.715028 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:37.714988    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:41.562286 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:41.562250    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:41.674064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:41.674006    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:43.852115 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.852087    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"]
Jul 07 00:03:43.854243 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.854227    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.857383 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.857363    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dkmww\""
Jul 07 00:03:43.868916 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.868892    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"]
Jul 07 00:03:43.885284 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.885260    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:43.930823 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.930787    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.930835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.930858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdlf2\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-kube-api-access-fdlf2\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.930949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.930978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.931004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.931028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931222 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.931048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:43.931222 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:43.931069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032345 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032345 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032623 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032623 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032735 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032791 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032756    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032791 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032892 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdlf2\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-kube-api-access-fdlf2\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032892 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032855    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.032892 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.033047 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.032897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.033158 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.033135    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.033221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.033184    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.033473 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.033456    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.034918 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.034887    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.035071 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.035049    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.041433 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.041380    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.043613 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.043592    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdlf2\" (UniqueName: \"kubernetes.io/projected/2c769803-6427-4fcd-b0fb-26d432cd5bfc-kube-api-access-fdlf2\") pod \"maas-default-gateway-openshift-default-56654dcf7-dfpqm\" (UID: \"2c769803-6427-4fcd-b0fb-26d432cd5bfc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.055582 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.055553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:44.163972 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.163892    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:44.308195 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:44.308170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"]
Jul 07 00:03:44.310275 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:03:44.310252    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c769803_6427_4fcd_b0fb_26d432cd5bfc.slice/crio-d0faeab8a7466bfc92cb83390d174adc12081dc913c7edb86591f97af283a642 WatchSource:0}: Error finding container d0faeab8a7466bfc92cb83390d174adc12081dc913c7edb86591f97af283a642: Status 404 returned error can't find the container with id d0faeab8a7466bfc92cb83390d174adc12081dc913c7edb86591f97af283a642
Jul 07 00:03:45.225782 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:45.225740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" event={"ID":"2c769803-6427-4fcd-b0fb-26d432cd5bfc","Type":"ContainerStarted","Data":"d0faeab8a7466bfc92cb83390d174adc12081dc913c7edb86591f97af283a642"}
Jul 07 00:03:46.436230 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:46.436177    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:03:46.436650 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:46.436283    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:03:46.436650 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:46.436333    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:03:47.236931 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:47.236895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" event={"ID":"2c769803-6427-4fcd-b0fb-26d432cd5bfc","Type":"ContainerStarted","Data":"b59e4d4836ba1ee531579999936596ee79dd698e6f6c31cf2a5ae2669a899d3c"}
Jul 07 00:03:47.274495 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:47.274438    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podStartSLOduration=2.15057096 podStartE2EDuration="4.274395627s" totalImagesPullingTime="2.123824667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:47.268288949 +0000 UTC m=+457.721716544" watchObservedRunningTime="2026-07-07 00:03:47.274395627 +0000 UTC m=+457.727823224"
Jul 07 00:03:48.164484 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.164441    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:48.169261 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.169237    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:48.240693 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.240659    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:48.241674 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.241651    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:03:48.343983 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.343947    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:48.441418 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.441321    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:48.543782 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:48.543748    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:49.236872 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:49.236837    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:49.350581 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:49.350550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:51.773999 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:51.773969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:51.872184 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:51.872156    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:51.994240 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:51.994208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:53.527294 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:53.527257    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:53.595260 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:53.595200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:57.936770 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:57.936727    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:58.042446 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:03:58.042380    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:03.826243 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:03.826205    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:03.899370 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:03.899339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:09.963636 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:09.963580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:28.841526 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:28.841485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:29.526149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:29.526117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:36.003051 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.003014    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:36.005859 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.005843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.007098 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.007067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:36.008269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.008245    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 00:04:36.008385 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.008360    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d4gwg\""
Jul 07 00:04:36.008459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.008387    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 00:04:36.020177 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.020153    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:36.041430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.041388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.041552 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.041441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrk76\" (UniqueName: \"kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.100370 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.100338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:36.142742 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.142706    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.142742 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.142743    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrk76\" (UniqueName: \"kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.145213 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.145194    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.151829 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.151806    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrk76\" (UniqueName: \"kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76\") pod \"maas-controller-7f4dc49dc7-xgklz\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") " pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.193559 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.193525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:36.197820 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.197799    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:04:36.200906 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.200889    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.210950 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.210931    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:04:36.243414 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.243378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7vc\" (UniqueName: \"kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.243577 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.243433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.316220 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.316183    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:36.344111 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.344081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7vc\" (UniqueName: \"kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.344257 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.344132    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.346613 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.346585    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.354064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.354041    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7vc\" (UniqueName: \"kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc\") pod \"maas-controller-7bfd6c446f-x8b5g\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") " pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.447706 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.447680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:36.450081 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:04:36.450056    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae044ec2_2d6c_47ee_8954_b7d9fe7006c6.slice/crio-71571628428f6646fd7048d5ef2eb05cb49ff7bf4ce5663f00497708461aa7af WatchSource:0}: Error finding container 71571628428f6646fd7048d5ef2eb05cb49ff7bf4ce5663f00497708461aa7af: Status 404 returned error can't find the container with id 71571628428f6646fd7048d5ef2eb05cb49ff7bf4ce5663f00497708461aa7af
Jul 07 00:04:36.511486 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.511454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:36.633642 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:36.633611    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:04:36.636560 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:04:36.636516    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce4eb63_3f9a_434a_8616_44c8d0167eb5.slice/crio-416e440ea79d8599a38b3d92f9e2f1732626542e2a09b0fe4dca233b7b7fd5cd WatchSource:0}: Error finding container 416e440ea79d8599a38b3d92f9e2f1732626542e2a09b0fe4dca233b7b7fd5cd: Status 404 returned error can't find the container with id 416e440ea79d8599a38b3d92f9e2f1732626542e2a09b0fe4dca233b7b7fd5cd
Jul 07 00:04:37.416762 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:37.416705    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" event={"ID":"fce4eb63-3f9a-434a-8616-44c8d0167eb5","Type":"ContainerStarted","Data":"416e440ea79d8599a38b3d92f9e2f1732626542e2a09b0fe4dca233b7b7fd5cd"}
Jul 07 00:04:37.419240 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:37.419211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" event={"ID":"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6","Type":"ContainerStarted","Data":"71571628428f6646fd7048d5ef2eb05cb49ff7bf4ce5663f00497708461aa7af"}
Jul 07 00:04:38.944712 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:38.944680    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:39.043133 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.043096    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:39.428484 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.428375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" event={"ID":"fce4eb63-3f9a-434a-8616-44c8d0167eb5","Type":"ContainerStarted","Data":"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"}
Jul 07 00:04:39.428650 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.428486    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:39.429937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.429914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" event={"ID":"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6","Type":"ContainerStarted","Data":"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"}
Jul 07 00:04:39.430048 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.430036    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:39.450117 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.450068    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" podStartSLOduration=1.351466237 podStartE2EDuration="3.450055081s" totalImagesPullingTime="2.098588844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:39.449458147 +0000 UTC m=+509.902885746" watchObservedRunningTime="2026-07-07 00:04:39.450055081 +0000 UTC m=+509.903482677"
Jul 07 00:04:39.466153 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:39.466102    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" podStartSLOduration=2.189830681 podStartE2EDuration="4.466084129s" totalImagesPullingTime="2.276253448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:39.464771321 +0000 UTC m=+509.918198918" watchObservedRunningTime="2026-07-07 00:04:39.466084129 +0000 UTC m=+509.919511724"
Jul 07 00:04:42.192651 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:42.192603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:42.294080 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:42.294046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:50.440151 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.440121    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:04:50.440582 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.440359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:50.501506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.501476    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:50.501701 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.501659    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" podUID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" containerName="manager" containerID="cri-o://e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052" gracePeriod=30
Jul 07 00:04:50.740602 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.740577    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:50.757690 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.757666    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrk76\" (UniqueName: \"kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76\") pod \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") "
Jul 07 00:04:50.757842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.757733    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert\") pod \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\" (UID: \"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6\") "
Jul 07 00:04:50.760106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.760075    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" (UID: "ae044ec2-2d6c-47ee-8954-b7d9fe7006c6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:04:50.760188 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.760125    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76" (OuterVolumeSpecName: "kube-api-access-qrk76") pod "ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" (UID: "ae044ec2-2d6c-47ee-8954-b7d9fe7006c6"). InnerVolumeSpecName "kube-api-access-qrk76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:04:50.858725 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.858692    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-webhook-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:04:50.858725 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:50.858717    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrk76\" (UniqueName: \"kubernetes.io/projected/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6-kube-api-access-qrk76\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:04:51.474315 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.474282    2574 generic.go:356] "Generic (PLEG): container finished" podID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" containerID="e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052" exitCode=0
Jul 07 00:04:51.474739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.474325    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz"
Jul 07 00:04:51.474739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.474344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" event={"ID":"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6","Type":"ContainerDied","Data":"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"}
Jul 07 00:04:51.474739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.474386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4dc49dc7-xgklz" event={"ID":"ae044ec2-2d6c-47ee-8954-b7d9fe7006c6","Type":"ContainerDied","Data":"71571628428f6646fd7048d5ef2eb05cb49ff7bf4ce5663f00497708461aa7af"}
Jul 07 00:04:51.474739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.474425    2574 scope.go:117] "RemoveContainer" containerID="e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"
Jul 07 00:04:51.483242 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.483224    2574 scope.go:117] "RemoveContainer" containerID="e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"
Jul 07 00:04:51.483523 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:04:51.483505    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052\": container with ID starting with e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052 not found: ID does not exist" containerID="e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"
Jul 07 00:04:51.483576 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.483531    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052"} err="failed to get container status \"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052\": rpc error: code = NotFound desc = could not find container \"e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052\": container with ID starting with e1d309a9ef4de122136bf9efb8a9ea2c7070fa69ee3eb9bc05ddfdd5d7041052 not found: ID does not exist"
Jul 07 00:04:51.495190 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.495170    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:51.499140 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:51.499121    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f4dc49dc7-xgklz"]
Jul 07 00:04:52.086599 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:04:52.086566    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" path="/var/lib/kubelet/pods/ae044ec2-2d6c-47ee-8954-b7d9fe7006c6/volumes"
Jul 07 00:05:10.339230 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.339195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:10.855331 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.855271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:10.986813 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.986778    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-688c79454f-t9vb2"]
Jul 07 00:05:10.987040 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.987028    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" containerName="manager"
Jul 07 00:05:10.987082 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.987042    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" containerName="manager"
Jul 07 00:05:10.987115 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.987093    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae044ec2-2d6c-47ee-8954-b7d9fe7006c6" containerName="manager"
Jul 07 00:05:10.989907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.989887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:10.992232 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.992205    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gxc75\""
Jul 07 00:05:10.992337 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:10.992277    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 00:05:11.000157 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.000135    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-688c79454f-t9vb2"]
Jul 07 00:05:11.117069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.116987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.117069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.117037    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmd99\" (UniqueName: \"kubernetes.io/projected/a17fa226-1569-4351-a7f6-c599f3d527a7-kube-api-access-rmd99\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.117249 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.117102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17fa226-1569-4351-a7f6-c599f3d527a7-openshift-service-ca\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.218020 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.217974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17fa226-1569-4351-a7f6-c599f3d527a7-openshift-service-ca\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.218206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.218073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.218206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.218116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmd99\" (UniqueName: \"kubernetes.io/projected/a17fa226-1569-4351-a7f6-c599f3d527a7-kube-api-access-rmd99\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.218318 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:05:11.218235    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 00:05:11.218318 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:05:11.218306    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls podName:a17fa226-1569-4351-a7f6-c599f3d527a7 nodeName:}" failed. No retries permitted until 2026-07-07 00:05:11.718288002 +0000 UTC m=+542.171715596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls") pod "maas-api-688c79454f-t9vb2" (UID: "a17fa226-1569-4351-a7f6-c599f3d527a7") : secret "maas-api-serving-cert" not found
Jul 07 00:05:11.218823 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.218803    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17fa226-1569-4351-a7f6-c599f3d527a7-openshift-service-ca\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.230722 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.230685    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmd99\" (UniqueName: \"kubernetes.io/projected/a17fa226-1569-4351-a7f6-c599f3d527a7-kube-api-access-rmd99\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.267023 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.266990    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:11.367863 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.367787    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:11.451149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.451117    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bfgth"]
Jul 07 00:05:11.451344 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.451158    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:11.453260 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.453243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.455508 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.455484    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 00:05:11.455624 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.455571    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qc7mq\""
Jul 07 00:05:11.463624 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.463599    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bfgth"]
Jul 07 00:05:11.521456 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.521398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec144d6-4db4-4b5f-9171-655e279479e5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.521655 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.521544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79vp\" (UniqueName: \"kubernetes.io/projected/2ec144d6-4db4-4b5f-9171-655e279479e5-kube-api-access-h79vp\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.623013 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.622919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec144d6-4db4-4b5f-9171-655e279479e5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.623013 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.622974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h79vp\" (UniqueName: \"kubernetes.io/projected/2ec144d6-4db4-4b5f-9171-655e279479e5-kube-api-access-h79vp\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.623930 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.623905    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec144d6-4db4-4b5f-9171-655e279479e5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.631356 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.631327    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79vp\" (UniqueName: \"kubernetes.io/projected/2ec144d6-4db4-4b5f-9171-655e279479e5-kube-api-access-h79vp\") pod \"payload-pre-processing-7964457696-bfgth\" (UID: \"2ec144d6-4db4-4b5f-9171-655e279479e5\") " pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.724310 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.724271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.726877 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.726850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a17fa226-1569-4351-a7f6-c599f3d527a7-maas-api-tls\") pod \"maas-api-688c79454f-t9vb2\" (UID: \"a17fa226-1569-4351-a7f6-c599f3d527a7\") " pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:11.764771 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.764739    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:11.889933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.889857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bfgth"]
Jul 07 00:05:11.892807 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:05:11.892781    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec144d6_4db4_4b5f_9171_655e279479e5.slice/crio-1bfd25fc85002f4cfb982f3398899aefed28a0ac598d3ba85a3f2169b07f623a WatchSource:0}: Error finding container 1bfd25fc85002f4cfb982f3398899aefed28a0ac598d3ba85a3f2169b07f623a: Status 404 returned error can't find the container with id 1bfd25fc85002f4cfb982f3398899aefed28a0ac598d3ba85a3f2169b07f623a
Jul 07 00:05:11.899696 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:11.899670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:12.050736 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:12.050704    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-688c79454f-t9vb2"]
Jul 07 00:05:12.053697 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:05:12.053672    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17fa226_1569_4351_a7f6_c599f3d527a7.slice/crio-9d7cba167eec228e7881beb62a235e5d54f720feb6145eb854e5328ab79c9aa7 WatchSource:0}: Error finding container 9d7cba167eec228e7881beb62a235e5d54f720feb6145eb854e5328ab79c9aa7: Status 404 returned error can't find the container with id 9d7cba167eec228e7881beb62a235e5d54f720feb6145eb854e5328ab79c9aa7
Jul 07 00:05:12.552767 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:12.552725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-688c79454f-t9vb2" event={"ID":"a17fa226-1569-4351-a7f6-c599f3d527a7","Type":"ContainerStarted","Data":"9d7cba167eec228e7881beb62a235e5d54f720feb6145eb854e5328ab79c9aa7"}
Jul 07 00:05:12.554004 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:12.553975    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth" event={"ID":"2ec144d6-4db4-4b5f-9171-655e279479e5","Type":"ContainerStarted","Data":"1bfd25fc85002f4cfb982f3398899aefed28a0ac598d3ba85a3f2169b07f623a"}
Jul 07 00:05:13.559738 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:13.559707    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth" event={"ID":"2ec144d6-4db4-4b5f-9171-655e279479e5","Type":"ContainerStarted","Data":"2ce034a3ce3f22f6e6c564cd49b5df0c3eea38fa97c545d133bc825b3de63688"}
Jul 07 00:05:13.560041 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:13.559824    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:13.602453 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:13.602372    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth" podStartSLOduration=1.000113303 podStartE2EDuration="2.602351449s" totalImagesPullingTime="1.602238146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:13.600249364 +0000 UTC m=+544.053676962" watchObservedRunningTime="2026-07-07 00:05:13.602351449 +0000 UTC m=+544.055779051"
Jul 07 00:05:14.569820 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:14.569784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-688c79454f-t9vb2" event={"ID":"a17fa226-1569-4351-a7f6-c599f3d527a7","Type":"ContainerStarted","Data":"cdef267435728e889fc067cd614045e2360e41a64321d9001516857a34b20700"}
Jul 07 00:05:14.570417 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:14.570378    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:14.587385 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:14.587327    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-688c79454f-t9vb2" podStartSLOduration=2.554217284 podStartE2EDuration="4.587306206s" totalImagesPullingTime="2.033088922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:14.585216108 +0000 UTC m=+545.038643717" watchObservedRunningTime="2026-07-07 00:05:14.587306206 +0000 UTC m=+545.040733804"
Jul 07 00:05:18.765168 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:18.765132    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dfpqm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": read tcp 10.133.0.2:42210->10.133.0.17:15021: read: connection reset by peer" start-of-body=
Jul 07 00:05:18.765602 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:18.765206    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podUID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": read tcp 10.133.0.2:42210->10.133.0.17:15021: read: connection reset by peer"
Jul 07 00:05:19.593490 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.593456    2574 generic.go:356] "Generic (PLEG): container finished" podID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerID="b59e4d4836ba1ee531579999936596ee79dd698e6f6c31cf2a5ae2669a899d3c" exitCode=0
Jul 07 00:05:19.593663 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.593527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" event={"ID":"2c769803-6427-4fcd-b0fb-26d432cd5bfc","Type":"ContainerDied","Data":"b59e4d4836ba1ee531579999936596ee79dd698e6f6c31cf2a5ae2669a899d3c"}
Jul 07 00:05:19.593893 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.593880    2574 scope.go:117] "RemoveContainer" containerID="b59e4d4836ba1ee531579999936596ee79dd698e6f6c31cf2a5ae2669a899d3c"
Jul 07 00:05:19.594842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.594816    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:05:19.594898 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.594882    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:05:19.594937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:19.594913    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:05:20.599624 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:20.599589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" event={"ID":"2c769803-6427-4fcd-b0fb-26d432cd5bfc","Type":"ContainerStarted","Data":"4cc55f8ed82afde1d2db22f562dec8bea2d472111ae15cee4bd04a4d073230cd"}
Jul 07 00:05:21.164962 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:21.164931    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:05:21.165331 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:21.165306    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dfpqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 07 00:05:21.165552 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:21.165525    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podUID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 07 00:05:21.588309 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:21.588282    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-688c79454f-t9vb2"
Jul 07 00:05:22.037928 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:22.037898    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:22.165246 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:22.165202    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dfpqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 07 00:05:22.165464 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:22.165274    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podUID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 07 00:05:22.588898 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:22.588861    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:22.745148 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:22.745114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:23.164524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:23.164481    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dfpqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 07 00:05:23.165021 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:23.164572    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podUID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 07 00:05:24.175930 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:24.175888    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dfpqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 07 00:05:24.176560 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:24.176518    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm" podUID="2c769803-6427-4fcd-b0fb-26d432cd5bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 07 00:05:24.571688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:24.571661    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-bfgth"
Jul 07 00:05:25.167695 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:25.167667    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:05:25.168061 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:25.168040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:05:25.168794 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:25.168774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dfpqm"
Jul 07 00:05:30.421126 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:30.421093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:31.358243 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:31.358207    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:37.071142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.071112    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"]
Jul 07 00:05:37.079364 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.079339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.082198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.082173    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gq64g\""
Jul 07 00:05:37.082697 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.082465    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 00:05:37.083196 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.083179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 00:05:37.083320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.083274    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 00:05:37.088760 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.088736    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"]
Jul 07 00:05:37.103951 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.103922    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:37.230238 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.230238 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpf9\" (UniqueName: \"kubernetes.io/projected/a198faff-11d3-41f2-9cc7-f7cf02b032a1-kube-api-access-8hpf9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.230541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230275    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.230541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230352    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.230541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.230541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.230492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.330935 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.330841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.330935 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.330883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpf9\" (UniqueName: \"kubernetes.io/projected/a198faff-11d3-41f2-9cc7-f7cf02b032a1-kube-api-access-8hpf9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.330935 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.330925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331193 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.330951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331193 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.330974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331193 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.331030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.331354    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.331398    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.331673 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.331654    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.333477 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.333455    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a198faff-11d3-41f2-9cc7-f7cf02b032a1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.333625 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.333605    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a198faff-11d3-41f2-9cc7-f7cf02b032a1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.339518 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.339493    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpf9\" (UniqueName: \"kubernetes.io/projected/a198faff-11d3-41f2-9cc7-f7cf02b032a1-kube-api-access-8hpf9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hz7tr\" (UID: \"a198faff-11d3-41f2-9cc7-f7cf02b032a1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.390422 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.390369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:37.521230 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.521177    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"]
Jul 07 00:05:37.523499 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:05:37.523472    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda198faff_11d3_41f2_9cc7_f7cf02b032a1.slice/crio-3a68010e3f80a29b9547e1191507f21de009dbd63fbcac1be754d3fdeb9990fa WatchSource:0}: Error finding container 3a68010e3f80a29b9547e1191507f21de009dbd63fbcac1be754d3fdeb9990fa: Status 404 returned error can't find the container with id 3a68010e3f80a29b9547e1191507f21de009dbd63fbcac1be754d3fdeb9990fa
Jul 07 00:05:37.665821 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:37.665733    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr" event={"ID":"a198faff-11d3-41f2-9cc7-f7cf02b032a1","Type":"ContainerStarted","Data":"3a68010e3f80a29b9547e1191507f21de009dbd63fbcac1be754d3fdeb9990fa"}
Jul 07 00:05:38.673238 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:38.673197    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr" event={"ID":"a198faff-11d3-41f2-9cc7-f7cf02b032a1","Type":"ContainerStarted","Data":"bf391cc684c5074642d09c060dcd18af6f7b6dccd1931266488190cdfcbeba62"}
Jul 07 00:05:38.693506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:38.693439    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr" podStartSLOduration=0.626596501 podStartE2EDuration="1.693422913s" totalImagesPullingTime="1.066826412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:38.691501716 +0000 UTC m=+569.144929311" watchObservedRunningTime="2026-07-07 00:05:38.693422913 +0000 UTC m=+569.146850502"
Jul 07 00:05:42.596997 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:42.596967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:45.136842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.136806    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"]
Jul 07 00:05:45.144953 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.144919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.147725 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.147700    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 00:05:45.151937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.151914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"]
Jul 07 00:05:45.183649 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.183614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:45.302264 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpxv\" (UniqueName: \"kubernetes.io/projected/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-kube-api-access-9fpxv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.302264 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.302517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.302517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.302517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.302517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.302470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.403730 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.403730 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpxv\" (UniqueName: \"kubernetes.io/projected/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-kube-api-access-9fpxv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.403730 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404007 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404007 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404007 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.403782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.404225    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404321 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.404275    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.404321 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.404310    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.406126 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.406101    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.406442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.406419    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.412698 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.412673    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpxv\" (UniqueName: \"kubernetes.io/projected/83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5-kube-api-access-9fpxv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf\" (UID: \"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.456751 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.456714    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:45.583619 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.583597    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"]
Jul 07 00:05:45.586205 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:05:45.586171    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d1c37f_71f1_47df_a4d6_7b4f3d6c01c5.slice/crio-648440b3f23fbee6d10126b830da540c6763a35b84645a16d196817e5b5c33a4 WatchSource:0}: Error finding container 648440b3f23fbee6d10126b830da540c6763a35b84645a16d196817e5b5c33a4: Status 404 returned error can't find the container with id 648440b3f23fbee6d10126b830da540c6763a35b84645a16d196817e5b5c33a4
Jul 07 00:05:45.699851 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:45.699760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf" event={"ID":"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5","Type":"ContainerStarted","Data":"648440b3f23fbee6d10126b830da540c6763a35b84645a16d196817e5b5c33a4"}
Jul 07 00:05:46.705222 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:46.705184    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf" event={"ID":"83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5","Type":"ContainerStarted","Data":"2e2442c22a82da7217331a421921283e73bfcd3f7e8763c2a136d40104d7227f"}
Jul 07 00:05:46.728296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:46.728240    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf" podStartSLOduration=1.554657272 podStartE2EDuration="1.728223149s" totalImagesPullingTime="173.565877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:46.726570381 +0000 UTC m=+577.179997988" watchObservedRunningTime="2026-07-07 00:05:46.728223149 +0000 UTC m=+577.181650767"
Jul 07 00:05:47.391054 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:47.391016    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:47.391225 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:47.391073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:47.403546 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:47.403517    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:47.720617 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:47.720527    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hz7tr"
Jul 07 00:05:52.156502 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.156468    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"]
Jul 07 00:05:52.159355 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.159334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.162050 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.162030    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 00:05:52.187871 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.187847    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"]
Jul 07 00:05:52.259168 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.259168 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.259374 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.259374 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.259374 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5bc7\" (UniqueName: \"kubernetes.io/projected/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-kube-api-access-q5bc7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.259374 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.259309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.284718 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.284680    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:52.359875 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.359838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.359886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.359915    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.359936    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5bc7\" (UniqueName: \"kubernetes.io/projected/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-kube-api-access-q5bc7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.359959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.360013    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.360355    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360469 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.360440    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.360521 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.360489    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.362204 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.362177    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.362498 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.362480    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.370142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.370114    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5bc7\" (UniqueName: \"kubernetes.io/projected/0710e1f3-1593-4c5e-83c9-c39a2e2b5563-kube-api-access-q5bc7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zm6bw\" (UID: \"0710e1f3-1593-4c5e-83c9-c39a2e2b5563\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.470106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.470034    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:05:52.596434 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.596395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"]
Jul 07 00:05:52.599023 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:05:52.598997    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0710e1f3_1593_4c5e_83c9_c39a2e2b5563.slice/crio-20c3526b87d28ac9ead00ffae37d79895de4f64c432324598a025cfaa088b427 WatchSource:0}: Error finding container 20c3526b87d28ac9ead00ffae37d79895de4f64c432324598a025cfaa088b427: Status 404 returned error can't find the container with id 20c3526b87d28ac9ead00ffae37d79895de4f64c432324598a025cfaa088b427
Jul 07 00:05:52.730143 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:52.730059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw" event={"ID":"0710e1f3-1593-4c5e-83c9-c39a2e2b5563","Type":"ContainerStarted","Data":"20c3526b87d28ac9ead00ffae37d79895de4f64c432324598a025cfaa088b427"}
Jul 07 00:05:53.735602 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:53.735559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw" event={"ID":"0710e1f3-1593-4c5e-83c9-c39a2e2b5563","Type":"ContainerStarted","Data":"3c089178ccfb645899eccf676c95eb19982162d41bf794bebdca437f486381bb"}
Jul 07 00:05:53.754901 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:53.754849    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw" podStartSLOduration=1.572438895 podStartE2EDuration="1.754833902s" totalImagesPullingTime="182.395007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:53.75348868 +0000 UTC m=+584.206916278" watchObservedRunningTime="2026-07-07 00:05:53.754833902 +0000 UTC m=+584.208261497"
Jul 07 00:05:55.457234 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:55.457192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:55.457646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:55.457303    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:55.469817 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:55.469791    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:55.755795 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:55.755714    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf"
Jul 07 00:05:59.387497 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:05:59.387463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:06:02.470488 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:02.470450    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:06:02.470920 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:02.470520    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:06:02.483014 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:02.482985    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:06:02.784079 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:02.784045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zm6bw"
Jul 07 00:06:09.983114 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:09.983081    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:06:09.994220 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:09.994196    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:06:34.354322 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:34.354206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:06:35.667298 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:35.667255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:06:56.254570 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:06:56.254517    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:07:46.646177 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:46.646143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:07:46.742146 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:46.742112    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:07:46.742358 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:46.742317    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" podUID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" containerName="manager" containerID="cri-o://7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0" gracePeriod=30
Jul 07 00:07:46.988597 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:46.988567    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:07:47.016296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.016264    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7vc\" (UniqueName: \"kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc\") pod \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") "
Jul 07 00:07:47.016467 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.016323    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert\") pod \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\" (UID: \"fce4eb63-3f9a-434a-8616-44c8d0167eb5\") "
Jul 07 00:07:47.018374 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.018348    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fce4eb63-3f9a-434a-8616-44c8d0167eb5" (UID: "fce4eb63-3f9a-434a-8616-44c8d0167eb5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:07:47.018490 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.018369    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc" (OuterVolumeSpecName: "kube-api-access-dr7vc") pod "fce4eb63-3f9a-434a-8616-44c8d0167eb5" (UID: "fce4eb63-3f9a-434a-8616-44c8d0167eb5"). InnerVolumeSpecName "kube-api-access-dr7vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:47.117064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.117021    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7vc\" (UniqueName: \"kubernetes.io/projected/fce4eb63-3f9a-434a-8616-44c8d0167eb5-kube-api-access-dr7vc\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:07:47.117064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.117061    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce4eb63-3f9a-434a-8616-44c8d0167eb5-webhook-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:07:47.206311 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.206224    2574 generic.go:356] "Generic (PLEG): container finished" podID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" containerID="7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0" exitCode=0
Jul 07 00:07:47.206311 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.206266    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g"
Jul 07 00:07:47.206501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.206308    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" event={"ID":"fce4eb63-3f9a-434a-8616-44c8d0167eb5","Type":"ContainerDied","Data":"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"}
Jul 07 00:07:47.206501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.206360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-x8b5g" event={"ID":"fce4eb63-3f9a-434a-8616-44c8d0167eb5","Type":"ContainerDied","Data":"416e440ea79d8599a38b3d92f9e2f1732626542e2a09b0fe4dca233b7b7fd5cd"}
Jul 07 00:07:47.206501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.206383    2574 scope.go:117] "RemoveContainer" containerID="7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"
Jul 07 00:07:47.214569 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.214547    2574 scope.go:117] "RemoveContainer" containerID="7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"
Jul 07 00:07:47.214835 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:07:47.214814    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0\": container with ID starting with 7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0 not found: ID does not exist" containerID="7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"
Jul 07 00:07:47.214906 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.214844    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0"} err="failed to get container status \"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0\": rpc error: code = NotFound desc = could not find container \"7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0\": container with ID starting with 7db26b98ec0973a2ce7826b21403147b1ca78b2148478a31ceaf5c2b302dfef0 not found: ID does not exist"
Jul 07 00:07:47.228151 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.228126    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:07:47.232996 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.232974    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-x8b5g"]
Jul 07 00:07:47.889745 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.889714    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:07:47.998530 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.998494    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-r5xwj"]
Jul 07 00:07:47.998794 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.998783    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" containerName="manager"
Jul 07 00:07:47.998836 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.998796    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" containerName="manager"
Jul 07 00:07:47.998869 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:47.998852    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" containerName="manager"
Jul 07 00:07:48.002718 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.002700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.006147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.006124    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 00:07:48.006147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.006137    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d4gwg\""
Jul 07 00:07:48.006347 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.006183    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 00:07:48.010752 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.010728    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-r5xwj"]
Jul 07 00:07:48.023806 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.023775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2e7165-7713-42bc-850f-5588d575155a-webhook-cert\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.024015 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.023860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4nff\" (UniqueName: \"kubernetes.io/projected/2d2e7165-7713-42bc-850f-5588d575155a-kube-api-access-w4nff\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.089129 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.089088    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce4eb63-3f9a-434a-8616-44c8d0167eb5" path="/var/lib/kubelet/pods/fce4eb63-3f9a-434a-8616-44c8d0167eb5/volumes"
Jul 07 00:07:48.125121 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.125083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4nff\" (UniqueName: \"kubernetes.io/projected/2d2e7165-7713-42bc-850f-5588d575155a-kube-api-access-w4nff\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.125304 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.125204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2e7165-7713-42bc-850f-5588d575155a-webhook-cert\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.127728 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.127707    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2e7165-7713-42bc-850f-5588d575155a-webhook-cert\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.132955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.132930    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4nff\" (UniqueName: \"kubernetes.io/projected/2d2e7165-7713-42bc-850f-5588d575155a-kube-api-access-w4nff\") pod \"maas-controller-7bfd6c446f-r5xwj\" (UID: \"2d2e7165-7713-42bc-850f-5588d575155a\") " pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.313512 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.313480    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:48.439915 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.439879    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfd6c446f-r5xwj"]
Jul 07 00:07:48.442896 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:07:48.442867    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2e7165_7713_42bc_850f_5588d575155a.slice/crio-6f45671ccebbabc6943253078c7380dee214efcc292674e3b49b204a01f0d5e5 WatchSource:0}: Error finding container 6f45671ccebbabc6943253078c7380dee214efcc292674e3b49b204a01f0d5e5: Status 404 returned error can't find the container with id 6f45671ccebbabc6943253078c7380dee214efcc292674e3b49b204a01f0d5e5
Jul 07 00:07:48.444269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:48.444248    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:07:49.217019 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:49.216983    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj" event={"ID":"2d2e7165-7713-42bc-850f-5588d575155a","Type":"ContainerStarted","Data":"304d8fb658a1ef6e343254b4669537e5c455aacd689aea95ab14e0144173484c"}
Jul 07 00:07:49.217421 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:49.217043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj" event={"ID":"2d2e7165-7713-42bc-850f-5588d575155a","Type":"ContainerStarted","Data":"6f45671ccebbabc6943253078c7380dee214efcc292674e3b49b204a01f0d5e5"}
Jul 07 00:07:49.217421 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:49.217073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:07:49.237035 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:07:49.236985    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj" podStartSLOduration=1.65485171 podStartE2EDuration="2.236968819s" totalImagesPullingTime="582.117109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:49.234862541 +0000 UTC m=+699.688290137" watchObservedRunningTime="2026-07-07 00:07:49.236968819 +0000 UTC m=+699.690396415"
Jul 07 00:08:00.227954 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:00.227924    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bfd6c446f-r5xwj"
Jul 07 00:08:18.129838 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:18.129797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:28.386241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:28.386203    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:28.485159 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:28.485126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:28.587180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:28.587148    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:34.274105 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:34.274066    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:34.381571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:34.381538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:34.474108 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:34.474071    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:34.627899 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:34.627807    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:40.382107 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:40.382065    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:40.482857 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:08:40.482824    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:11:10.007469 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:11:10.007379    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:11:10.015709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:11:10.015630    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:12:52.797990 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:12:52.797942    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:12:58.176167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:12:58.176131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:13:35.606293 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:13:35.606256    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:13:35.707322 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:13:35.707288    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:37.167651 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:14:37.167611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:10.033671 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:16:10.033639    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:16:10.039255 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:16:10.039235    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:19:27.779783 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:27.779741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:37.349450 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:37.349398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:45.606709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:45.606669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:50.744037 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:50.744003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:53.678451 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:53.678393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:53.847781 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:53.847742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:54.112869 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:54.112830    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:59.879184 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:59.879147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:59.947958 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:19:59.947927    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:00.045161 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.045124    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:00.048756 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.048732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.051868 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.051847    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a9ff2fdc-openshift-default-dockercfg-99bxn\""
Jul 07 00:20:00.072901 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.072872    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:00.082741 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.082876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.082876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.082876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnjnf\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.083001 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.083001 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.083001 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.082983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.083152 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.083020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.083152 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.083080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.087566 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.087512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:00.154670 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.154573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:00.183849 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.183805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnjnf\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.183859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.183898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.183923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.183962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184488 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184306    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184631 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184601    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184723 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184679    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.184777 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184737    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.185014 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.184975    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.186657 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.186626    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.186782 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.186724    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.191853 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.191831    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnjnf\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.192479 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.192462    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token\") pod \"e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") " pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.359148 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.359111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:00.490768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.490739    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:00.493382 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:00.493350    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbc55be_a8ed_4eb9_9b2e_19daa889b60f.slice/crio-9579577c3ba75fa5a97b01c902ad6669b6f45824341671b6e71297fefca38a48 WatchSource:0}: Error finding container 9579577c3ba75fa5a97b01c902ad6669b6f45824341671b6e71297fefca38a48: Status 404 returned error can't find the container with id 9579577c3ba75fa5a97b01c902ad6669b6f45824341671b6e71297fefca38a48
Jul 07 00:20:00.495844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.495816    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:00.495928 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.495876    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:00.495928 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:00.495909    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:01.196646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.196608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" event={"ID":"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f","Type":"ContainerStarted","Data":"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"}
Jul 07 00:20:01.197052 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.196676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" event={"ID":"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f","Type":"ContainerStarted","Data":"9579577c3ba75fa5a97b01c902ad6669b6f45824341671b6e71297fefca38a48"}
Jul 07 00:20:01.229109 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.229045    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" podStartSLOduration=1.229023334 podStartE2EDuration="1.229023334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:01.22691189 +0000 UTC m=+1431.680339485" watchObservedRunningTime="2026-07-07 00:20:01.229023334 +0000 UTC m=+1431.682450931"
Jul 07 00:20:01.242348 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.242316    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:01.342769 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.342733    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:01.359627 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.359600    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:01.365796 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.365770    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:01.425974 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.425942    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:01.429189 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.429167    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.431721 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.431702    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a9ff2fdc-serving-cert\""
Jul 07 00:20:01.441739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.441717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:01.469986 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.469892    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:01.493622 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.493595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.493772 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.493647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.493772 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.493676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcwd\" (UniqueName: \"kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.571189 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.571143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:01.594157 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.594124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.594334 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.594167    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.594442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.594336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcwd\" (UniqueName: \"kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.594854 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.594831    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.596693 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.596675    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.604518 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.604478    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcwd\" (UniqueName: \"kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd\") pod \"maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") " pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.745743 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.745644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:01.899556 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.899524    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:01.902759 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:01.902732    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac6b9a1_c469_4575_8523_6152918b5b56.slice/crio-8ab9713e6fa79633bd071b53f1fe6802cac8544fe1da0b3727f56f5984265d95 WatchSource:0}: Error finding container 8ab9713e6fa79633bd071b53f1fe6802cac8544fe1da0b3727f56f5984265d95: Status 404 returned error can't find the container with id 8ab9713e6fa79633bd071b53f1fe6802cac8544fe1da0b3727f56f5984265d95
Jul 07 00:20:01.904948 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:01.904922    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:20:02.100418 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:02.100378    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:02.202198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:02.202161    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:02.202675 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:02.202383    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" event={"ID":"0ac6b9a1-c469-4575-8523-6152918b5b56","Type":"ContainerStarted","Data":"8ab9713e6fa79633bd071b53f1fe6802cac8544fe1da0b3727f56f5984265d95"}
Jul 07 00:20:02.202745 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:02.202713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:02.203531 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:02.203512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:03.208642 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:03.208594    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" event={"ID":"0ac6b9a1-c469-4575-8523-6152918b5b56","Type":"ContainerStarted","Data":"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"}
Jul 07 00:20:03.227929 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:03.227864    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" podStartSLOduration=1.7065945409999999 podStartE2EDuration="2.227843224s" totalImagesPullingTime="521.248683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:03.226470716 +0000 UTC m=+1433.679898313" watchObservedRunningTime="2026-07-07 00:20:03.227843224 +0000 UTC m=+1433.681270822"
Jul 07 00:20:03.670855 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:03.670818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:04.213303 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:04.213270    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:06.355456 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.355393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:06.502728 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.502687    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:06.502934 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.502905    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" podUID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" containerName="istio-proxy" containerID="cri-o://89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25" gracePeriod=30
Jul 07 00:20:06.535616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.535575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:06.696699 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.696596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:06.842273 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.842235    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:06.842565 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.842532    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" podUID="0ac6b9a1-c469-4575-8523-6152918b5b56" containerName="maas-api" containerID="cri-o://6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d" gracePeriod=30
Jul 07 00:20:06.879428 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:06.877711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:07.112272 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.112245    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:07.135363 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.135332    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca\") pod \"0ac6b9a1-c469-4575-8523-6152918b5b56\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") "
Jul 07 00:20:07.135524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.135388    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls\") pod \"0ac6b9a1-c469-4575-8523-6152918b5b56\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") "
Jul 07 00:20:07.135524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.135436    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcwd\" (UniqueName: \"kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd\") pod \"0ac6b9a1-c469-4575-8523-6152918b5b56\" (UID: \"0ac6b9a1-c469-4575-8523-6152918b5b56\") "
Jul 07 00:20:07.135680 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.135659    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ac6b9a1-c469-4575-8523-6152918b5b56" (UID: "0ac6b9a1-c469-4575-8523-6152918b5b56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:07.137589 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.137561    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd" (OuterVolumeSpecName: "kube-api-access-4zcwd") pod "0ac6b9a1-c469-4575-8523-6152918b5b56" (UID: "0ac6b9a1-c469-4575-8523-6152918b5b56"). InnerVolumeSpecName "kube-api-access-4zcwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:07.137692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.137567    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ac6b9a1-c469-4575-8523-6152918b5b56" (UID: "0ac6b9a1-c469-4575-8523-6152918b5b56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:20:07.226336 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.226241    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ac6b9a1-c469-4575-8523-6152918b5b56" containerID="6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d" exitCode=0
Jul 07 00:20:07.226336 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.226284    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"
Jul 07 00:20:07.226548 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.226331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" event={"ID":"0ac6b9a1-c469-4575-8523-6152918b5b56","Type":"ContainerDied","Data":"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"}
Jul 07 00:20:07.226548 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.226379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l" event={"ID":"0ac6b9a1-c469-4575-8523-6152918b5b56","Type":"ContainerDied","Data":"8ab9713e6fa79633bd071b53f1fe6802cac8544fe1da0b3727f56f5984265d95"}
Jul 07 00:20:07.226548 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.226413    2574 scope.go:117] "RemoveContainer" containerID="6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"
Jul 07 00:20:07.238822 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.238785    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac6b9a1-c469-4575-8523-6152918b5b56-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:07.238932 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.238864    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcwd\" (UniqueName: \"kubernetes.io/projected/0ac6b9a1-c469-4575-8523-6152918b5b56-kube-api-access-4zcwd\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:07.238932 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.238887    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac6b9a1-c469-4575-8523-6152918b5b56-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:07.238932 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.238867    2574 scope.go:117] "RemoveContainer" containerID="6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"
Jul 07 00:20:07.239573 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:07.239540    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d\": container with ID starting with 6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d not found: ID does not exist" containerID="6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"
Jul 07 00:20:07.239681 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.239581    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d"} err="failed to get container status \"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d\": rpc error: code = NotFound desc = could not find container \"6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d\": container with ID starting with 6b7d298feb9cda1e00c4fa57c856a17b63ddc7ae7f08fa59027d4698e46fae7d not found: ID does not exist"
Jul 07 00:20:07.252177 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.252150    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:07.256964 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:07.256939    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9ff2fdc-6c5684c877-zsh9l"]
Jul 07 00:20:08.090309 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:08.090264    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac6b9a1-c469-4575-8523-6152918b5b56" path="/var/lib/kubelet/pods/0ac6b9a1-c469-4575-8523-6152918b5b56/volumes"
Jul 07 00:20:08.647869 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:08.647828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.450028 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.450005    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:12.468047 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.468013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.477302 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477280    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnjnf\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477455 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477335    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477455 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477351    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477455 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477374    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477455 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477455 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477456    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477528    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477553    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477584    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket\") pod \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\" (UID: \"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f\") "
Jul 07 00:20:12.477715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477637    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:12.477715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477655    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:12.477974 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477806    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:12.477974 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477865    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.477974 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.477884    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.478174 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.478083    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:12.478234 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.478168    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:12.480052 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.480003    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf" (OuterVolumeSpecName: "kube-api-access-xnjnf") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "kube-api-access-xnjnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:12.480469 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.480444    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:20:12.480575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.480480    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:12.480575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.480489    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" (UID: "ebbc55be-a8ed-4eb9-9b2e-19daa889b60f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:12.536274 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.536240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.578367 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578339    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578367 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578364    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578374    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578383    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578391    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578413    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnjnf\" (UniqueName: \"kubernetes.io/projected/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-kube-api-access-xnjnf\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.578571 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.578425    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:12.644704 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.644670    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:12.644997 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.644984    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac6b9a1-c469-4575-8523-6152918b5b56" containerName="maas-api"
Jul 07 00:20:12.645058 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.644998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac6b9a1-c469-4575-8523-6152918b5b56" containerName="maas-api"
Jul 07 00:20:12.645058 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.645014    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" containerName="istio-proxy"
Jul 07 00:20:12.645058 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.645020    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" containerName="istio-proxy"
Jul 07 00:20:12.645210 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.645072    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" containerName="istio-proxy"
Jul 07 00:20:12.645210 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.645082    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac6b9a1-c469-4575-8523-6152918b5b56" containerName="maas-api"
Jul 07 00:20:12.647376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.647349    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.650470 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.650447    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-86a17854-openshift-default-dockercfg-qrb2w\""
Jul 07 00:20:12.665939 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.665917    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:12.679098 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679225 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679225 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679332 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk5bw\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679332 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679443 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679443 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679551 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.679601 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.679544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.680893 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.680868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.780464 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.780626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk5bw\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.780626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.780705 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.780705 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.780798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781570 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.780805    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781570 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.781364    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781570 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.781380    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.781608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781864 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.781811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.781915 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.781886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.783534 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.782868    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.783534 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.783180    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.783700 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.783679    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.788028 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.784716    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.788028 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.786341    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.789964 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.789941    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.790101 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.790083    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk5bw\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw\") pod \"e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") " pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:12.958569 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:12.958532    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:13.086514 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.086426    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:13.089224 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:13.089195    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c20187e_5cef_4db7_abec_6f9845b97348.slice/crio-cf275e56da03bd3fe20d1471fc185cd86b32be887c63061fe70b426adbf6dbc6 WatchSource:0}: Error finding container cf275e56da03bd3fe20d1471fc185cd86b32be887c63061fe70b426adbf6dbc6: Status 404 returned error can't find the container with id cf275e56da03bd3fe20d1471fc185cd86b32be887c63061fe70b426adbf6dbc6
Jul 07 00:20:13.091259 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.091227    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:13.091342 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.091291    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:13.091342 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.091316    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:13.255673 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.255637    2574 generic.go:356] "Generic (PLEG): container finished" podID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" containerID="89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25" exitCode=0
Jul 07 00:20:13.255848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.255694    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"
Jul 07 00:20:13.255848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.255733    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" event={"ID":"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f","Type":"ContainerDied","Data":"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"}
Jul 07 00:20:13.255848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.255791    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv" event={"ID":"ebbc55be-a8ed-4eb9-9b2e-19daa889b60f","Type":"ContainerDied","Data":"9579577c3ba75fa5a97b01c902ad6669b6f45824341671b6e71297fefca38a48"}
Jul 07 00:20:13.255848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.255823    2574 scope.go:117] "RemoveContainer" containerID="89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"
Jul 07 00:20:13.257709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.257682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" event={"ID":"0c20187e-5cef-4db7-abec-6f9845b97348","Type":"ContainerStarted","Data":"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"}
Jul 07 00:20:13.257830 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.257728    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" event={"ID":"0c20187e-5cef-4db7-abec-6f9845b97348","Type":"ContainerStarted","Data":"cf275e56da03bd3fe20d1471fc185cd86b32be887c63061fe70b426adbf6dbc6"}
Jul 07 00:20:13.266055 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.266036    2574 scope.go:117] "RemoveContainer" containerID="89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"
Jul 07 00:20:13.266329 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:13.266311    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25\": container with ID starting with 89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25 not found: ID does not exist" containerID="89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"
Jul 07 00:20:13.266447 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.266336    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25"} err="failed to get container status \"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25\": rpc error: code = NotFound desc = could not find container \"89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25\": container with ID starting with 89eb9c8eb7e66af053dc07ccf709189a981b37aa9951e0825a16b46daa661c25 not found: ID does not exist"
Jul 07 00:20:13.280205 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.280142    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" podStartSLOduration=1.280126144 podStartE2EDuration="1.280126144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:13.279393222 +0000 UTC m=+1443.732820818" watchObservedRunningTime="2026-07-07 00:20:13.280126144 +0000 UTC m=+1443.733553742"
Jul 07 00:20:13.292280 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.292251    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:13.295292 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.295268    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a9ff2fdc-openshift-default-f6b776657-8d7mv"]
Jul 07 00:20:13.413048 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.412959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:13.869983 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.869921    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:13.959389 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.959359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:13.969804 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:13.969770    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.039563 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.039536    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:14.042649 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.042627    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.045510 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.045492    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-86a17854-serving-cert\""
Jul 07 00:20:14.054773 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.054754    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:14.088554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.088524    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebbc55be-a8ed-4eb9-9b2e-19daa889b60f" path="/var/lib/kubelet/pods/ebbc55be-a8ed-4eb9-9b2e-19daa889b60f/volumes"
Jul 07 00:20:14.090241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.090217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.093329 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.093300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.093450 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.093348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvtj\" (UniqueName: \"kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.093450 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.093382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.194538 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.194458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.194710 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.194547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.194710 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.194571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvtj\" (UniqueName: \"kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.195211 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.195190    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.196875 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.196856    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.200880 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.200855    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.206799 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.206779    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvtj\" (UniqueName: \"kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj\") pod \"maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") " pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.355227 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.355201    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:14.483844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.483820    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:14.487261 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:14.487232    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf77327_be30_439c_801f_1cca279f2354.slice/crio-2d6c9acffe3c69d7c02e94ca63db1527d076762b938bc62dde74b78dd008723c WatchSource:0}: Error finding container 2d6c9acffe3c69d7c02e94ca63db1527d076762b938bc62dde74b78dd008723c: Status 404 returned error can't find the container with id 2d6c9acffe3c69d7c02e94ca63db1527d076762b938bc62dde74b78dd008723c
Jul 07 00:20:14.620589 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.620549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.722334 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.722295    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.963635 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:14.963604    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:15.268532 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.268499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" event={"ID":"fbf77327-be30-439c-801f-1cca279f2354","Type":"ContainerStarted","Data":"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"}
Jul 07 00:20:15.268715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.268561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" event={"ID":"fbf77327-be30-439c-801f-1cca279f2354","Type":"ContainerStarted","Data":"2d6c9acffe3c69d7c02e94ca63db1527d076762b938bc62dde74b78dd008723c"}
Jul 07 00:20:15.268797 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.268732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:15.268797 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.268765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:15.269768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.269743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:15.285717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.285668    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" podStartSLOduration=0.997606019 podStartE2EDuration="1.285653335s" totalImagesPullingTime="288.047316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:15.283932891 +0000 UTC m=+1445.737360511" watchObservedRunningTime="2026-07-07 00:20:15.285653335 +0000 UTC m=+1445.739080932"
Jul 07 00:20:15.815073 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:15.815040    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:18.912616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:18.912578    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:19.295882 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.295847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:19.296200 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.296164    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" podUID="fbf77327-be30-439c-801f-1cca279f2354" containerName="maas-api" containerID="cri-o://f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104" gracePeriod=30
Jul 07 00:20:19.302144 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.302125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:19.319947 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.319924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:19.554383 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.554325    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:19.636678 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.636647    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls\") pod \"fbf77327-be30-439c-801f-1cca279f2354\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") "
Jul 07 00:20:19.636843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.636699    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca\") pod \"fbf77327-be30-439c-801f-1cca279f2354\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") "
Jul 07 00:20:19.636843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.636769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvtj\" (UniqueName: \"kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj\") pod \"fbf77327-be30-439c-801f-1cca279f2354\" (UID: \"fbf77327-be30-439c-801f-1cca279f2354\") "
Jul 07 00:20:19.637094 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.637065    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbf77327-be30-439c-801f-1cca279f2354" (UID: "fbf77327-be30-439c-801f-1cca279f2354"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:19.638779 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.638756    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbf77327-be30-439c-801f-1cca279f2354" (UID: "fbf77327-be30-439c-801f-1cca279f2354"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:20:19.638779 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.638769    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj" (OuterVolumeSpecName: "kube-api-access-2tvtj") pod "fbf77327-be30-439c-801f-1cca279f2354" (UID: "fbf77327-be30-439c-801f-1cca279f2354"). InnerVolumeSpecName "kube-api-access-2tvtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:19.738287 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.738248    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbf77327-be30-439c-801f-1cca279f2354-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:19.738287 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.738283    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbf77327-be30-439c-801f-1cca279f2354-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:19.738287 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:19.738296    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tvtj\" (UniqueName: \"kubernetes.io/projected/fbf77327-be30-439c-801f-1cca279f2354-kube-api-access-2tvtj\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:20.293550 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.293513    2574 generic.go:356] "Generic (PLEG): container finished" podID="fbf77327-be30-439c-801f-1cca279f2354" containerID="f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104" exitCode=0
Jul 07 00:20:20.293998 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.293559    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"
Jul 07 00:20:20.293998 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.293577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" event={"ID":"fbf77327-be30-439c-801f-1cca279f2354","Type":"ContainerDied","Data":"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"}
Jul 07 00:20:20.293998 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.293626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5" event={"ID":"fbf77327-be30-439c-801f-1cca279f2354","Type":"ContainerDied","Data":"2d6c9acffe3c69d7c02e94ca63db1527d076762b938bc62dde74b78dd008723c"}
Jul 07 00:20:20.293998 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.293650    2574 scope.go:117] "RemoveContainer" containerID="f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"
Jul 07 00:20:20.301903 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.301718    2574 scope.go:117] "RemoveContainer" containerID="f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"
Jul 07 00:20:20.301994 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:20.301975    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104\": container with ID starting with f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104 not found: ID does not exist" containerID="f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"
Jul 07 00:20:20.302034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.302002    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104"} err="failed to get container status \"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104\": rpc error: code = NotFound desc = could not find container \"f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104\": container with ID starting with f494e535fa3718ce0483c23a0297b35eb95133987ea586570d08e85704227104 not found: ID does not exist"
Jul 07 00:20:20.308711 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.308691    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:20.312916 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:20.312896    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-86a17854-75bcbd7b46-6l6x5"]
Jul 07 00:20:22.090240 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:22.090202    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbf77327-be30-439c-801f-1cca279f2354" path="/var/lib/kubelet/pods/fbf77327-be30-439c-801f-1cca279f2354/volumes"
Jul 07 00:20:25.065020 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.064967    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:25.066380 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.065203    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" podUID="0c20187e-5cef-4db7-abec-6f9845b97348" containerName="istio-proxy" containerID="cri-o://b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee" gracePeriod=30
Jul 07 00:20:25.082304 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.082275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:25.182217 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.182174    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:25.318615 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.318556    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:25.321271 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.321246    2574 generic.go:356] "Generic (PLEG): container finished" podID="0c20187e-5cef-4db7-abec-6f9845b97348" containerID="b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee" exitCode=0
Jul 07 00:20:25.321351 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.321283    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"
Jul 07 00:20:25.321351 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.321322    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" event={"ID":"0c20187e-5cef-4db7-abec-6f9845b97348","Type":"ContainerDied","Data":"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"}
Jul 07 00:20:25.321442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.321379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8" event={"ID":"0c20187e-5cef-4db7-abec-6f9845b97348","Type":"ContainerDied","Data":"cf275e56da03bd3fe20d1471fc185cd86b32be887c63061fe70b426adbf6dbc6"}
Jul 07 00:20:25.321442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.321425    2574 scope.go:117] "RemoveContainer" containerID="b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"
Jul 07 00:20:25.329158 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.329141    2574 scope.go:117] "RemoveContainer" containerID="b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"
Jul 07 00:20:25.329449 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:25.329380    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee\": container with ID starting with b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee not found: ID does not exist" containerID="b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"
Jul 07 00:20:25.329449 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.329424    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee"} err="failed to get container status \"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee\": rpc error: code = NotFound desc = could not find container \"b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee\": container with ID starting with b928eedac30a389e105c2912b0477b9a6c8399c5d79e539cb833f21a14d49eee not found: ID does not exist"
Jul 07 00:20:25.382996 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.382970    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383002    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383036    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383059    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383103    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383121    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383379 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383152    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383379 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383183    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383379 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383219    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk5bw\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw\") pod \"0c20187e-5cef-4db7-abec-6f9845b97348\" (UID: \"0c20187e-5cef-4db7-abec-6f9845b97348\") "
Jul 07 00:20:25.383558 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383515    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:25.383712 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383676    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:25.383772 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383683    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:25.383772 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.383735    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:25.384048 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.384010    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:25.385556 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.385419    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:25.385721 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.385699    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:20:25.385803 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.385722    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:25.385986 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.385952    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw" (OuterVolumeSpecName: "kube-api-access-xk5bw") pod "0c20187e-5cef-4db7-abec-6f9845b97348" (UID: "0c20187e-5cef-4db7-abec-6f9845b97348"). InnerVolumeSpecName "kube-api-access-xk5bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:25.484307 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484277    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484307 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484303    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484307 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484314    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c20187e-5cef-4db7-abec-6f9845b97348-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484322    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484331    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484338    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c20187e-5cef-4db7-abec-6f9845b97348-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484345    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484353    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c20187e-5cef-4db7-abec-6f9845b97348-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.484575 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.484361    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk5bw\" (UniqueName: \"kubernetes.io/projected/0c20187e-5cef-4db7-abec-6f9845b97348-kube-api-access-xk5bw\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:25.644356 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.644324    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:25.648382 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:25.648360    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-86a17854-openshift-default-69b84968b7-4c7d8"]
Jul 07 00:20:26.087948 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:26.087921    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c20187e-5cef-4db7-abec-6f9845b97348" path="/var/lib/kubelet/pods/0c20187e-5cef-4db7-abec-6f9845b97348/volumes"
Jul 07 00:20:27.327531 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:27.327500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:31.034616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.034576    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:31.108095 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.108055    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:31.221916 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.221879    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:31.222349 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222329    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf77327-be30-439c-801f-1cca279f2354" containerName="maas-api"
Jul 07 00:20:31.222459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222352    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf77327-be30-439c-801f-1cca279f2354" containerName="maas-api"
Jul 07 00:20:31.222459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222377    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c20187e-5cef-4db7-abec-6f9845b97348" containerName="istio-proxy"
Jul 07 00:20:31.222459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222386    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c20187e-5cef-4db7-abec-6f9845b97348" containerName="istio-proxy"
Jul 07 00:20:31.222626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222543    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c20187e-5cef-4db7-abec-6f9845b97348" containerName="istio-proxy"
Jul 07 00:20:31.222626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.222558    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf77327-be30-439c-801f-1cca279f2354" containerName="maas-api"
Jul 07 00:20:31.225840 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.225814    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.228738 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.228718    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d500513f-openshift-default-dockercfg-nrhng\""
Jul 07 00:20:31.238036 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.238012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:31.264993 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.264961    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:31.335271 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335271 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335271 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335271 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.335678 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.335553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4dt5\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.344110 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.344081    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:31.436897 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436862    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.436897 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.436987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437132 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4dt5\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437513 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437378    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437513 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437786 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437758    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.437920 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.437894    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.438052 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.438029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.439323 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.439302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.439493 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.439477    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.450308 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.450281    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.450563 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.450546    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4dt5\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5\") pod \"e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") " pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.537227 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.537185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:31.673306 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.673281    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:31.674734 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:31.674705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77456eb3_c2a3_4797_b469_78d8ff440d98.slice/crio-7dfdadbc02c3dc0d9943a3750287e240984051ce1575be8d5842125656cb71f7 WatchSource:0}: Error finding container 7dfdadbc02c3dc0d9943a3750287e240984051ce1575be8d5842125656cb71f7: Status 404 returned error can't find the container with id 7dfdadbc02c3dc0d9943a3750287e240984051ce1575be8d5842125656cb71f7
Jul 07 00:20:31.676792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.676760    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:31.676889 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.676825    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:31.676889 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:31.676854    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:20:32.356234 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.356190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" event={"ID":"77456eb3-c2a3-4797-b469-78d8ff440d98","Type":"ContainerStarted","Data":"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"}
Jul 07 00:20:32.356898 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.356256    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" event={"ID":"77456eb3-c2a3-4797-b469-78d8ff440d98","Type":"ContainerStarted","Data":"7dfdadbc02c3dc0d9943a3750287e240984051ce1575be8d5842125656cb71f7"}
Jul 07 00:20:32.384941 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.384890    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" podStartSLOduration=1.3848658569999999 podStartE2EDuration="1.384865857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:32.383930823 +0000 UTC m=+1462.837358458" watchObservedRunningTime="2026-07-07 00:20:32.384865857 +0000 UTC m=+1462.838293454"
Jul 07 00:20:32.445114 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.445072    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:32.447827 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.447807    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.450215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.450198    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-d500513f-serving-cert\""
Jul 07 00:20:32.458677 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.458656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:32.537650 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.537617    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:32.542647 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.542627    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:32.545947 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.545917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkcfd\" (UniqueName: \"kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.546085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.546036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.546158 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.546088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.647227 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.647140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.647227 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.647200    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.647464 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.647266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkcfd\" (UniqueName: \"kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.647464 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:32.647367    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-d500513f-serving-cert: secret "maas-api-e2e-derive-d500513f-serving-cert" not found
Jul 07 00:20:32.647552 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:32.647466    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls podName:97002bc7-390e-4b7a-bb2d-24f662a237d6 nodeName:}" failed. No retries permitted until 2026-07-07 00:20:33.147446796 +0000 UTC m=+1463.600874370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls") pod "maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" (UID: "97002bc7-390e-4b7a-bb2d-24f662a237d6") : secret "maas-api-e2e-derive-d500513f-serving-cert" not found
Jul 07 00:20:32.647901 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.647883    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:32.656122 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:32.656102    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkcfd\" (UniqueName: \"kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:33.151969 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.151926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:33.154334 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.154306    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") pod \"maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") " pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:33.277164 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.277122    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:33.360180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.360150    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:33.361095 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.361067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:33.361095 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.361088    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:33.382590 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.382557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:33.499194 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:33.499034    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:33.501708 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:20:33.501679    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97002bc7_390e_4b7a_bb2d_24f662a237d6.slice/crio-0b171587d18a7b2a349ed1ad096ed6666a0acb8d2d8ba0f57a96c72d4525cb79 WatchSource:0}: Error finding container 0b171587d18a7b2a349ed1ad096ed6666a0acb8d2d8ba0f57a96c72d4525cb79: Status 404 returned error can't find the container with id 0b171587d18a7b2a349ed1ad096ed6666a0acb8d2d8ba0f57a96c72d4525cb79
Jul 07 00:20:34.365778 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:34.365740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" event={"ID":"97002bc7-390e-4b7a-bb2d-24f662a237d6","Type":"ContainerStarted","Data":"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"}
Jul 07 00:20:34.366226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:34.365809    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:34.366226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:34.365832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" event={"ID":"97002bc7-390e-4b7a-bb2d-24f662a237d6","Type":"ContainerStarted","Data":"0b171587d18a7b2a349ed1ad096ed6666a0acb8d2d8ba0f57a96c72d4525cb79"}
Jul 07 00:20:34.384680 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:34.384631    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" podStartSLOduration=2.036667387 podStartE2EDuration="2.384614258s" totalImagesPullingTime="347.946871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:34.383359581 +0000 UTC m=+1464.836787187" watchObservedRunningTime="2026-07-07 00:20:34.384614258 +0000 UTC m=+1464.838041854"
Jul 07 00:20:34.574375 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:34.574340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.033392 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.033364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.154714 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.154679    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:37.154888 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.154846    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" podUID="77456eb3-c2a3-4797-b469-78d8ff440d98" containerName="istio-proxy" containerID="cri-o://f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0" gracePeriod=30
Jul 07 00:20:37.190718 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.190687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.297753 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.297662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.438807 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.438730    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:37.439077 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.439048    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" podUID="97002bc7-390e-4b7a-bb2d-24f662a237d6" containerName="maas-api" containerID="cri-o://061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68" gracePeriod=30
Jul 07 00:20:37.481723 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.481580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.729760 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.729734    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:37.793967 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.793940    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca\") pod \"97002bc7-390e-4b7a-bb2d-24f662a237d6\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") "
Jul 07 00:20:37.794162 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.793996    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkcfd\" (UniqueName: \"kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd\") pod \"97002bc7-390e-4b7a-bb2d-24f662a237d6\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") "
Jul 07 00:20:37.794162 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.794076    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") pod \"97002bc7-390e-4b7a-bb2d-24f662a237d6\" (UID: \"97002bc7-390e-4b7a-bb2d-24f662a237d6\") "
Jul 07 00:20:37.794340 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.794304    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97002bc7-390e-4b7a-bb2d-24f662a237d6" (UID: "97002bc7-390e-4b7a-bb2d-24f662a237d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:37.796167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.796137    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd" (OuterVolumeSpecName: "kube-api-access-vkcfd") pod "97002bc7-390e-4b7a-bb2d-24f662a237d6" (UID: "97002bc7-390e-4b7a-bb2d-24f662a237d6"). InnerVolumeSpecName "kube-api-access-vkcfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:37.796269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.796188    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97002bc7-390e-4b7a-bb2d-24f662a237d6" (UID: "97002bc7-390e-4b7a-bb2d-24f662a237d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:20:37.895067 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.894964    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97002bc7-390e-4b7a-bb2d-24f662a237d6-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:37.895067 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.894995    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkcfd\" (UniqueName: \"kubernetes.io/projected/97002bc7-390e-4b7a-bb2d-24f662a237d6-kube-api-access-vkcfd\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:37.895067 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:37.895006    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97002bc7-390e-4b7a-bb2d-24f662a237d6-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:38.391028 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.390994    2574 generic.go:356] "Generic (PLEG): container finished" podID="97002bc7-390e-4b7a-bb2d-24f662a237d6" containerID="061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68" exitCode=0
Jul 07 00:20:38.391465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.391052    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"
Jul 07 00:20:38.391465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.391081    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" event={"ID":"97002bc7-390e-4b7a-bb2d-24f662a237d6","Type":"ContainerDied","Data":"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"}
Jul 07 00:20:38.391465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.391159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp" event={"ID":"97002bc7-390e-4b7a-bb2d-24f662a237d6","Type":"ContainerDied","Data":"0b171587d18a7b2a349ed1ad096ed6666a0acb8d2d8ba0f57a96c72d4525cb79"}
Jul 07 00:20:38.391465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.391183    2574 scope.go:117] "RemoveContainer" containerID="061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"
Jul 07 00:20:38.399260 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.399238    2574 scope.go:117] "RemoveContainer" containerID="061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"
Jul 07 00:20:38.399548 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:38.399527    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68\": container with ID starting with 061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68 not found: ID does not exist" containerID="061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"
Jul 07 00:20:38.399611 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.399557    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68"} err="failed to get container status \"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68\": rpc error: code = NotFound desc = could not find container \"061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68\": container with ID starting with 061fcbe4391e907fc7f5ab098bae5399747d852677927fb7e4068d2e23690c68 not found: ID does not exist"
Jul 07 00:20:38.410391 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.410370    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:38.415130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.415107    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-d500513f-7b4d966b79-ktdcp"]
Jul 07 00:20:38.995442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:38.995255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:40.087532 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:40.087497    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97002bc7-390e-4b7a-bb2d-24f662a237d6" path="/var/lib/kubelet/pods/97002bc7-390e-4b7a-bb2d-24f662a237d6/volumes"
Jul 07 00:20:42.799300 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.799277    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:42.942442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942337    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942389    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942442 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942431    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942452    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942471    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942503    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942535    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4dt5\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942555    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.942717 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942599    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket\") pod \"77456eb3-c2a3-4797-b469-78d8ff440d98\" (UID: \"77456eb3-c2a3-4797-b469-78d8ff440d98\") "
Jul 07 00:20:42.943025 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942841    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:42.943025 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.942864    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:42.943025 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.943018    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:42.943176 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.943045    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:20:42.943673 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.943641    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data" (OuterVolumeSpecName: "istio-data") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:42.944747 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.944715    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:20:42.944852 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.944793    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5" (OuterVolumeSpecName: "kube-api-access-l4dt5") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "kube-api-access-l4dt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:42.944905 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.944889    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:42.944942 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:42.944923    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token" (OuterVolumeSpecName: "istio-token") pod "77456eb3-c2a3-4797-b469-78d8ff440d98" (UID: "77456eb3-c2a3-4797-b469-78d8ff440d98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:43.012061 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.012026    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:43.044195 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044160    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044195 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044190    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044195 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044200    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044209    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77456eb3-c2a3-4797-b469-78d8ff440d98-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044218    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044226    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044234    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4dt5\" (UniqueName: \"kubernetes.io/projected/77456eb3-c2a3-4797-b469-78d8ff440d98-kube-api-access-l4dt5\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044242    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.044430 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.044250    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77456eb3-c2a3-4797-b469-78d8ff440d98-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:20:43.063654 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.063624    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:43.416619 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.416577    2574 generic.go:356] "Generic (PLEG): container finished" podID="77456eb3-c2a3-4797-b469-78d8ff440d98" containerID="f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0" exitCode=0
Jul 07 00:20:43.416811 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.416643    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"
Jul 07 00:20:43.416811 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.416652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" event={"ID":"77456eb3-c2a3-4797-b469-78d8ff440d98","Type":"ContainerDied","Data":"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"}
Jul 07 00:20:43.416811 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.416723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw" event={"ID":"77456eb3-c2a3-4797-b469-78d8ff440d98","Type":"ContainerDied","Data":"7dfdadbc02c3dc0d9943a3750287e240984051ce1575be8d5842125656cb71f7"}
Jul 07 00:20:43.416811 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.416746    2574 scope.go:117] "RemoveContainer" containerID="f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"
Jul 07 00:20:43.425713 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.425695    2574 scope.go:117] "RemoveContainer" containerID="f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"
Jul 07 00:20:43.425959 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:20:43.425940    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0\": container with ID starting with f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0 not found: ID does not exist" containerID="f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"
Jul 07 00:20:43.426014 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.425968    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0"} err="failed to get container status \"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0\": rpc error: code = NotFound desc = could not find container \"f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0\": container with ID starting with f16370b9a0158c80e087c5ce5dceb22510f15ffbd6fc22fbeb90dd36b01fb7f0 not found: ID does not exist"
Jul 07 00:20:43.439711 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.439683    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:43.449797 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.449774    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d500513f-openshift-default-6d89c6b747-tdvjw"]
Jul 07 00:20:43.487115 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.487078    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:43.587356 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.587320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:43.688465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:43.688366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:44.087779 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:44.087745    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77456eb3-c2a3-4797-b469-78d8ff440d98" path="/var/lib/kubelet/pods/77456eb3-c2a3-4797-b469-78d8ff440d98/volumes"
Jul 07 00:20:44.592218 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:44.592178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:45.056578 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:45.056536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:50.838282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:50.838246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:50.948753 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:50.948713    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:51.040179 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:51.040148    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:51.137900 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:51.137762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:51.621808 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:20:51.621769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:10.066269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:10.066243    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:21:10.068013 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:10.067992    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:21:17.696470 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:17.696428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:23.335710 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:23.335672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:23.525860 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:23.525823    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:23.693441 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:23.693336    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:39.453833 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:39.453561    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:45.411721 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:45.411674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:45.530728 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:45.530694    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:45.621489 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:45.621452    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:56.161260 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:56.161226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:56.921195 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:21:56.921164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:02.708768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:02.708730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:02.817353 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:02.817313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:02.909161 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:02.909124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:02.976175 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:02.976091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:03.761474 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:03.761443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:03.858886 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:03.858849    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:03.960105 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:03.960072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:05.548602 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:05.548568    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:11.295914 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:11.295875    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:11.396059 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:11.396020    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:11.947758 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:11.947718    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:12.021238 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:12.021195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:17.823204 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:17.823165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:17.888713 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:17.888682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:18.061930 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.061891    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:18.486579 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486548    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:18.486854 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486842    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97002bc7-390e-4b7a-bb2d-24f662a237d6" containerName="maas-api"
Jul 07 00:22:18.486897 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486856    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="97002bc7-390e-4b7a-bb2d-24f662a237d6" containerName="maas-api"
Jul 07 00:22:18.486897 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486869    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77456eb3-c2a3-4797-b469-78d8ff440d98" containerName="istio-proxy"
Jul 07 00:22:18.486897 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486875    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="77456eb3-c2a3-4797-b469-78d8ff440d98" containerName="istio-proxy"
Jul 07 00:22:18.486986 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486922    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="77456eb3-c2a3-4797-b469-78d8ff440d98" containerName="istio-proxy"
Jul 07 00:22:18.486986 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.486930    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="97002bc7-390e-4b7a-bb2d-24f662a237d6" containerName="maas-api"
Jul 07 00:22:18.488834 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.488817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.492005 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.491987    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8281254f-openshift-default-dockercfg-kp6mk\""
Jul 07 00:22:18.524087 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.524047    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:18.529276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.529248    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:18.551226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551398 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551398 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bln8w\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551398 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.551537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.551527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.652723 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.652723 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.652967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bln8w\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653373 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653373 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653314    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653373 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653339    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653181    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653597 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653570    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.653786 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.653763    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.655310 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.655293    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.655359 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.655308    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.661640 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.661610    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bln8w\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.661786 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.661725    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token\") pod \"e2e-mt-8281254f-openshift-default-9fc86b95-4hngk\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") " pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.798577 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.798544    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:18.942803 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.942769    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:18.947608 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:22:18.947574    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff05f8b0_2756_493b_84a2_7c919725ccc4.slice/crio-87faaeb2eb350aba3c97554f4641be64388bbf5a681455bc7b25ae07421b817c WatchSource:0}: Error finding container 87faaeb2eb350aba3c97554f4641be64388bbf5a681455bc7b25ae07421b817c: Status 404 returned error can't find the container with id 87faaeb2eb350aba3c97554f4641be64388bbf5a681455bc7b25ae07421b817c
Jul 07 00:22:18.950032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.949991    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:18.950142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.950087    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:18.950142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.950126    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:18.990201 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:18.990164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:19.819224 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:19.819188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerStarted","Data":"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"}
Jul 07 00:22:19.819423 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:19.819266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerStarted","Data":"87faaeb2eb350aba3c97554f4641be64388bbf5a681455bc7b25ae07421b817c"}
Jul 07 00:22:19.839451 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:19.839378    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" podStartSLOduration=1.839362696 podStartE2EDuration="1.839362696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:19.837722587 +0000 UTC m=+1570.291150185" watchObservedRunningTime="2026-07-07 00:22:19.839362696 +0000 UTC m=+1570.292790336"
Jul 07 00:22:20.799064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:20.799031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:20.803546 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:20.803525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:20.823741 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:20.823715    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:20.824517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:20.824499    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:21.792494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.792460    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:21.857632 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.857602    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:21.914771 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.914738    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:21.917126 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.917103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:21.919367 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.919346    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-8281254f-serving-cert\""
Jul 07 00:22:21.928356 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.928334    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:21.941256 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.941228    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:21.981199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.981161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:21.981199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.981195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppv5\" (UniqueName: \"kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:21.981439 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:21.981229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.082587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.082495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.082587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.082533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppv5\" (UniqueName: \"kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.082838 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.082650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.082838 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:22:22.082804    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-8281254f-serving-cert: secret "maas-api-e2e-mt-8281254f-serving-cert" not found
Jul 07 00:22:22.082963 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:22:22.082882    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls podName:7cca31ce-8303-465d-9089-aefa5b2193ed nodeName:}" failed. No retries permitted until 2026-07-07 00:22:22.582862345 +0000 UTC m=+1573.036289923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls") pod "maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" (UID: "7cca31ce-8303-465d-9089-aefa5b2193ed") : secret "maas-api-e2e-mt-8281254f-serving-cert" not found
Jul 07 00:22:22.083243 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.083221    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.091143 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.091117    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppv5\" (UniqueName: \"kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.181528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.181495    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:22.433394 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.433294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:22.530686 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.530652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:22.586938 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.586898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.589493 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.589466    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") pod \"maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") " pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.827596 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.827559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:22.963175 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:22.963145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:22.965741 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:22:22.965710    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cca31ce_8303_465d_9089_aefa5b2193ed.slice/crio-6979e250ab5c69f9286df60181e2b0dda98bfecadbf0ba9bf88b215f685bec40 WatchSource:0}: Error finding container 6979e250ab5c69f9286df60181e2b0dda98bfecadbf0ba9bf88b215f685bec40: Status 404 returned error can't find the container with id 6979e250ab5c69f9286df60181e2b0dda98bfecadbf0ba9bf88b215f685bec40
Jul 07 00:22:23.837321 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:23.837286    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" event={"ID":"7cca31ce-8303-465d-9089-aefa5b2193ed","Type":"ContainerStarted","Data":"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"}
Jul 07 00:22:23.837520 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:23.837369    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" event={"ID":"7cca31ce-8303-465d-9089-aefa5b2193ed","Type":"ContainerStarted","Data":"6979e250ab5c69f9286df60181e2b0dda98bfecadbf0ba9bf88b215f685bec40"}
Jul 07 00:22:23.837520 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:23.837390    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:26.261629 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:26.261594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:26.922653 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:26.922623    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:27.015033 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:27.014999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:27.328109 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:27.328073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:29.847245 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:29.847214    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:29.866014 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:29.865948    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" podStartSLOduration=8.41938286 podStartE2EDuration="8.865928556s" totalImagesPullingTime="446.545696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:23.892304256 +0000 UTC m=+1574.345731852" watchObservedRunningTime="2026-07-07 00:22:29.865928556 +0000 UTC m=+1580.319356154"
Jul 07 00:22:33.475382 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.475339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:33.554459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.554349    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:33.882133 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.882092    2574 generic.go:356] "Generic (PLEG): container finished" podID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerID="be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5" exitCode=0
Jul 07 00:22:33.882662 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.882146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerDied","Data":"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"}
Jul 07 00:22:33.882662 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.882563    2574 scope.go:117] "RemoveContainer" containerID="be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"
Jul 07 00:22:33.883719 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.883688    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:33.883840 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.883773    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:33.883904 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.883845    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:22:33.935268 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:33.935235    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:34.343058 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.343015    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:34.343248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.343222    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" podUID="7cca31ce-8303-465d-9089-aefa5b2193ed" containerName="maas-api" containerID="cri-o://aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be" gracePeriod=30
Jul 07 00:22:34.346713 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.346676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:34.445051 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.445018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:34.613713 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.613603    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:34.695698 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.695660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") pod \"7cca31ce-8303-465d-9089-aefa5b2193ed\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") "
Jul 07 00:22:34.695896 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.695731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lppv5\" (UniqueName: \"kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5\") pod \"7cca31ce-8303-465d-9089-aefa5b2193ed\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") "
Jul 07 00:22:34.695896 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.695813    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca\") pod \"7cca31ce-8303-465d-9089-aefa5b2193ed\" (UID: \"7cca31ce-8303-465d-9089-aefa5b2193ed\") "
Jul 07 00:22:34.696178 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.696154    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7cca31ce-8303-465d-9089-aefa5b2193ed" (UID: "7cca31ce-8303-465d-9089-aefa5b2193ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:22:34.697879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.697845    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7cca31ce-8303-465d-9089-aefa5b2193ed" (UID: "7cca31ce-8303-465d-9089-aefa5b2193ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:22:34.698115 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.698090    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5" (OuterVolumeSpecName: "kube-api-access-lppv5") pod "7cca31ce-8303-465d-9089-aefa5b2193ed" (UID: "7cca31ce-8303-465d-9089-aefa5b2193ed"). InnerVolumeSpecName "kube-api-access-lppv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:22:34.796896 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.796852    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cca31ce-8303-465d-9089-aefa5b2193ed-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:34.796896 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.796888    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cca31ce-8303-465d-9089-aefa5b2193ed-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:34.796896 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.796902    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lppv5\" (UniqueName: \"kubernetes.io/projected/7cca31ce-8303-465d-9089-aefa5b2193ed-kube-api-access-lppv5\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:34.891050 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.890950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerStarted","Data":"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"}
Jul 07 00:22:34.892226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.892196    2574 generic.go:356] "Generic (PLEG): container finished" podID="7cca31ce-8303-465d-9089-aefa5b2193ed" containerID="aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be" exitCode=0
Jul 07 00:22:34.892338 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.892235    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"
Jul 07 00:22:34.892338 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.892273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" event={"ID":"7cca31ce-8303-465d-9089-aefa5b2193ed","Type":"ContainerDied","Data":"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"}
Jul 07 00:22:34.892338 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.892320    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf" event={"ID":"7cca31ce-8303-465d-9089-aefa5b2193ed","Type":"ContainerDied","Data":"6979e250ab5c69f9286df60181e2b0dda98bfecadbf0ba9bf88b215f685bec40"}
Jul 07 00:22:34.892475 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.892341    2574 scope.go:117] "RemoveContainer" containerID="aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"
Jul 07 00:22:34.901481 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.901458    2574 scope.go:117] "RemoveContainer" containerID="aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"
Jul 07 00:22:34.901759 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:22:34.901741    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be\": container with ID starting with aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be not found: ID does not exist" containerID="aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"
Jul 07 00:22:34.901808 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.901769    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be"} err="failed to get container status \"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be\": rpc error: code = NotFound desc = could not find container \"aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be\": container with ID starting with aea009d09952ece28e7b14d69cc459d027ddc436baf386335ced22440a2345be not found: ID does not exist"
Jul 07 00:22:34.924894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.924868    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:34.930787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:34.930763    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-8281254f-5d7fb4c4b7-799hf"]
Jul 07 00:22:35.799457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:35.799385    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:35.800597 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:35.800574    2574 patch_prober.go:28] interesting pod/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:22:35.800655 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:35.800625    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:22:35.823958 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:35.823935    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:36.090480 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:36.090385    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cca31ce-8303-465d-9089-aefa5b2193ed" path="/var/lib/kubelet/pods/7cca31ce-8303-465d-9089-aefa5b2193ed/volumes"
Jul 07 00:22:36.799923 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:36.799890    2574 patch_prober.go:28] interesting pod/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:22:36.800325 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:36.799950    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:22:37.799220 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:37.799178    2574 patch_prober.go:28] interesting pod/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:22:37.799395 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:37.799243    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:22:38.802615 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:38.802589    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:38.803625 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:38.803607    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:40.268736 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.268690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:40.331221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.331187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:40.498924 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.498891    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:40.499135 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.499109    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy" containerID="cri-o://3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd" gracePeriod=30
Jul 07 00:22:40.527709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.527620    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:40.741085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.741050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:40.861045 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.860962    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:40.962648 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:40.962601    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:41.074011 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:41.073976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:45.748712 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.748686    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:45.894354 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894308    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894354 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894354    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894381    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894488    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894505    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894588    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bln8w\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.894626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894628    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket\") pod \"ff05f8b0-2756-493b-84a2-7c919725ccc4\" (UID: \"ff05f8b0-2756-493b-84a2-7c919725ccc4\") "
Jul 07 00:22:45.895276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894635    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:45.895276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894873    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.895276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.894901    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:22:45.895276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.895061    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:45.895276 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.895068    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:45.895565 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.895449    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:45.896879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.896851    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:45.896879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.896864    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:22:45.897024 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.896873    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:22:45.897077 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.897040    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w" (OuterVolumeSpecName: "kube-api-access-bln8w") pod "ff05f8b0-2756-493b-84a2-7c919725ccc4" (UID: "ff05f8b0-2756-493b-84a2-7c919725ccc4"). InnerVolumeSpecName "kube-api-access-bln8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:22:45.942122 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.942085    2574 generic.go:356] "Generic (PLEG): container finished" podID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerID="3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd" exitCode=0
Jul 07 00:22:45.942305 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.942133    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"
Jul 07 00:22:45.942305 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.942156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerDied","Data":"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"}
Jul 07 00:22:45.942305 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.942210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk" event={"ID":"ff05f8b0-2756-493b-84a2-7c919725ccc4","Type":"ContainerDied","Data":"87faaeb2eb350aba3c97554f4641be64388bbf5a681455bc7b25ae07421b817c"}
Jul 07 00:22:45.942305 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.942238    2574 scope.go:117] "RemoveContainer" containerID="3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"
Jul 07 00:22:45.950709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.950692    2574 scope.go:117] "RemoveContainer" containerID="be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"
Jul 07 00:22:45.958034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.958016    2574 scope.go:117] "RemoveContainer" containerID="3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"
Jul 07 00:22:45.958305 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:22:45.958285    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd\": container with ID starting with 3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd not found: ID does not exist" containerID="3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"
Jul 07 00:22:45.958368 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.958317    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd"} err="failed to get container status \"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd\": rpc error: code = NotFound desc = could not find container \"3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd\": container with ID starting with 3f291c33b1b3817a7e972810f012f4a89830ba3825baf8aa356c18ba2b9dbafd not found: ID does not exist"
Jul 07 00:22:45.958368 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.958344    2574 scope.go:117] "RemoveContainer" containerID="be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"
Jul 07 00:22:45.958612 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:22:45.958595    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5\": container with ID starting with be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5 not found: ID does not exist" containerID="be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"
Jul 07 00:22:45.958664 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.958621    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5"} err="failed to get container status \"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5\": rpc error: code = NotFound desc = could not find container \"be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5\": container with ID starting with be2ee42fe108f8da7bb8189a19274c7411d0da638bd1c8fb94c6b314c57ca5d5 not found: ID does not exist"
Jul 07 00:22:45.964206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.964183    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:45.970612 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.970589    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8281254f-openshift-default-9fc86b95-4hngk"]
Jul 07 00:22:45.995526 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995499    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995526 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995521    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995531    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bln8w\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-kube-api-access-bln8w\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995540    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995549    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff05f8b0-2756-493b-84a2-7c919725ccc4-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995557    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995564    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff05f8b0-2756-493b-84a2-7c919725ccc4-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:45.995646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:45.995574    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff05f8b0-2756-493b-84a2-7c919725ccc4-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:22:46.093113 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:46.093064    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" path="/var/lib/kubelet/pods/ff05f8b0-2756-493b-84a2-7c919725ccc4/volumes"
Jul 07 00:22:46.755044 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:46.755002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:46.871633 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:46.871598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:46.967762 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:46.967730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:47.131911 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:47.131868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:53.109496 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:53.109464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:53.177162 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:22:53.177131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:01.995549 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:01.995510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:02.309449 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309392    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:23:02.309748 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309736    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:02.309792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309750    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:02.309792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309760    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:02.309792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309765    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:02.309792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309775    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cca31ce-8303-465d-9089-aefa5b2193ed" containerName="maas-api"
Jul 07 00:23:02.309792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309781    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cca31ce-8303-465d-9089-aefa5b2193ed" containerName="maas-api"
Jul 07 00:23:02.309944 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309839    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:02.309944 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.309850    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cca31ce-8303-465d-9089-aefa5b2193ed" containerName="maas-api"
Jul 07 00:23:02.312530 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.312503    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.317204 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.317185    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bf334991-openshift-default-dockercfg-rgrd8\""
Jul 07 00:23:02.322445 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322445 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322505    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2twx\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.322692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.322641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.337449 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.337421    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:23:02.390165 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.390129    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:02.423358 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2twx\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.423855 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.423779    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.424046 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.424024    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.424150 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.424084    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.424208 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.424159    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.424290 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.424269    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.425818 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.425797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.425913 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.425897    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.432917 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.432894    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2twx\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.433081 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.433060    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token\") pod \"e2e-mt-bf334991-openshift-default-69668fc647-kgknz\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") " pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.485188 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.485155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:02.622513 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.622392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:02.757183 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.757150    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:23:02.760362 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:23:02.760333    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef12de45_bf81_4903_b035_932321ad1a9c.slice/crio-d1b42659312ca166b1f7af51b7ccf81338cb98d4b7cd0c0e8d553f10d5f44a5b WatchSource:0}: Error finding container d1b42659312ca166b1f7af51b7ccf81338cb98d4b7cd0c0e8d553f10d5f44a5b: Status 404 returned error can't find the container with id d1b42659312ca166b1f7af51b7ccf81338cb98d4b7cd0c0e8d553f10d5f44a5b
Jul 07 00:23:02.762399 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.762368    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:02.762514 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.762455    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:02.762514 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:02.762485    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:03.021216 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:03.021180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerStarted","Data":"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"}
Jul 07 00:23:03.021619 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:03.021251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerStarted","Data":"d1b42659312ca166b1f7af51b7ccf81338cb98d4b7cd0c0e8d553f10d5f44a5b"}
Jul 07 00:23:03.047679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:03.047631    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podStartSLOduration=1.047614556 podStartE2EDuration="1.047614556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:23:03.046234565 +0000 UTC m=+1613.499662187" watchObservedRunningTime="2026-07-07 00:23:03.047614556 +0000 UTC m=+1613.501042152"
Jul 07 00:23:03.622869 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:03.622822    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:03.628061 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:03.628035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:04.025570 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:04.025532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:04.026631 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:04.026613    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:04.973938 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:04.973902    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:05.051125 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.051094    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:05.051519 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.051462    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff05f8b0-2756-493b-84a2-7c919725ccc4" containerName="istio-proxy"
Jul 07 00:23:05.053344 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.053322    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.055792 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.055760    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-bf334991-serving-cert\""
Jul 07 00:23:05.065072 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.065044    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:05.070244 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.070219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:05.140368 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.140328    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:05.145349 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.145327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.145471 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.145370    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.145471 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.145463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttx5z\" (UniqueName: \"kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.246502 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.246390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.246502 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.246469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.246690 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.246510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttx5z\" (UniqueName: \"kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.247116 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.247090    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.248830 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.248808    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.262640 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.262618    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttx5z\" (UniqueName: \"kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z\") pod \"maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") " pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.269992 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.269966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:05.364858 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.364828    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:05.496296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.496268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:05.498754 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:23:05.498725    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e07f84d_e443_479d_8448_c21a67ff5928.slice/crio-34407bfe575cb4aabe92963f12fb2687a4efe1f1f64702eb82741834b46f1e5d WatchSource:0}: Error finding container 34407bfe575cb4aabe92963f12fb2687a4efe1f1f64702eb82741834b46f1e5d: Status 404 returned error can't find the container with id 34407bfe575cb4aabe92963f12fb2687a4efe1f1f64702eb82741834b46f1e5d
Jul 07 00:23:05.715444 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.715381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:05.816675 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:05.816641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:06.035090 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:06.035055    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" event={"ID":"7e07f84d-e443-479d-8448-c21a67ff5928","Type":"ContainerStarted","Data":"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"}
Jul 07 00:23:06.035280 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:06.035105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" event={"ID":"7e07f84d-e443-479d-8448-c21a67ff5928","Type":"ContainerStarted","Data":"34407bfe575cb4aabe92963f12fb2687a4efe1f1f64702eb82741834b46f1e5d"}
Jul 07 00:23:06.035280 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:06.035140    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:06.055701 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:06.055657    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" podStartSLOduration=0.70504452 podStartE2EDuration="1.05563916s" totalImagesPullingTime="350.59464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:23:06.054520051 +0000 UTC m=+1616.507947647" watchObservedRunningTime="2026-07-07 00:23:06.05563916 +0000 UTC m=+1616.509066757"
Jul 07 00:23:09.465812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:09.465772    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:10.420530 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:10.420433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:10.521506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:10.521465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:12.044882 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:12.044854    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:15.977126 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:15.977082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:19.098246 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:19.098189    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:33192->10.133.0.34:15021: read: connection reset by peer" start-of-body=
Jul 07 00:23:19.098740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:19.098289    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:33192->10.133.0.34:15021: read: connection reset by peer"
Jul 07 00:23:20.105179 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.105143    2574 generic.go:356] "Generic (PLEG): container finished" podID="ef12de45-bf81-4903-b035-932321ad1a9c" containerID="04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a" exitCode=0
Jul 07 00:23:20.105607 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.105203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerDied","Data":"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"}
Jul 07 00:23:20.105607 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.105561    2574 scope.go:117] "RemoveContainer" containerID="04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"
Jul 07 00:23:20.106949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.106889    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:20.107101 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.107078    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:20.107205 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:20.107181    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:23:21.111945 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:21.111913    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerStarted","Data":"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"}
Jul 07 00:23:21.623320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:21.623280    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:21.623537 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:21.623512    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:23:21.623594 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:21.623557    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:23:22.623420 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:22.623365    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:23:22.623816 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:22.623448    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:23:23.623743 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:23.623705    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:23:23.624162 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:23.623758    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:23:24.623654 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:24.623610    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:23:24.623846 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:24.623671    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:23:25.626577 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:25.626543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:25.627134 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:25.626828    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:25.627616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:25.627600    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:23:27.467216 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:27.467183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:27.576697 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:27.576660    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:32.548153 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:32.548105    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:41.756313 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:41.756274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:42.145184 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.145149    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:42.145466 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.145396    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" podUID="7e07f84d-e443-479d-8448-c21a67ff5928" containerName="maas-api" containerID="cri-o://b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83" gracePeriod=30
Jul 07 00:23:42.177198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.177159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:42.395494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.395426    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:42.474924 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.474895    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttx5z\" (UniqueName: \"kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z\") pod \"7e07f84d-e443-479d-8448-c21a67ff5928\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") "
Jul 07 00:23:42.475102 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.474965    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca\") pod \"7e07f84d-e443-479d-8448-c21a67ff5928\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") "
Jul 07 00:23:42.475102 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.475004    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls\") pod \"7e07f84d-e443-479d-8448-c21a67ff5928\" (UID: \"7e07f84d-e443-479d-8448-c21a67ff5928\") "
Jul 07 00:23:42.475382 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.475359    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e07f84d-e443-479d-8448-c21a67ff5928" (UID: "7e07f84d-e443-479d-8448-c21a67ff5928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:23:42.477079 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.477044    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e07f84d-e443-479d-8448-c21a67ff5928" (UID: "7e07f84d-e443-479d-8448-c21a67ff5928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:23:42.477203 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.477102    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z" (OuterVolumeSpecName: "kube-api-access-ttx5z") pod "7e07f84d-e443-479d-8448-c21a67ff5928" (UID: "7e07f84d-e443-479d-8448-c21a67ff5928"). InnerVolumeSpecName "kube-api-access-ttx5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:23:42.576593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.576556    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e07f84d-e443-479d-8448-c21a67ff5928-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:23:42.576593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.576588    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e07f84d-e443-479d-8448-c21a67ff5928-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:23:42.576593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:42.576598    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttx5z\" (UniqueName: \"kubernetes.io/projected/7e07f84d-e443-479d-8448-c21a67ff5928-kube-api-access-ttx5z\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:23:43.209757 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.209723    2574 generic.go:356] "Generic (PLEG): container finished" podID="7e07f84d-e443-479d-8448-c21a67ff5928" containerID="b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83" exitCode=0
Jul 07 00:23:43.210147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.209764    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"
Jul 07 00:23:43.210147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.209804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" event={"ID":"7e07f84d-e443-479d-8448-c21a67ff5928","Type":"ContainerDied","Data":"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"}
Jul 07 00:23:43.210147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.209860    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9" event={"ID":"7e07f84d-e443-479d-8448-c21a67ff5928","Type":"ContainerDied","Data":"34407bfe575cb4aabe92963f12fb2687a4efe1f1f64702eb82741834b46f1e5d"}
Jul 07 00:23:43.210147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.209885    2574 scope.go:117] "RemoveContainer" containerID="b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"
Jul 07 00:23:43.218202 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.218180    2574 scope.go:117] "RemoveContainer" containerID="b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"
Jul 07 00:23:43.218464 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:23:43.218446    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83\": container with ID starting with b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83 not found: ID does not exist" containerID="b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"
Jul 07 00:23:43.218526 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.218475    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83"} err="failed to get container status \"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83\": rpc error: code = NotFound desc = could not find container \"b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83\": container with ID starting with b0d6ad7317604e40560ecd801876beb8a963b5056d7a85124e21e9ef75652d83 not found: ID does not exist"
Jul 07 00:23:43.232578 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.232555    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:43.237434 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:43.237396    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-bf334991-55dcff84d8-5q2z9"]
Jul 07 00:23:44.087426 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:44.087371    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e07f84d-e443-479d-8448-c21a67ff5928" path="/var/lib/kubelet/pods/7e07f84d-e443-479d-8448-c21a67ff5928/volumes"
Jul 07 00:23:47.941377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:47.941343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:52.931520 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:23:52.931469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:29.831723 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:29.831681    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:31.452758 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:31.452725    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:35.857937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:35.857846    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:35.923034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:35.922991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:36.105484 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:36.105450    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:24:36.105671 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:36.105648    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" containerID="cri-o://7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9" gracePeriod=30
Jul 07 00:24:36.131267 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:36.131175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:36.370336 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:36.370286    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:37.420490 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:37.420444    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:37.521739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:37.521699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:37.625504 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:37.625476    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:38.411107 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:38.411071    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:38.515680 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:38.515646    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:38.609266 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:38.609234    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:39.967093 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:39.967056    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:40.629829 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:40.629785    2574 patch_prober.go:28] interesting pod/e2e-mt-bf334991-openshift-default-69668fc647-kgknz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:24:40.630063 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:40.629849    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:24:41.348879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.348854    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:24:41.460911 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.460832    2574 generic.go:356] "Generic (PLEG): container finished" podID="ef12de45-bf81-4903-b035-932321ad1a9c" containerID="7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9" exitCode=0
Jul 07 00:24:41.460911 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.460879    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"
Jul 07 00:24:41.461087 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.460884    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerDied","Data":"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"}
Jul 07 00:24:41.461087 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.461010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz" event={"ID":"ef12de45-bf81-4903-b035-932321ad1a9c","Type":"ContainerDied","Data":"d1b42659312ca166b1f7af51b7ccf81338cb98d4b7cd0c0e8d553f10d5f44a5b"}
Jul 07 00:24:41.461087 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.461042    2574 scope.go:117] "RemoveContainer" containerID="7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"
Jul 07 00:24:41.468983 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.468964    2574 scope.go:117] "RemoveContainer" containerID="04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"
Jul 07 00:24:41.476088 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.476072    2574 scope.go:117] "RemoveContainer" containerID="7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"
Jul 07 00:24:41.476324 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:24:41.476303    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9\": container with ID starting with 7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9 not found: ID does not exist" containerID="7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"
Jul 07 00:24:41.476367 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.476333    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9"} err="failed to get container status \"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9\": rpc error: code = NotFound desc = could not find container \"7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9\": container with ID starting with 7d1a425bd08ed2515b012ac2ce8a47501aaadd648ef5768c505cf9efdc0592c9 not found: ID does not exist"
Jul 07 00:24:41.476367 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.476349    2574 scope.go:117] "RemoveContainer" containerID="04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"
Jul 07 00:24:41.476596 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:24:41.476578    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a\": container with ID starting with 04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a not found: ID does not exist" containerID="04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"
Jul 07 00:24:41.476655 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.476607    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a"} err="failed to get container status \"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a\": rpc error: code = NotFound desc = could not find container \"04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a\": container with ID starting with 04813dd6eadd35e5a0e0e79b2cbf8e8308568f8b25a19fac01127e5da9eaf23a not found: ID does not exist"
Jul 07 00:24:41.477789 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.477773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.477843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.477831    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.477876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.477852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.477970 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.477950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478033 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478003    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478076 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478032    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2twx\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478076 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478055    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:24:41.478158 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478158 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478123    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:24:41.478262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478262 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket\") pod \"ef12de45-bf81-4903-b035-932321ad1a9c\" (UID: \"ef12de45-bf81-4903-b035-932321ad1a9c\") "
Jul 07 00:24:41.478487 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478455    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:24:41.478579 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478489    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef12de45-bf81-4903-b035-932321ad1a9c-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.478579 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478506    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.478692 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.478671    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:24:41.479559 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.479531    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:24:41.480138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.480111    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx" (OuterVolumeSpecName: "kube-api-access-r2twx") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "kube-api-access-r2twx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:24:41.480241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.480188    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:24:41.480307 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.480274    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:24:41.480307 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.480289    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef12de45-bf81-4903-b035-932321ad1a9c" (UID: "ef12de45-bf81-4903-b035-932321ad1a9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:24:41.579933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579890    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef12de45-bf81-4903-b035-932321ad1a9c-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.579933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579927    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2twx\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-kube-api-access-r2twx\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.580155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579955    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.580155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579967    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.580155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579979    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.580155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579987    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef12de45-bf81-4903-b035-932321ad1a9c-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.580155 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.579995    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef12de45-bf81-4903-b035-932321ad1a9c-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:24:41.782143 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.782110    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:24:41.785682 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:41.785656    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bf334991-openshift-default-69668fc647-kgknz"]
Jul 07 00:24:42.087606 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:42.087528    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" path="/var/lib/kubelet/pods/ef12de45-bf81-4903-b035-932321ad1a9c/volumes"
Jul 07 00:24:45.692180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:45.692137    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:45.792059 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:45.792021    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:46.380679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:46.380643    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:52.235581 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:52.235544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:52.341287 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:52.341255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:52.439743 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:24:52.439710    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:02.940782 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:02.940742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:03.305547 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:03.305508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:06.887550 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:06.887514    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:06.953218 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:06.953178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:24.242800 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:24.242766    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:30.222315 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.222273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:30.321884 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.321846    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:30.668684 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.668640    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:30.905867 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.905836    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:25:30.906153 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906142    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:30.906197 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906155    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:30.906197 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906165    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e07f84d-e443-479d-8448-c21a67ff5928" containerName="maas-api"
Jul 07 00:25:30.906197 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906171    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e07f84d-e443-479d-8448-c21a67ff5928" containerName="maas-api"
Jul 07 00:25:30.906289 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906219    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:30.906289 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906226    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:30.906289 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.906234    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e07f84d-e443-479d-8448-c21a67ff5928" containerName="maas-api"
Jul 07 00:25:30.909215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.909194    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.911839 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.911821    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1e462f-openshift-default-dockercfg-tmzt6\""
Jul 07 00:25:30.924926 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.924879    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:25:30.967354 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.967309    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:30.987372 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987689 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987538    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987689 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987576    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987689 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987602    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987826 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzpqf\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:30.987826 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:30.987727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.088991 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.088947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.088998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089566 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzpqf\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089566 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089681 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089643    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089732 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089693    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089788    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089904 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089885    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.089978 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.089913    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.091457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.091429    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.091705 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.091689    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.097978 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.097956    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.101216 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.101195    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzpqf\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf\") pod \"e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") " pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.219050 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.218962    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:31.357424 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.357363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:25:31.360770 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:25:31.360733    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10946b91_946f_4e6c_b93a_f88ee3f6a6ee.slice/crio-2a72d2b488f4c688c04d34e947c377555517933f1f59b522716cebe969689091 WatchSource:0}: Error finding container 2a72d2b488f4c688c04d34e947c377555517933f1f59b522716cebe969689091: Status 404 returned error can't find the container with id 2a72d2b488f4c688c04d34e947c377555517933f1f59b522716cebe969689091
Jul 07 00:25:31.362866 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.362833    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:31.362941 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.362901    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:31.362941 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.362930    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:31.669677 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.669641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerStarted","Data":"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"}
Jul 07 00:25:31.669851 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.669692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerStarted","Data":"2a72d2b488f4c688c04d34e947c377555517933f1f59b522716cebe969689091"}
Jul 07 00:25:31.696617 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.696566    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podStartSLOduration=1.696550678 podStartE2EDuration="1.696550678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:25:31.695197258 +0000 UTC m=+1762.148624857" watchObservedRunningTime="2026-07-07 00:25:31.696550678 +0000 UTC m=+1762.149978335"
Jul 07 00:25:31.968065 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:31.967972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:32.220053 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:32.219966    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:32.224946 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:32.224920    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:32.673922 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:32.673889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:32.674860 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:32.674840    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:33.604857 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.604822    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:33.684869 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.684836    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:25:33.685328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.685293    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:33.685328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.685310    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef12de45-bf81-4903-b035-932321ad1a9c" containerName="istio-proxy"
Jul 07 00:25:33.688589 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.688566    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.691830 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.691815    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-1e462f-serving-cert\""
Jul 07 00:25:33.708258 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.708232    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:25:33.716745 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.716714    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:33.812130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.812089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8224p\" (UniqueName: \"kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.812476 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.812155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.812476 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.812264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.815787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.815759    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:33.913506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.913423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8224p\" (UniqueName: \"kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.913506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.913466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.913681 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.913508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.913681 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:25:33.913641    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-1e462f-serving-cert: secret "maas-api-e2e-inf-a-1e462f-serving-cert" not found
Jul 07 00:25:33.913747 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:25:33.913699    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls podName:a47dfcbd-040d-4d96-91fa-5138e228dbab nodeName:}" failed. No retries permitted until 2026-07-07 00:25:34.413683967 +0000 UTC m=+1764.867111542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls") pod "maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" (UID: "a47dfcbd-040d-4d96-91fa-5138e228dbab") : secret "maas-api-e2e-inf-a-1e462f-serving-cert" not found
Jul 07 00:25:33.914102 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.914083    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:33.926247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:33.926214    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8224p\" (UniqueName: \"kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:34.122427 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.122371    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:34.298736 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.298691    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:34.402915 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.402883    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:34.417066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.417038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:34.419588 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.419561    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") pod \"maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") " pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:34.600013 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.599925    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:34.739729 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.739708    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:25:34.741888 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:25:34.741850    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47dfcbd_040d_4d96_91fa_5138e228dbab.slice/crio-a84d88d1a67bf71d2a7ff049e0ddb01c7bd6679cfa839d1ad116548b94dc6b3b WatchSource:0}: Error finding container a84d88d1a67bf71d2a7ff049e0ddb01c7bd6679cfa839d1ad116548b94dc6b3b: Status 404 returned error can't find the container with id a84d88d1a67bf71d2a7ff049e0ddb01c7bd6679cfa839d1ad116548b94dc6b3b
Jul 07 00:25:34.743428 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:34.743395    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:25:35.689000 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:35.688963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" event={"ID":"a47dfcbd-040d-4d96-91fa-5138e228dbab","Type":"ContainerStarted","Data":"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"}
Jul 07 00:25:35.689206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:35.689019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" event={"ID":"a47dfcbd-040d-4d96-91fa-5138e228dbab","Type":"ContainerStarted","Data":"a84d88d1a67bf71d2a7ff049e0ddb01c7bd6679cfa839d1ad116548b94dc6b3b"}
Jul 07 00:25:35.689206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:35.689053    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:35.705576 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:35.705465    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" podStartSLOduration=2.230607541 podStartE2EDuration="2.705448957s" totalImagesPullingTime="474.841416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:25:35.705076753 +0000 UTC m=+1766.158504351" watchObservedRunningTime="2026-07-07 00:25:35.705448957 +0000 UTC m=+1766.158876552"
Jul 07 00:25:38.102349 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:38.102309    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:38.428244 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:38.428158    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:38.741345 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:38.741264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:39.202257 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:39.202219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:41.485422 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.485368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:41.580910 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.580861    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:41.699056 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.699029    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:25:41.722776 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.722745    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:25:41.729992 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.729967    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.732303 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.732275    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-58927c-serving-cert\""
Jul 07 00:25:41.739335 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.739311    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:25:41.779427 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.775987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:41.887457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.886600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.887457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.886733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.887457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.886847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vm9t\" (UniqueName: \"kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.959515 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.959482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:41.987972 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.987877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.988140 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.987989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vm9t\" (UniqueName: \"kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.988140 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.988026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.988804 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.988767    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.990414 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.990373    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:41.997963 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:41.997934    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vm9t\" (UniqueName: \"kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t\") pod \"maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") " pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:42.042953 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:42.042917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:42.225739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:42.225711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:25:42.228241 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:25:42.228209    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7502c998_3268_42c8_a4ec_cdb4f4806ff8.slice/crio-6f788627ec5d24188717e1e303897e1ec3d1393b58a230c116ed4e71de0aca4f WatchSource:0}: Error finding container 6f788627ec5d24188717e1e303897e1ec3d1393b58a230c116ed4e71de0aca4f: Status 404 returned error can't find the container with id 6f788627ec5d24188717e1e303897e1ec3d1393b58a230c116ed4e71de0aca4f
Jul 07 00:25:42.287082 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:42.287047    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:42.381844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:42.381806    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:42.721327 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:42.721292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" event={"ID":"7502c998-3268-42c8-a4ec-cdb4f4806ff8","Type":"ContainerStarted","Data":"6f788627ec5d24188717e1e303897e1ec3d1393b58a230c116ed4e71de0aca4f"}
Jul 07 00:25:43.726344 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:43.726310    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" event={"ID":"7502c998-3268-42c8-a4ec-cdb4f4806ff8","Type":"ContainerStarted","Data":"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"}
Jul 07 00:25:43.726795 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:43.726454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:43.748255 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:43.748202    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" podStartSLOduration=2.325671712 podStartE2EDuration="2.748187797s" totalImagesPullingTime="422.516085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:25:43.746454941 +0000 UTC m=+1774.199882539" watchObservedRunningTime="2026-07-07 00:25:43.748187797 +0000 UTC m=+1774.201615392"
Jul 07 00:25:45.897424 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:45.897382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:48.530135 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.530090    2574 patch_prober.go:28] interesting pod/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:37882->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Jul 07 00:25:48.530524 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.530160    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:37882->10.133.0.36:15021: read: connection reset by peer"
Jul 07 00:25:48.756766 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.756688    2574 generic.go:356] "Generic (PLEG): container finished" podID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerID="dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9" exitCode=0
Jul 07 00:25:48.756909 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.756763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerDied","Data":"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"}
Jul 07 00:25:48.757141 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.757128    2574 scope.go:117] "RemoveContainer" containerID="dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"
Jul 07 00:25:48.758080 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.758054    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:48.758139 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.758118    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:48.758176 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:48.758151    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:25:49.737924 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:49.737890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:25:49.764351 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:49.764319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerStarted","Data":"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"}
Jul 07 00:25:50.219979 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:50.219944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:50.220153 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:50.220130    2574 patch_prober.go:28] interesting pod/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 00:25:50.220198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:50.220181    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 00:25:51.219762 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:51.219726    2574 patch_prober.go:28] interesting pod/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 00:25:51.220168 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:51.219786    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 00:25:52.220286 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:52.220253    2574 patch_prober.go:28] interesting pod/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 00:25:52.220709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:52.220305    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 00:25:53.220274 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:53.220236    2574 patch_prober.go:28] interesting pod/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 00:25:53.220483 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:53.220292    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 00:25:54.223601 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:54.223563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:54.224063 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:54.223830    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:54.224466 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:54.224447    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:25:56.065548 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:56.065512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:56.166950 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:25:56.166917    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:04.133823 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:04.133742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:04.230912 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:04.230865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:09.905080 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:09.905037    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:10.098182 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:10.098150    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:26:10.098507 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:10.098490    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:26:27.788938 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:26:27.788882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:04.756703 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:04.756665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:05.711577 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:05.711543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:05.860876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:05.860826    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:05.962026 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:05.961924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:06.273300 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.273267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:06.504391 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.504358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:06.604343 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.604254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:06.670747 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.670712    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:27:06.670989 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.670958    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerName="maas-api" containerID="cri-o://42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118" gracePeriod=30
Jul 07 00:27:06.694012 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.693979    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.37:8443/health\": dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 07 00:27:06.704111 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.704082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:06.920702 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:06.920681    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:27:07.042050 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.042014    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca\") pod \"a47dfcbd-040d-4d96-91fa-5138e228dbab\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") "
Jul 07 00:27:07.042247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.042061    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") pod \"a47dfcbd-040d-4d96-91fa-5138e228dbab\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") "
Jul 07 00:27:07.042247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.042081    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8224p\" (UniqueName: \"kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p\") pod \"a47dfcbd-040d-4d96-91fa-5138e228dbab\" (UID: \"a47dfcbd-040d-4d96-91fa-5138e228dbab\") "
Jul 07 00:27:07.042510 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.042486    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a47dfcbd-040d-4d96-91fa-5138e228dbab" (UID: "a47dfcbd-040d-4d96-91fa-5138e228dbab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:27:07.044357 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.044328    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a47dfcbd-040d-4d96-91fa-5138e228dbab" (UID: "a47dfcbd-040d-4d96-91fa-5138e228dbab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:27:07.044504 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.044382    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p" (OuterVolumeSpecName: "kube-api-access-8224p") pod "a47dfcbd-040d-4d96-91fa-5138e228dbab" (UID: "a47dfcbd-040d-4d96-91fa-5138e228dbab"). InnerVolumeSpecName "kube-api-access-8224p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:07.118721 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.118688    2574 generic.go:356] "Generic (PLEG): container finished" podID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerID="42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118" exitCode=0
Jul 07 00:27:07.118909 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.118741    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"
Jul 07 00:27:07.118909 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.118776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" event={"ID":"a47dfcbd-040d-4d96-91fa-5138e228dbab","Type":"ContainerDied","Data":"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"}
Jul 07 00:27:07.118909 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.118829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5" event={"ID":"a47dfcbd-040d-4d96-91fa-5138e228dbab","Type":"ContainerDied","Data":"a84d88d1a67bf71d2a7ff049e0ddb01c7bd6679cfa839d1ad116548b94dc6b3b"}
Jul 07 00:27:07.118909 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.118854    2574 scope.go:117] "RemoveContainer" containerID="42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"
Jul 07 00:27:07.127659 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.127642    2574 scope.go:117] "RemoveContainer" containerID="42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"
Jul 07 00:27:07.127906 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:27:07.127887    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118\": container with ID starting with 42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118 not found: ID does not exist" containerID="42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"
Jul 07 00:27:07.127949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.127915    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118"} err="failed to get container status \"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118\": rpc error: code = NotFound desc = could not find container \"42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118\": container with ID starting with 42ef90f0ed3ea22909f233b1aad47f9ed3935f67efb26622c5fbb1eeff0dc118 not found: ID does not exist"
Jul 07 00:27:07.142879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.142857    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47dfcbd-040d-4d96-91fa-5138e228dbab-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:07.142879 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.142878    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47dfcbd-040d-4d96-91fa-5138e228dbab-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:07.143026 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.142889    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8224p\" (UniqueName: \"kubernetes.io/projected/a47dfcbd-040d-4d96-91fa-5138e228dbab-kube-api-access-8224p\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:07.162906 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.162838    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:27:07.171312 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:07.171258    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1e462f-5f6bf854dc-2hbf5"]
Jul 07 00:27:08.087815 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:08.087784    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" path="/var/lib/kubelet/pods/a47dfcbd-040d-4d96-91fa-5138e228dbab/volumes"
Jul 07 00:27:11.334153 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:11.334094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:20.328953 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:20.328914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:48.306180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.306093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:48.552429 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.552378    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:27:48.552673 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.552648    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy" containerID="cri-o://4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec" gracePeriod=30
Jul 07 00:27:48.576706 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.576632    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:48.801222 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.801183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:48.969804 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:48.969658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:49.356774 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.356737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:49.456858 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.456825    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:49.557274 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.557239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:49.660922 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.660839    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:27:49.661097 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.661073    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerName="maas-api" containerID="cri-o://76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf" gracePeriod=30
Jul 07 00:27:49.693561 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.693522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:49.732749 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.732710    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.38:8443/health\": dial tcp 10.133.0.38:8443: connect: connection refused"
Jul 07 00:27:49.907661 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:49.907633    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:27:50.012768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.012658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vm9t\" (UniqueName: \"kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t\") pod \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") "
Jul 07 00:27:50.012768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.012719    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca\") pod \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") "
Jul 07 00:27:50.012768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.012762    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls\") pod \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\" (UID: \"7502c998-3268-42c8-a4ec-cdb4f4806ff8\") "
Jul 07 00:27:50.013149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.013119    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7502c998-3268-42c8-a4ec-cdb4f4806ff8" (UID: "7502c998-3268-42c8-a4ec-cdb4f4806ff8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:27:50.014841 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.014811    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t" (OuterVolumeSpecName: "kube-api-access-7vm9t") pod "7502c998-3268-42c8-a4ec-cdb4f4806ff8" (UID: "7502c998-3268-42c8-a4ec-cdb4f4806ff8"). InnerVolumeSpecName "kube-api-access-7vm9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:50.014948 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.014885    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7502c998-3268-42c8-a4ec-cdb4f4806ff8" (UID: "7502c998-3268-42c8-a4ec-cdb4f4806ff8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:27:50.113665 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.113634    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vm9t\" (UniqueName: \"kubernetes.io/projected/7502c998-3268-42c8-a4ec-cdb4f4806ff8-kube-api-access-7vm9t\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:50.113665 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.113660    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7502c998-3268-42c8-a4ec-cdb4f4806ff8-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:50.113665 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.113669    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7502c998-3268-42c8-a4ec-cdb4f4806ff8-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:50.294193 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.294163    2574 generic.go:356] "Generic (PLEG): container finished" podID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerID="76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf" exitCode=0
Jul 07 00:27:50.294377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.294200    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" event={"ID":"7502c998-3268-42c8-a4ec-cdb4f4806ff8","Type":"ContainerDied","Data":"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"}
Jul 07 00:27:50.294377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.294222    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"
Jul 07 00:27:50.294377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.294241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq" event={"ID":"7502c998-3268-42c8-a4ec-cdb4f4806ff8","Type":"ContainerDied","Data":"6f788627ec5d24188717e1e303897e1ec3d1393b58a230c116ed4e71de0aca4f"}
Jul 07 00:27:50.294377 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.294263    2574 scope.go:117] "RemoveContainer" containerID="76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"
Jul 07 00:27:50.302390 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.302371    2574 scope.go:117] "RemoveContainer" containerID="76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"
Jul 07 00:27:50.302660 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:27:50.302641    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf\": container with ID starting with 76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf not found: ID does not exist" containerID="76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"
Jul 07 00:27:50.302715 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.302667    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf"} err="failed to get container status \"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf\": rpc error: code = NotFound desc = could not find container \"76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf\": container with ID starting with 76ab00aaf641a9e6bc7546c527fb812ed52cee25198b6b31f5e62304e4f5d7cf not found: ID does not exist"
Jul 07 00:27:50.310210 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.310188    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:27:50.318053 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:50.318035    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-58927c-54f75c747d-zm6cq"]
Jul 07 00:27:52.088131 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:52.088099    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" path="/var/lib/kubelet/pods/7502c998-3268-42c8-a4ec-cdb4f4806ff8/volumes"
Jul 07 00:27:53.803960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.803932    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:27:53.845241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845202    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845226    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845258    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845318    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845375    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845433    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzpqf\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845465    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845483    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:53.845833 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845492    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket\") pod \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\" (UID: \"10946b91-946f-4e6c-b93a-f88ee3f6a6ee\") "
Jul 07 00:27:53.845833 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845741    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:53.845833 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845685    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:27:53.846005 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845848    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.846005 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.845868    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.846089 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.846067    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:53.846387 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.846363    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:53.847642 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.847621    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:53.847739 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.847720    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf" (OuterVolumeSpecName: "kube-api-access-gzpqf") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "kube-api-access-gzpqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:53.848109 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.848089    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:53.848167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.848114    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10946b91-946f-4e6c-b93a-f88ee3f6a6ee" (UID: "10946b91-946f-4e6c-b93a-f88ee3f6a6ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:27:53.947059 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947030    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947059 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947058    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947071    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzpqf\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-kube-api-access-gzpqf\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947083    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947095    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947106    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:53.947282 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:53.947116    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10946b91-946f-4e6c-b93a-f88ee3f6a6ee-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:27:54.314338 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.314303    2574 generic.go:356] "Generic (PLEG): container finished" podID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerID="4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec" exitCode=0
Jul 07 00:27:54.314562 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.314372    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"
Jul 07 00:27:54.314562 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.314391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerDied","Data":"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"}
Jul 07 00:27:54.314562 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.314508    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q" event={"ID":"10946b91-946f-4e6c-b93a-f88ee3f6a6ee","Type":"ContainerDied","Data":"2a72d2b488f4c688c04d34e947c377555517933f1f59b522716cebe969689091"}
Jul 07 00:27:54.314562 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.314551    2574 scope.go:117] "RemoveContainer" containerID="4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"
Jul 07 00:27:54.322760 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.322743    2574 scope.go:117] "RemoveContainer" containerID="dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"
Jul 07 00:27:54.330435 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.330394    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:27:54.330956 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.330945    2574 scope.go:117] "RemoveContainer" containerID="4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"
Jul 07 00:27:54.331209 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:27:54.331192    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec\": container with ID starting with 4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec not found: ID does not exist" containerID="4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"
Jul 07 00:27:54.331257 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.331217    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec"} err="failed to get container status \"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec\": rpc error: code = NotFound desc = could not find container \"4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec\": container with ID starting with 4e00992e253736bda4e4ec9c24be0de56347346d9891efef415cbcce6ad259ec not found: ID does not exist"
Jul 07 00:27:54.331257 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.331234    2574 scope.go:117] "RemoveContainer" containerID="dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"
Jul 07 00:27:54.331480 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:27:54.331458    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9\": container with ID starting with dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9 not found: ID does not exist" containerID="dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"
Jul 07 00:27:54.331541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.331491    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9"} err="failed to get container status \"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9\": rpc error: code = NotFound desc = could not find container \"dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9\": container with ID starting with dcd4c4f16072f9d8a04dd4b2021e2ca610af7cc0d8b27c2853bb0ff88b1b34b9 not found: ID does not exist"
Jul 07 00:27:54.334655 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:54.334633    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1e462f-openshift-default-66c6565b77-6d82q"]
Jul 07 00:27:55.122619 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:55.122588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:55.185843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:55.185807    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:55.447264 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:55.447172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:55.668258 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:55.668223    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:56.052998 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.052964    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:56.088055 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.088025    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" path="/var/lib/kubelet/pods/10946b91-946f-4e6c-b93a-f88ee3f6a6ee/volumes"
Jul 07 00:27:56.286423 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286376    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286678    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286689    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286697    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerName="maas-api"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286703    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerName="maas-api"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286714    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286720    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286726    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerName="maas-api"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286731    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerName="maas-api"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286788    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286795    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47dfcbd-040d-4d96-91fa-5138e228dbab" containerName="maas-api"
Jul 07 00:27:56.286798 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.286803    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7502c998-3268-42c8-a4ec-cdb4f4806ff8" containerName="maas-api"
Jul 07 00:27:56.291512 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.291490    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.293843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.293814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-494b9b-openshift-default-dockercfg-rcjlt\""
Jul 07 00:27:56.307600 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.307529    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:27:56.340791 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.340756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:56.367787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4v6\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.367955 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367935    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.368152 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.367971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.368152 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.368033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468639 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4v6\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468812    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.468862 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.468937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.469142    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.469152    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469449 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.469236    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469552 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.469530    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.469624 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.469571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.471318 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.471297    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.471436 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.471377    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.478091 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.478067    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4v6\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.478321 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.478300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token\") pod \"e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") " pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.510263 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.510230    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:56.601243 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.601163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:56.730890 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.730866    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:27:56.733346 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:27:56.733316    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf557cfef_474b_488c_893e_4c16d9ae7cbc.slice/crio-95607881e18ccafd1882982b764369ca8d00524cc749db3835ce08aac00f8eff WatchSource:0}: Error finding container 95607881e18ccafd1882982b764369ca8d00524cc749db3835ce08aac00f8eff: Status 404 returned error can't find the container with id 95607881e18ccafd1882982b764369ca8d00524cc749db3835ce08aac00f8eff
Jul 07 00:27:56.735534 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.735503    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:27:56.735653 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.735577    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:27:56.735653 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:56.735608    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:27:57.332854 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:57.332814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerStarted","Data":"8980ae7ae0078d796465dddfa49173cc21a1bd3f1669459df86ac4094bc53301"}
Jul 07 00:27:57.333347 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:57.332873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerStarted","Data":"95607881e18ccafd1882982b764369ca8d00524cc749db3835ce08aac00f8eff"}
Jul 07 00:27:57.354020 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:57.353969    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podStartSLOduration=1.353953963 podStartE2EDuration="1.353953963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:27:57.352181202 +0000 UTC m=+1907.805608797" watchObservedRunningTime="2026-07-07 00:27:57.353953963 +0000 UTC m=+1907.807381559"
Jul 07 00:27:57.602353 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:57.602263    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:57.606966 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:57.606940    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:58.336949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:58.336911    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:58.337934 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:58.337914    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:27:59.280576 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.280511    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:59.346382 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.346352    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:27:59.346853 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.346731    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10946b91-946f-4e6c-b93a-f88ee3f6a6ee" containerName="istio-proxy"
Jul 07 00:27:59.349828 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.349804    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.352376 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.352357    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-494b9b-serving-cert\""
Jul 07 00:27:59.365397 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.365361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:27:59.368303 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.368273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:59.447848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.447804    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:59.493866 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.493830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.494042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.493872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvnzl\" (UniqueName: \"kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.494042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.493995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.585657 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.585567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:59.594648 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.594621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.594773 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.594673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.594773 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.594707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvnzl\" (UniqueName: \"kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.595371 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.595350    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.597142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.597120    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.603668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.603647    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvnzl\" (UniqueName: \"kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl\") pod \"maas-api-e2e-api-a-494b9b-5f89745d7d-nk226\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") " pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.659883 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.659853    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:27:59.793985 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.793961    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:27:59.796290 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:27:59.796255    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9630b36a_4de4_48ec_a529_19c1d67b0cd7.slice/crio-7791dd6aa8d55b84a56cf5c34640661c81e97c8804744c18e7f217eeea065cec WatchSource:0}: Error finding container 7791dd6aa8d55b84a56cf5c34640661c81e97c8804744c18e7f217eeea065cec: Status 404 returned error can't find the container with id 7791dd6aa8d55b84a56cf5c34640661c81e97c8804744c18e7f217eeea065cec
Jul 07 00:27:59.945819 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:27:59.945731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:00.047054 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:00.047005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:00.347564 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:00.347526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" event={"ID":"9630b36a-4de4-48ec-a529-19c1d67b0cd7","Type":"ContainerStarted","Data":"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"}
Jul 07 00:28:00.347958 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:00.347590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:28:00.347958 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:00.347615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" event={"ID":"9630b36a-4de4-48ec-a529-19c1d67b0cd7","Type":"ContainerStarted","Data":"7791dd6aa8d55b84a56cf5c34640661c81e97c8804744c18e7f217eeea065cec"}
Jul 07 00:28:00.367094 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:00.367035    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" podStartSLOduration=0.952457912 podStartE2EDuration="1.367018443s" totalImagesPullingTime="414.560531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:00.365091244 +0000 UTC m=+1910.818518841" watchObservedRunningTime="2026-07-07 00:28:00.367018443 +0000 UTC m=+1910.820446038"
Jul 07 00:28:03.757919 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:03.757877    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:04.211198 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.211162    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:04.501382 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.501307    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:04.504345 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.504329    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.509710 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.509690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c1149c-openshift-default-dockercfg-twbr6\""
Jul 07 00:28:04.520569 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.520536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:04.544823 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.544793    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:04.635074 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dhx\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635074 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635281    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635487 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635487 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.635487 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.635350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.736912 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.736868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.736931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.736956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.736978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737395 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dhx\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737395 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737395 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737604 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737448    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737725 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737700    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737799 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737779    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737858 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737838    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.737906 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.737862    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.739320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.739302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.739590 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.739573    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.745396 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.745373    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.745582 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.745563    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dhx\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx\") pod \"e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") " pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.815392 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.815358    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:04.952878 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.952853    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:04.955044 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:28:04.955015    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10742b4c_adc5_4f38_b1b0_366d94c5068b.slice/crio-8027d9574f5017cda72308677580571dc0ac628145bf8dfae8b762aff64863f4 WatchSource:0}: Error finding container 8027d9574f5017cda72308677580571dc0ac628145bf8dfae8b762aff64863f4: Status 404 returned error can't find the container with id 8027d9574f5017cda72308677580571dc0ac628145bf8dfae8b762aff64863f4
Jul 07 00:28:04.957309 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.957278    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:04.957385 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.957344    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:04.957385 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:04.957373    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:05.296420 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:05.296379    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:05.370032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:05.369996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerStarted","Data":"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"}
Jul 07 00:28:05.370213 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:05.370054    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerStarted","Data":"8027d9574f5017cda72308677580571dc0ac628145bf8dfae8b762aff64863f4"}
Jul 07 00:28:05.393612 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:05.393561    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podStartSLOduration=1.39354631 podStartE2EDuration="1.39354631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:05.392496084 +0000 UTC m=+1915.845923692" watchObservedRunningTime="2026-07-07 00:28:05.39354631 +0000 UTC m=+1915.846973905"
Jul 07 00:28:05.816095 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:05.816036    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:06.358339 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:06.358314    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:28:06.820566 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:06.820528    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:07.292371 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.292320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:07.379420 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.379386    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:07.380561 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.380527    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:07.395051 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.395019    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:07.563248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.563158    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:07.784810 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:07.784777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:08.041072 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:08.041034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:08.142898 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:08.142866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:11.281182 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:11.281147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:11.383060 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:11.383018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:11.768085 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:11.768045    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:14.378615 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:14.378570    2574 patch_prober.go:28] interesting pod/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 00:28:14.379033 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:14.378637    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 00:28:15.421936 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.421844    2574 generic.go:356] "Generic (PLEG): container finished" podID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerID="8980ae7ae0078d796465dddfa49173cc21a1bd3f1669459df86ac4094bc53301" exitCode=0
Jul 07 00:28:15.421936 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.421911    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerDied","Data":"8980ae7ae0078d796465dddfa49173cc21a1bd3f1669459df86ac4094bc53301"}
Jul 07 00:28:15.422554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.422473    2574 scope.go:117] "RemoveContainer" containerID="8980ae7ae0078d796465dddfa49173cc21a1bd3f1669459df86ac4094bc53301"
Jul 07 00:28:15.423733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.423699    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:15.423840 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.423786    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:15.423840 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:15.423821    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:16.427425 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:16.427371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerStarted","Data":"4532b8348b4eb13575033c2a338fbb229047bf5bbd28629e241b0286a01787eb"}
Jul 07 00:28:16.602305 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:16.602269    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:16.602529 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:16.602419    2574 patch_prober.go:28] interesting pod/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 07 00:28:16.602529 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:16.602466    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 07 00:28:17.602116 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:17.602075    2574 patch_prober.go:28] interesting pod/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 07 00:28:17.602755 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:17.602724    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 07 00:28:18.602588 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:18.602546    2574 patch_prober.go:28] interesting pod/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 07 00:28:18.603264 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:18.603233    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 07 00:28:19.601695 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:19.601651    2574 patch_prober.go:28] interesting pod/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 07 00:28:19.601908 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:19.601717    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 07 00:28:19.788429 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:19.788099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:20.135835 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.135800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:20.306521 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.306473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:20.400450 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.400343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:20.571095 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.571051    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:28:20.571359 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.571326    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" podUID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" containerName="maas-api" containerID="cri-o://0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260" gracePeriod=30
Jul 07 00:28:20.601640 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.601598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:20.605061 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.605038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:20.605423 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.605392    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:20.606046 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.606028    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:20.829812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.829780    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:28:20.994742 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.994650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca\") pod \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") "
Jul 07 00:28:20.994742 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.994727    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls\") pod \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") "
Jul 07 00:28:20.994983 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.994757    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvnzl\" (UniqueName: \"kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl\") pod \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\" (UID: \"9630b36a-4de4-48ec-a529-19c1d67b0cd7\") "
Jul 07 00:28:20.995110 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.995086    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9630b36a-4de4-48ec-a529-19c1d67b0cd7" (UID: "9630b36a-4de4-48ec-a529-19c1d67b0cd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:28:20.996870 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.996834    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9630b36a-4de4-48ec-a529-19c1d67b0cd7" (UID: "9630b36a-4de4-48ec-a529-19c1d67b0cd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:28:20.997066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:20.997040    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl" (OuterVolumeSpecName: "kube-api-access-gvnzl") pod "9630b36a-4de4-48ec-a529-19c1d67b0cd7" (UID: "9630b36a-4de4-48ec-a529-19c1d67b0cd7"). InnerVolumeSpecName "kube-api-access-gvnzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:21.095560 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.095515    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9630b36a-4de4-48ec-a529-19c1d67b0cd7-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:21.095560 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.095556    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9630b36a-4de4-48ec-a529-19c1d67b0cd7-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:21.095766 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.095571    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvnzl\" (UniqueName: \"kubernetes.io/projected/9630b36a-4de4-48ec-a529-19c1d67b0cd7-kube-api-access-gvnzl\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:21.449135 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.449094    2574 generic.go:356] "Generic (PLEG): container finished" podID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" containerID="0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260" exitCode=0
Jul 07 00:28:21.449320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.449155    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"
Jul 07 00:28:21.449320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.449187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" event={"ID":"9630b36a-4de4-48ec-a529-19c1d67b0cd7","Type":"ContainerDied","Data":"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"}
Jul 07 00:28:21.449320 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.449287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226" event={"ID":"9630b36a-4de4-48ec-a529-19c1d67b0cd7","Type":"ContainerDied","Data":"7791dd6aa8d55b84a56cf5c34640661c81e97c8804744c18e7f217eeea065cec"}
Jul 07 00:28:21.449474 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.449318    2574 scope.go:117] "RemoveContainer" containerID="0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"
Jul 07 00:28:21.458366 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.458347    2574 scope.go:117] "RemoveContainer" containerID="0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"
Jul 07 00:28:21.458688 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:28:21.458668    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260\": container with ID starting with 0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260 not found: ID does not exist" containerID="0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"
Jul 07 00:28:21.458751 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.458698    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260"} err="failed to get container status \"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260\": rpc error: code = NotFound desc = could not find container \"0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260\": container with ID starting with 0b79e6c267f3c455327b8f8ed0e32a63f8721d537a5fa56c50cc1cab3a6ea260 not found: ID does not exist"
Jul 07 00:28:21.473034 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.473004    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:28:21.476900 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:21.476874    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-494b9b-5f89745d7d-nk226"]
Jul 07 00:28:22.088761 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:22.088724    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" path="/var/lib/kubelet/pods/9630b36a-4de4-48ec-a529-19c1d67b0cd7/volumes"
Jul 07 00:28:23.214965 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.214789    2574 patch_prober.go:28] interesting pod/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:39680->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Jul 07 00:28:23.214965 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.214852    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:39680->10.133.0.41:15021: read: connection reset by peer"
Jul 07 00:28:23.460375 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.460297    2574 generic.go:356] "Generic (PLEG): container finished" podID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerID="ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c" exitCode=0
Jul 07 00:28:23.460541 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.460373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerDied","Data":"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"}
Jul 07 00:28:23.460864 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.460847    2574 scope.go:117] "RemoveContainer" containerID="ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"
Jul 07 00:28:23.461867 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.461832    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:23.461937 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.461916    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:23.461977 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:23.461947    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:24.467662 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:24.467625    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerStarted","Data":"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"}
Jul 07 00:28:24.815659 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:24.815620    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:24.815857 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:24.815835    2574 patch_prober.go:28] interesting pod/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 00:28:24.815903 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:24.815880    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 00:28:25.816626 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:25.816581    2574 patch_prober.go:28] interesting pod/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 00:28:25.817030 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:25.816659    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 00:28:26.098230 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.098124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:26.205880 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.205839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:26.365061 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.364959    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:28:26.365887 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.365842    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy" containerID="cri-o://4532b8348b4eb13575033c2a338fbb229047bf5bbd28629e241b0286a01787eb" gracePeriod=30
Jul 07 00:28:26.395497 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.395082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:26.601746 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.601709    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:26.766174 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.766144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:26.816652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.816618    2574 patch_prober.go:28] interesting pod/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 00:28:26.817043 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:26.816675    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 00:28:27.132187 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.132092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:27.268053 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.268016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:27.360506 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.360465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:27.549169 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.549133    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:27.816485 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.816387    2574 patch_prober.go:28] interesting pod/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 00:28:27.816485 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:27.816474    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 00:28:28.819164 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:28.819135    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:28.819650 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:28.819512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:28.820247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:28.820229    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:31.507240 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.507210    2574 generic.go:356] "Generic (PLEG): container finished" podID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerID="4532b8348b4eb13575033c2a338fbb229047bf5bbd28629e241b0286a01787eb" exitCode=0
Jul 07 00:28:31.507672 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.507253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerDied","Data":"4532b8348b4eb13575033c2a338fbb229047bf5bbd28629e241b0286a01787eb"}
Jul 07 00:28:31.507672 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.507300    2574 scope.go:117] "RemoveContainer" containerID="8980ae7ae0078d796465dddfa49173cc21a1bd3f1669459df86ac4094bc53301"
Jul 07 00:28:31.625777 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.625753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:31.686621 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686542    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686621 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686581    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686621 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686609    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686643    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686663    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686680    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf4v6\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686715    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686744    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.686894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686864    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:31.687226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.686920    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert\") pod \"f557cfef-474b-488c-893e-4c16d9ae7cbc\" (UID: \"f557cfef-474b-488c-893e-4c16d9ae7cbc\") "
Jul 07 00:28:31.687226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687114    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:31.687328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687222    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.687328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687243    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.687328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687281    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:28:31.687328 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687289    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:31.687549 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.687389    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:31.689007 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.688974    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:31.689146 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.689015    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6" (OuterVolumeSpecName: "kube-api-access-gf4v6") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "kube-api-access-gf4v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:31.689388 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.689367    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:31.689388 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.689371    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f557cfef-474b-488c-893e-4c16d9ae7cbc" (UID: "f557cfef-474b-488c-893e-4c16d9ae7cbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:28:31.788241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788204    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788235    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788241 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788243    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788252    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf4v6\" (UniqueName: \"kubernetes.io/projected/f557cfef-474b-488c-893e-4c16d9ae7cbc-kube-api-access-gf4v6\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788261    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788270    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f557cfef-474b-488c-893e-4c16d9ae7cbc-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:31.788494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:31.788277    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f557cfef-474b-488c-893e-4c16d9ae7cbc-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:32.513269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.513176    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"
Jul 07 00:28:32.513269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.513182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw" event={"ID":"f557cfef-474b-488c-893e-4c16d9ae7cbc","Type":"ContainerDied","Data":"95607881e18ccafd1882982b764369ca8d00524cc749db3835ce08aac00f8eff"}
Jul 07 00:28:32.513269 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.513245    2574 scope.go:117] "RemoveContainer" containerID="4532b8348b4eb13575033c2a338fbb229047bf5bbd28629e241b0286a01787eb"
Jul 07 00:28:32.531764 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.531736    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:28:32.536478 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.536454    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-494b9b-openshift-default-847c68cf79-r64fw"]
Jul 07 00:28:32.848510 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.848465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:32.948324 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:32.948285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:33.097590 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.097558    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:33.097790 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.097770    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy" containerID="cri-o://814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc" gracePeriod=30
Jul 07 00:28:33.114079 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.114001    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:33.389047 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.388960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:33.694663 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.694567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:33.956495 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956384    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:28:33.956804 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956786    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:33.956907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956808    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:33.956907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956846    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" containerName="maas-api"
Jul 07 00:28:33.956907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956855    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" containerName="maas-api"
Jul 07 00:28:33.956907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956870    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:33.956907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956879    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:33.957146 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956970    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:33.957146 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.956984    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9630b36a-4de4-48ec-a529-19c1d67b0cd7" containerName="maas-api"
Jul 07 00:28:33.960204 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.960182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:33.962771 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.962752    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f5f1a0-openshift-default-dockercfg-7z2zt\""
Jul 07 00:28:33.973364 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.973341    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:28:33.986379 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:33.986353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:34.007457 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007611 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9lz4\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007611 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007611 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007650    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.007733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.007705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.088794 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.088761    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" path="/var/lib/kubelet/pods/f557cfef-474b-488c-893e-4c16d9ae7cbc/volumes"
Jul 07 00:28:34.108684 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.108844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.108844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.108966 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.108966 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.108966 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.108923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109129 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109129 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9lz4\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109129 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109119    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109224    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109250    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109487 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109448    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.109842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.109820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.111068 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.111048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.111296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.111279    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.118551 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.118527    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.119704 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.119683    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9lz4\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4\") pod \"e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") " pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.269997 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.269965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:34.406344 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.406312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:28:34.408678 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:28:34.408648    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e05ac24_f9fe_4782_b2a2_91e0bf927f69.slice/crio-98d3a01d679b7d3aeef3b323d0add741e29219479bedc1268433fec84909f64e WatchSource:0}: Error finding container 98d3a01d679b7d3aeef3b323d0add741e29219479bedc1268433fec84909f64e: Status 404 returned error can't find the container with id 98d3a01d679b7d3aeef3b323d0add741e29219479bedc1268433fec84909f64e
Jul 07 00:28:34.410940 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.410910    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:34.411003 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.410975    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:34.411040 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.411002    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:34.523501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.523389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerStarted","Data":"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"}
Jul 07 00:28:34.523501 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.523467    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerStarted","Data":"98d3a01d679b7d3aeef3b323d0add741e29219479bedc1268433fec84909f64e"}
Jul 07 00:28:34.545616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.545557    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podStartSLOduration=1.545536813 podStartE2EDuration="1.545536813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:34.54422234 +0000 UTC m=+1944.997649936" watchObservedRunningTime="2026-07-07 00:28:34.545536813 +0000 UTC m=+1944.998964411"
Jul 07 00:28:34.625142 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:34.625104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:35.270830 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:35.270794    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:35.275678 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:35.275654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:35.533019 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:35.532931    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:35.533907 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:35.533885    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:36.533226 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:36.533180    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:36.660939 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:36.660906    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:36.895087 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:36.895004    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:37.339131 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:37.339095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:37.441267 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:37.441235    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:37.542263 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:37.542221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:38.342485 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.342463    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:38.447870 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447786    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.447870 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447821    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.447870 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447846    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447891    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447909    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447932    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.447969    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448010    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448074    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7dhx\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx\") pod \"10742b4c-adc5-4f38-b1b0-366d94c5068b\" (UID: \"10742b4c-adc5-4f38-b1b0-366d94c5068b\") "
Jul 07 00:28:38.448149 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448080    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:38.448620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448231    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:38.448620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448281    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:38.448620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448329    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:28:38.448620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448375    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.448620 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448387    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.448993 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.448967    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data" (OuterVolumeSpecName: "istio-data") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:38.450242 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.450213    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:28:38.450352 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.450283    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token" (OuterVolumeSpecName: "istio-token") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:38.450528 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.450508    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:38.450573 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.450536    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx" (OuterVolumeSpecName: "kube-api-access-f7dhx") pod "10742b4c-adc5-4f38-b1b0-366d94c5068b" (UID: "10742b4c-adc5-4f38-b1b0-366d94c5068b"). InnerVolumeSpecName "kube-api-access-f7dhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:38.546993 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.546956    2574 generic.go:356] "Generic (PLEG): container finished" podID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerID="814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc" exitCode=0
Jul 07 00:28:38.547472 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.547000    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"
Jul 07 00:28:38.547472 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.547045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerDied","Data":"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"}
Jul 07 00:28:38.547472 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.547112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd" event={"ID":"10742b4c-adc5-4f38-b1b0-366d94c5068b","Type":"ContainerDied","Data":"8027d9574f5017cda72308677580571dc0ac628145bf8dfae8b762aff64863f4"}
Jul 07 00:28:38.547472 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.547150    2574 scope.go:117] "RemoveContainer" containerID="814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"
Jul 07 00:28:38.548981 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.548959    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.548981 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.548982    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.549130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.548995    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.549130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.549007    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.549130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.549019    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7dhx\" (UniqueName: \"kubernetes.io/projected/10742b4c-adc5-4f38-b1b0-366d94c5068b-kube-api-access-f7dhx\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.549130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.549033    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10742b4c-adc5-4f38-b1b0-366d94c5068b-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.549130 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.549046    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10742b4c-adc5-4f38-b1b0-366d94c5068b-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:28:38.556252 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.556233    2574 scope.go:117] "RemoveContainer" containerID="ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"
Jul 07 00:28:38.564031 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.564013    2574 scope.go:117] "RemoveContainer" containerID="814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"
Jul 07 00:28:38.564295 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:28:38.564276    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc\": container with ID starting with 814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc not found: ID does not exist" containerID="814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"
Jul 07 00:28:38.564358 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.564304    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc"} err="failed to get container status \"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc\": rpc error: code = NotFound desc = could not find container \"814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc\": container with ID starting with 814d8b9c94842d837b8fb2915ae4898270a73d4a16a4bd4ada5d9f8de7a67ddc not found: ID does not exist"
Jul 07 00:28:38.564358 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.564322    2574 scope.go:117] "RemoveContainer" containerID="ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"
Jul 07 00:28:38.564588 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:28:38.564568    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c\": container with ID starting with ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c not found: ID does not exist" containerID="ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"
Jul 07 00:28:38.564679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.564595    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c"} err="failed to get container status \"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c\": rpc error: code = NotFound desc = could not find container \"ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c\": container with ID starting with ea3a9e6ecb5bf5c96b43b42ffd97526452cd39b0eee9a52b90b33669352ec65c not found: ID does not exist"
Jul 07 00:28:38.568209 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.568186    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:38.573024 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:38.573002    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c1149c-openshift-default-7cf65656b7-sv2cd"]
Jul 07 00:28:40.087709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:40.087672    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" path="/var/lib/kubelet/pods/10742b4c-adc5-4f38-b1b0-366d94c5068b/volumes"
Jul 07 00:28:41.036032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.035995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:41.276121 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.276092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:41.557807 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.557776    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:28:41.558112 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558098    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.558167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558113    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.558167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558128    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.558167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558134    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.558284 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558184    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f557cfef-474b-488c-893e-4c16d9ae7cbc" containerName="istio-proxy"
Jul 07 00:28:41.558284 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558191    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.558284 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.558198    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="10742b4c-adc5-4f38-b1b0-366d94c5068b" containerName="istio-proxy"
Jul 07 00:28:41.561536 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.561516    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.565368 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.565351    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ead650-openshift-default-dockercfg-5bmm7\""
Jul 07 00:28:41.577064 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.577043    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:28:41.584116 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.584091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:41.678523 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678688 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678908 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678908 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9jsk\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.678908 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.678804    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779350 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779350 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779586 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9jsk\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779942 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779856    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779990 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779938    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.779990 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.779961    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.780138 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.780116    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.780238 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.780216    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.781828 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.781797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.782079 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.782061    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.787689 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.787667    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.787919 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.787900    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9jsk\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk\") pod \"e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") " pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.871662 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.871571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:41.893439 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:41.893385    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:42.007768 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.007718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:28:42.010070 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:28:42.010033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3275a9_285b_4cd6_b68e_aa76fa39e872.slice/crio-1ad3f9c044fd6f72784180c16862b93c9b9cca3169712b49ccf0fb78cf26f1e3 WatchSource:0}: Error finding container 1ad3f9c044fd6f72784180c16862b93c9b9cca3169712b49ccf0fb78cf26f1e3: Status 404 returned error can't find the container with id 1ad3f9c044fd6f72784180c16862b93c9b9cca3169712b49ccf0fb78cf26f1e3
Jul 07 00:28:42.014094 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.014062    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:42.014228 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.014147    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:42.014228 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.014191    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:42.571167 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.571125    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerStarted","Data":"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"}
Jul 07 00:28:42.571577 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.571223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerStarted","Data":"1ad3f9c044fd6f72784180c16862b93c9b9cca3169712b49ccf0fb78cf26f1e3"}
Jul 07 00:28:42.592470 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.592371    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podStartSLOduration=1.592351598 podStartE2EDuration="1.592351598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:42.591900815 +0000 UTC m=+1953.045328412" watchObservedRunningTime="2026-07-07 00:28:42.592351598 +0000 UTC m=+1953.045779194"
Jul 07 00:28:42.872536 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:42.872447    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:43.877068 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:43.877040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:44.580448 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.580386    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:44.581525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.581501    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:28:44.670646 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.670605    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:44.711979 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.711950    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:28:44.714103 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.714087    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.721370 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.720974    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-ead650-serving-cert\""
Jul 07 00:28:44.728559 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.728532    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:28:44.768102 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.768069    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:44.806981 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.806950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.807148 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.806989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmshk\" (UniqueName: \"kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.807148 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.807030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.866730 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.866644    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:44.908169 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.908131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.908574 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.908179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmshk\" (UniqueName: \"kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.908574 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.908226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.908574 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:28:44.908368    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-ead650-serving-cert: secret "maas-api-e2e-shared-b-ead650-serving-cert" not found
Jul 07 00:28:44.908574 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:28:44.908454    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls podName:793058f9-1ec9-4f67-b942-ec8325480245 nodeName:}" failed. No retries permitted until 2026-07-07 00:28:45.408430801 +0000 UTC m=+1955.861858375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls") pod "maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" (UID: "793058f9-1ec9-4f67-b942-ec8325480245") : secret "maas-api-e2e-shared-b-ead650-serving-cert" not found
Jul 07 00:28:44.908933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.908908    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.919088 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.919054    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmshk\" (UniqueName: \"kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:44.994975 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:44.994939    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:45.329183 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.329149    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:45.413515 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.413474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:45.415956 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.415916    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") pod \"maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") " pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:45.432831 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.432792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:45.625163 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.625059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:45.793429 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:45.789475    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:28:45.797768 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:28:45.797739    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793058f9_1ec9_4f67_b942_ec8325480245.slice/crio-dc57d87de08bdf3bd386bc35de440a39f91bf5db893d28c14f835f1251152e51 WatchSource:0}: Error finding container dc57d87de08bdf3bd386bc35de440a39f91bf5db893d28c14f835f1251152e51: Status 404 returned error can't find the container with id dc57d87de08bdf3bd386bc35de440a39f91bf5db893d28c14f835f1251152e51
Jul 07 00:28:46.592810 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:46.592766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" event={"ID":"793058f9-1ec9-4f67-b942-ec8325480245","Type":"ContainerStarted","Data":"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"}
Jul 07 00:28:46.593289 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:46.592829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" event={"ID":"793058f9-1ec9-4f67-b942-ec8325480245","Type":"ContainerStarted","Data":"dc57d87de08bdf3bd386bc35de440a39f91bf5db893d28c14f835f1251152e51"}
Jul 07 00:28:46.624661 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:46.624607    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" podStartSLOduration=2.286410581 podStartE2EDuration="2.624585855s" totalImagesPullingTime="338.175274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:46.622691992 +0000 UTC m=+1957.076119588" watchObservedRunningTime="2026-07-07 00:28:46.624585855 +0000 UTC m=+1957.078013451"
Jul 07 00:28:47.596459 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:47.596423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:48.970365 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:48.970297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:51.575642 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:51.575599    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 00:28:51.576169 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:51.575687    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 00:28:52.624268 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.624185    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerID="21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b" exitCode=0
Jul 07 00:28:52.624268 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.624259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerDied","Data":"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"}
Jul 07 00:28:52.624749 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.624657    2574 scope.go:117] "RemoveContainer" containerID="21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"
Jul 07 00:28:52.625680 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.625646    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:52.625764 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.625748    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:52.625802 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:52.625789    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:53.606210 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:53.606180    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:28:53.633297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:53.633257    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerStarted","Data":"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"}
Jul 07 00:28:54.270990 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:54.270958    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:54.271348 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:54.271013    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 00:28:54.271562 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:54.271536    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 00:28:55.271279 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:55.271237    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 00:28:55.272030 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:55.271996    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 00:28:56.270514 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:56.270475    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 00:28:56.270708 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:56.270541    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 00:28:57.272107 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:57.272068    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 00:28:57.272686 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:57.272133    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 00:28:58.230010 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:58.229971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:58.274675 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:58.274646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:58.275151 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:58.275040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:58.275761 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:58.275739    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:28:58.316519 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:58.316475    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:59.581707 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.581670    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 07 00:28:59.582163 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.581728    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 07 00:28:59.662996 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.662958    2574 generic.go:356] "Generic (PLEG): container finished" podID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerID="9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302" exitCode=0
Jul 07 00:28:59.663150 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.662996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerDied","Data":"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"}
Jul 07 00:28:59.663583 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.663560    2574 scope.go:117] "RemoveContainer" containerID="9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"
Jul 07 00:28:59.664493 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.664468    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:59.664553 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.664534    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:28:59.664601 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:28:59.664564    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 00:29:00.673682 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:00.673627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerStarted","Data":"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"}
Jul 07 00:29:00.872096 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:00.872062    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:29:00.872517 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:00.872391    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 07 00:29:00.872731 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:00.872708    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 07 00:29:01.872905 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:01.872859    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 07 00:29:01.873476 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:01.872936    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 07 00:29:02.872300 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:02.872250    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 07 00:29:02.872549 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:02.872324    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 07 00:29:03.873036 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:03.872998    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 07 00:29:03.873664 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:03.873634    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 07 00:29:04.875686 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:04.875652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:29:04.876066 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:04.876011    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:29:04.876733 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:04.876713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:29:06.066573 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:06.066538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:06.166953 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:06.166918    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:06.984109 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:06.984054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:39.403761 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:29:39.403726    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:18.447652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:30:18.447612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:22.229786 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:30:22.229755    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:56.080127 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:30:56.080039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:31:10.122933 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:31:10.122906    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:31:10.123494 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:31:10.123471    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krvhq_d5aac35b-8788-4cd4-8e95-d5ff9cf22f9b/ovn-acl-logging/0.log"
Jul 07 00:31:37.088171 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:31:37.088134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:31:37.958119 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:31:37.958079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:31:48.168444 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:31:48.168390    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:32:10.383319 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:32:10.383239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:32:57.094593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:32:57.094553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:32:58.051200 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:32:58.051164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:03.552844 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:03.552803    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:12.106625 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:12.106587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:12.206883 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:12.206836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:17.065048 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:17.065008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:26.676651 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:26.676613    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:59.097720 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:59.097684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:33:59.199644 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:33:59.199603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:06.772668 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:06.772628    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:06.875199 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:06.875162    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:08.698941 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:08.698910    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:09.591529 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:09.591491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:10.607232 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:10.607198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:11.006985 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:11.006888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:11.106902 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:11.106866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:11.208552 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:11.208509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:11.295994 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:11.295959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:16.112709 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:16.112664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:18.955381 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:18.955343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:19.055966 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:19.055934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:53.075492 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:53.075456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:53.314857 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:53.314826    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:34:53.315093 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:53.315065    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" containerID="cri-o://31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f" gracePeriod=30
Jul 07 00:34:54.338608 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.338574    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:54.440296 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.440261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:54.545898 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.545866    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:34:54.546147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.546123    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" podUID="793058f9-1ec9-4f67-b942-ec8325480245" containerName="maas-api" containerID="cri-o://aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928" gracePeriod=30
Jul 07 00:34:54.576769 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.576741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:34:54.792731 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.792705    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:34:54.967466 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.967355    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmshk\" (UniqueName: \"kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk\") pod \"793058f9-1ec9-4f67-b942-ec8325480245\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") "
Jul 07 00:34:54.967616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.967496    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") pod \"793058f9-1ec9-4f67-b942-ec8325480245\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") "
Jul 07 00:34:54.967616 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.967528    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca\") pod \"793058f9-1ec9-4f67-b942-ec8325480245\" (UID: \"793058f9-1ec9-4f67-b942-ec8325480245\") "
Jul 07 00:34:54.967940 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.967906    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "793058f9-1ec9-4f67-b942-ec8325480245" (UID: "793058f9-1ec9-4f67-b942-ec8325480245"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:34:54.969554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.969526    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "793058f9-1ec9-4f67-b942-ec8325480245" (UID: "793058f9-1ec9-4f67-b942-ec8325480245"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:34:54.969554 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:54.969539    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk" (OuterVolumeSpecName: "kube-api-access-fmshk") pod "793058f9-1ec9-4f67-b942-ec8325480245" (UID: "793058f9-1ec9-4f67-b942-ec8325480245"). InnerVolumeSpecName "kube-api-access-fmshk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:34:55.068776 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.068745    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/793058f9-1ec9-4f67-b942-ec8325480245-maas-api-tls\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:55.068776 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.068776    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/793058f9-1ec9-4f67-b942-ec8325480245-openshift-service-ca\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:55.068987 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.068785    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmshk\" (UniqueName: \"kubernetes.io/projected/793058f9-1ec9-4f67-b942-ec8325480245-kube-api-access-fmshk\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:55.208593 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.208559    2574 generic.go:356] "Generic (PLEG): container finished" podID="793058f9-1ec9-4f67-b942-ec8325480245" containerID="aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928" exitCode=0
Jul 07 00:34:55.208759 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.208605    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"
Jul 07 00:34:55.208759 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.208608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" event={"ID":"793058f9-1ec9-4f67-b942-ec8325480245","Type":"ContainerDied","Data":"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"}
Jul 07 00:34:55.208759 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.208732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp" event={"ID":"793058f9-1ec9-4f67-b942-ec8325480245","Type":"ContainerDied","Data":"dc57d87de08bdf3bd386bc35de440a39f91bf5db893d28c14f835f1251152e51"}
Jul 07 00:34:55.208861 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.208763    2574 scope.go:117] "RemoveContainer" containerID="aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"
Jul 07 00:34:55.217297 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.217282    2574 scope.go:117] "RemoveContainer" containerID="aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"
Jul 07 00:34:55.217608 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:34:55.217559    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928\": container with ID starting with aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928 not found: ID does not exist" containerID="aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"
Jul 07 00:34:55.217608 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.217595    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928"} err="failed to get container status \"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928\": rpc error: code = NotFound desc = could not find container \"aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928\": container with ID starting with aabd9675931a12408234e333ed6edfdf5bf73448bf24f94f2b68148748009928 not found: ID does not exist"
Jul 07 00:34:55.229322 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.229288    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:34:55.236842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:55.236817    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ead650-658f8fc8cc-mwngp"]
Jul 07 00:34:56.087812 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:56.087781    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="793058f9-1ec9-4f67-b942-ec8325480245" path="/var/lib/kubelet/pods/793058f9-1ec9-4f67-b942-ec8325480245/volumes"
Jul 07 00:34:58.277751 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.277712    2574 patch_prober.go:28] interesting pod/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:34:58.278141 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.277773    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:34:58.563308 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.563285    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:34:58.699005 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.698955    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699005 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699013    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699039    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699058    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699094    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699109    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9lz4\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699254 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699235    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data\") pod \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\" (UID: \"1e05ac24-f9fe-4782-b2a2-91e0bf927f69\") "
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699283    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699460    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699436    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699558    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699599    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699616    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.699652 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.699631    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.700183 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.700157    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:34:58.701424 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.701388    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:34:58.701540 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.701500    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:34:58.701540 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.701507    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4" (OuterVolumeSpecName: "kube-api-access-q9lz4") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "kube-api-access-q9lz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:34:58.701641 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.701622    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e05ac24-f9fe-4782-b2a2-91e0bf927f69" (UID: "1e05ac24-f9fe-4782-b2a2-91e0bf927f69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800120    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800164    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800173    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800183    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9lz4\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-kube-api-access-q9lz4\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800194    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:58.800221 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:58.800202    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e05ac24-f9fe-4782-b2a2-91e0bf927f69-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:34:59.229949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.229862    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerID="31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f" exitCode=0
Jul 07 00:34:59.229949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.229908    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"
Jul 07 00:34:59.229949 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.229939    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerDied","Data":"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"}
Jul 07 00:34:59.230180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.229989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9" event={"ID":"1e05ac24-f9fe-4782-b2a2-91e0bf927f69","Type":"ContainerDied","Data":"98d3a01d679b7d3aeef3b323d0add741e29219479bedc1268433fec84909f64e"}
Jul 07 00:34:59.230180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.230012    2574 scope.go:117] "RemoveContainer" containerID="31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"
Jul 07 00:34:59.238705 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.238687    2574 scope.go:117] "RemoveContainer" containerID="21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"
Jul 07 00:34:59.247324 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.247307    2574 scope.go:117] "RemoveContainer" containerID="31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"
Jul 07 00:34:59.247647 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:34:59.247624    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f\": container with ID starting with 31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f not found: ID does not exist" containerID="31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"
Jul 07 00:34:59.247740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.247660    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f"} err="failed to get container status \"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f\": rpc error: code = NotFound desc = could not find container \"31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f\": container with ID starting with 31781c9777534c9c58376c54d602fc057668bf69da07928f40f89681a487b51f not found: ID does not exist"
Jul 07 00:34:59.247740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.247686    2574 scope.go:117] "RemoveContainer" containerID="21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"
Jul 07 00:34:59.247947 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:34:59.247928    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b\": container with ID starting with 21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b not found: ID does not exist" containerID="21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"
Jul 07 00:34:59.247993 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.247953    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b"} err="failed to get container status \"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b\": rpc error: code = NotFound desc = could not find container \"21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b\": container with ID starting with 21827368c8d1629bbb2a8af236bd1342a894bc03ba2017305d3cb76bfa94735b not found: ID does not exist"
Jul 07 00:34:59.252740 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.252712    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:34:59.255894 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:34:59.255870    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f5f1a0-openshift-default-56bc968959-cn6x9"]
Jul 07 00:35:00.087525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.087493    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" path="/var/lib/kubelet/pods/1e05ac24-f9fe-4782-b2a2-91e0bf927f69/volumes"
Jul 07 00:35:00.220797 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.220749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:00.290699 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.290662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:00.467866 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.467784    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:35:00.468039 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.468009    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" containerID="cri-o://6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7" gracePeriod=30
Jul 07 00:35:00.500056 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.500007    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:00.732432 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:00.732313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:04.879006 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:04.878910    2574 patch_prober.go:28] interesting pod/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:35:04.879006 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:04.878979    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:35:05.716859 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.716830    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:35:05.759283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759197    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759236    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759283 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759261    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9jsk\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759301    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759328    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759362    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759385    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759463    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759508    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket\") pod \"de3275a9-285b-4cd6-b68e-aa76fa39e872\" (UID: \"de3275a9-285b-4cd6-b68e-aa76fa39e872\") "
Jul 07 00:35:05.759587 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759520    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:05.759936 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759716    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.759936 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759735    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:35:05.760027 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759940    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:05.760027 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.759952    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:05.760247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.760221    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data" (OuterVolumeSpecName: "istio-data") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:05.761748 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.761724    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:35:05.761831 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.761796    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token" (OuterVolumeSpecName: "istio-token") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:35:05.762042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.762019    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk" (OuterVolumeSpecName: "kube-api-access-v9jsk") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "kube-api-access-v9jsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:35:05.762042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.762029    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de3275a9-285b-4cd6-b68e-aa76fa39e872" (UID: "de3275a9-285b-4cd6-b68e-aa76fa39e872"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:05.826835 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.826792    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-688c79454f-t9vb2_a17fa226-1569-4351-a7f6-c599f3d527a7/maas-api/0.log"
Jul 07 00:35:05.860248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860199    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-workload-certs\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860244    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-envoy\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860253    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-token\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860248 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860261    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-podinfo\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860270    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-credential-socket\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860279    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3275a9-285b-4cd6-b68e-aa76fa39e872-istiod-ca-cert\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860288    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9jsk\" (UniqueName: \"kubernetes.io/projected/de3275a9-285b-4cd6-b68e-aa76fa39e872-kube-api-access-v9jsk\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:05.860525 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:05.860296    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3275a9-285b-4cd6-b68e-aa76fa39e872-istio-data\") on node \"ip-10-0-141-102.ec2.internal\" DevicePath \"\""
Jul 07 00:35:06.159084 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.159052    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bfd6c446f-r5xwj_2d2e7165-7713-42bc-850f-5588d575155a/manager/0.log"
Jul 07 00:35:06.260915 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.260878    2574 generic.go:356] "Generic (PLEG): container finished" podID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerID="6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7" exitCode=0
Jul 07 00:35:06.261106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.260933    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"
Jul 07 00:35:06.261106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.260943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerDied","Data":"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"}
Jul 07 00:35:06.261106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.260985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7" event={"ID":"de3275a9-285b-4cd6-b68e-aa76fa39e872","Type":"ContainerDied","Data":"1ad3f9c044fd6f72784180c16862b93c9b9cca3169712b49ccf0fb78cf26f1e3"}
Jul 07 00:35:06.261106 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.261007    2574 scope.go:117] "RemoveContainer" containerID="6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"
Jul 07 00:35:06.269334 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.269316    2574 scope.go:117] "RemoveContainer" containerID="9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"
Jul 07 00:35:06.277465 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.277440    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:35:06.277579 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.277439    2574 scope.go:117] "RemoveContainer" containerID="6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"
Jul 07 00:35:06.277757 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:35:06.277737    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7\": container with ID starting with 6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7 not found: ID does not exist" containerID="6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"
Jul 07 00:35:06.277832 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.277770    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7"} err="failed to get container status \"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7\": rpc error: code = NotFound desc = could not find container \"6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7\": container with ID starting with 6c1e7e704166b3ead28aa51d03c94f45a87c792388b8415282cd65bdade470f7 not found: ID does not exist"
Jul 07 00:35:06.277832 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.277812    2574 scope.go:117] "RemoveContainer" containerID="9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"
Jul 07 00:35:06.278092 ip-10-0-141-102 kubenswrapper[2574]: E0707 00:35:06.278071    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302\": container with ID starting with 9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302 not found: ID does not exist" containerID="9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"
Jul 07 00:35:06.278137 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.278097    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302"} err="failed to get container status \"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302\": rpc error: code = NotFound desc = could not find container \"9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302\": container with ID starting with 9280c48f12ecf1dc0b22df8ad96dc105048a461b47fab19ac91b2ea6b01b3302 not found: ID does not exist"
Jul 07 00:35:06.281976 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.281956    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ead650-openshift-default-6f99546fbc-trfx7"]
Jul 07 00:35:06.520350 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.520322    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-jzlvc_2325653a-30e7-4988-8454-29c9ba011d51/copy-manifests/0.log"
Jul 07 00:35:06.527609 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:06.527584    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-jzlvc_2325653a-30e7-4988-8454-29c9ba011d51/manager/0.log"
Jul 07 00:35:08.087452 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:08.087419    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" path="/var/lib/kubelet/pods/de3275a9-285b-4cd6-b68e-aa76fa39e872/volumes"
Jul 07 00:35:09.435876 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:09.435847    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jc7gz_6c068c77-b940-4a08-9f33-ef7b6f8c45d9/discovery/0.log"
Jul 07 00:35:09.770702 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:09.770676    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/1.log"
Jul 07 00:35:09.886662 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:09.886627    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bfgth_2ec144d6-4db4-4b5f-9171-655e279479e5/payload-pre-processing/0.log"
Jul 07 00:35:10.563981 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:10.563950    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hz7tr_a198faff-11d3-41f2-9cc7-f7cf02b032a1/main/0.log"
Jul 07 00:35:10.780842 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:10.780808    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrz7gf_83d1c37f-71f1-47df-a4d6-7b4f3d6c01c5/main/0.log"
Jul 07 00:35:10.905154 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:10.905079    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zm6bw_0710e1f3-1593-4c5e-83c9-c39a2e2b5563/main/0.log"
Jul 07 00:35:15.378203 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:15.378164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:15.477557 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:15.477524    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log" limit=1024
Jul 07 00:35:18.370322 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:18.370294    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g79jh_3d2aa0af-89af-448c-a456-d15cdcf16afc/global-pull-secret-syncer/0.log"
Jul 07 00:35:18.510103 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:18.510070    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ccs99_e1570fc8-58c0-437f-bf05-8024712c3edb/konnectivity-agent/0.log"
Jul 07 00:35:18.629101 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:18.629015    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-102.ec2.internal_669e63d0e24cd24225c0314e3e07d651/haproxy/0.log"
Jul 07 00:35:26.435038 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:26.435008    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-849gj_ec1e829c-4541-4162-89c8-032437a7f1cb/node-exporter/0.log"
Jul 07 00:35:26.454544 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:26.454516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-849gj_ec1e829c-4541-4162-89c8-032437a7f1cb/kube-rbac-proxy/0.log"
Jul 07 00:35:26.478499 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:26.478477    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-849gj_ec1e829c-4541-4162-89c8-032437a7f1cb/init-textfile/0.log"
Jul 07 00:35:28.268580 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268538    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"]
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268840    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="793058f9-1ec9-4f67-b942-ec8325480245" containerName="maas-api"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268853    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="793058f9-1ec9-4f67-b942-ec8325480245" containerName="maas-api"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268869    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268875    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268882    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268889    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268895    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.268960 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268900    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.269215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268970    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3275a9-285b-4cd6-b68e-aa76fa39e872" containerName="istio-proxy"
Jul 07 00:35:28.269215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268978    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="793058f9-1ec9-4f67-b942-ec8325480245" containerName="maas-api"
Jul 07 00:35:28.269215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268984    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.269215 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.268991    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e05ac24-f9fe-4782-b2a2-91e0bf927f69" containerName="istio-proxy"
Jul 07 00:35:28.272042 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.272022    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.274691 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.274670    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khfq\"/\"openshift-service-ca.crt\""
Jul 07 00:35:28.274787 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.274672    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khfq\"/\"kube-root-ca.crt\""
Jul 07 00:35:28.275683 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.275666    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6khfq\"/\"default-dockercfg-hjcwq\""
Jul 07 00:35:28.280843 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.280814    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"]
Jul 07 00:35:28.344895 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.344864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-podres\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.345069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.344913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-sys\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.345069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.344933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-proc\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.345069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.345006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-lib-modules\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.345069 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.345037    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp7hz\" (UniqueName: \"kubernetes.io/projected/84534a98-0d07-4f56-a274-4498e098cbde-kube-api-access-lp7hz\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445505 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-podres\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-sys\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-proc\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-lib-modules\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp7hz\" (UniqueName: \"kubernetes.io/projected/84534a98-0d07-4f56-a274-4498e098cbde-kube-api-access-lp7hz\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445609    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-proc\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445608    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-sys\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445647    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-podres\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.445946 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.445686    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84534a98-0d07-4f56-a274-4498e098cbde-lib-modules\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.453293 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.453266    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp7hz\" (UniqueName: \"kubernetes.io/projected/84534a98-0d07-4f56-a274-4498e098cbde-kube-api-access-lp7hz\") pod \"perf-node-gather-daemonset-td6bx\" (UID: \"84534a98-0d07-4f56-a274-4498e098cbde\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.583648 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.583558    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:28.709810 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:28.709783    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"]
Jul 07 00:35:28.712124 ip-10-0-141-102 kubenswrapper[2574]: W0707 00:35:28.712096    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84534a98_0d07_4f56_a274_4498e098cbde.slice/crio-29ba0a57f4e59a75a6e4d10b7fe5c6f9246965119c9e364e0860861b7359b93b WatchSource:0}: Error finding container 29ba0a57f4e59a75a6e4d10b7fe5c6f9246965119c9e364e0860861b7359b93b: Status 404 returned error can't find the container with id 29ba0a57f4e59a75a6e4d10b7fe5c6f9246965119c9e364e0860861b7359b93b
Jul 07 00:35:29.356172 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:29.356133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx" event={"ID":"84534a98-0d07-4f56-a274-4498e098cbde","Type":"ContainerStarted","Data":"0ccd3ef40d1dae014f1e50a20a417e2a6a49a6c9960aa7fa5751bc2349f88642"}
Jul 07 00:35:29.356613 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:29.356195    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx" event={"ID":"84534a98-0d07-4f56-a274-4498e098cbde","Type":"ContainerStarted","Data":"29ba0a57f4e59a75a6e4d10b7fe5c6f9246965119c9e364e0860861b7359b93b"}
Jul 07 00:35:29.356613 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:29.356224    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:29.375123 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:29.375071    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx" podStartSLOduration=1.375054818 podStartE2EDuration="1.375054818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:35:29.372824129 +0000 UTC m=+2359.826251725" watchObservedRunningTime="2026-07-07 00:35:29.375054818 +0000 UTC m=+2359.828482413"
Jul 07 00:35:31.385638 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:31.385609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9rlm_530cea56-1c2e-4f0c-926e-5a9ef670686c/dns/0.log"
Jul 07 00:35:31.408247 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:31.408219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9rlm_530cea56-1c2e-4f0c-926e-5a9ef670686c/kube-rbac-proxy/0.log"
Jul 07 00:35:31.455679 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:31.455649    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wvbt9_0fe27f5d-5983-4afd-8fce-081e37d7fbea/dns-node-resolver/0.log"
Jul 07 00:35:32.156935 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:32.156888    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x6k8g_06b39bed-9d98-4db1-8b61-5804382e47dc/node-ca/0.log"
Jul 07 00:35:33.327434 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:33.327387    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jc7gz_6c068c77-b940-4a08-9f33-ef7b6f8c45d9/discovery/0.log"
Jul 07 00:35:33.416903 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:33.416872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/0.log"
Jul 07 00:35:33.473044 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:33.473001    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/1.log"
Jul 07 00:35:33.515644 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:33.515609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bfgth_2ec144d6-4db4-4b5f-9171-655e279479e5/payload-pre-processing/0.log"
Jul 07 00:35:34.319203 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:34.319156    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jds7x_fc175706-bf36-48d4-9e4b-0ed310eb0c49/serve-healthcheck-canary/0.log"
Jul 07 00:35:34.868882 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:34.868854    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd58t_77aeb02d-199a-4819-a7b2-ed13e805863b/kube-rbac-proxy/0.log"
Jul 07 00:35:34.889794 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:34.889766    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd58t_77aeb02d-199a-4819-a7b2-ed13e805863b/exporter/0.log"
Jul 07 00:35:34.917032 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:34.917003    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd58t_77aeb02d-199a-4819-a7b2-ed13e805863b/extractor/0.log"
Jul 07 00:35:35.370147 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:35.370122    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-td6bx"
Jul 07 00:35:37.563848 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:37.563815    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-688c79454f-t9vb2_a17fa226-1569-4351-a7f6-c599f3d527a7/maas-api/0.log"
Jul 07 00:35:37.771827 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:37.771795    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bfd6c446f-r5xwj_2d2e7165-7713-42bc-850f-5588d575155a/manager/0.log"
Jul 07 00:35:37.918617 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:37.918546    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-jzlvc_2325653a-30e7-4988-8454-29c9ba011d51/manager/0.log"
Jul 07 00:35:37.942731 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:37.942708    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-jzlvc_2325653a-30e7-4988-8454-29c9ba011d51/copy-manifests/0.log"
Jul 07 00:35:39.466144 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:39.466109    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jc7gz_6c068c77-b940-4a08-9f33-ef7b6f8c45d9/discovery/0.log"
Jul 07 00:35:39.550206 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:39.550176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59b45dbd94-zgmbp_4cd65381-0108-4dcb-b407-c3711a205b4e/manager/0.log"
Jul 07 00:35:39.613231 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:39.613199    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/0.log"
Jul 07 00:35:39.670217 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:39.670176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/1.log"
Jul 07 00:35:39.710332 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:39.710306    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bfgth_2ec144d6-4db4-4b5f-9171-655e279479e5/payload-pre-processing/0.log"
Jul 07 00:35:41.291600 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:41.291566    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jc7gz_6c068c77-b940-4a08-9f33-ef7b6f8c45d9/discovery/0.log"
Jul 07 00:35:41.345511 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:41.345479    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/0.log"
Jul 07 00:35:41.405250 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:41.405218    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dfpqm_2c769803-6427-4fcd-b0fb-26d432cd5bfc/istio-proxy/1.log"
Jul 07 00:35:41.436180 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:41.436154    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bfgth_2ec144d6-4db4-4b5f-9171-655e279479e5/payload-pre-processing/0.log"
Jul 07 00:35:44.664186 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:44.664099    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j7dks_372d38c1-a408-4a43-95bb-7109bc54da62/migrator/0.log"
Jul 07 00:35:44.684375 ip-10-0-141-102 kubenswrapper[2574]: I0707 00:35:44.684348    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j7dks_372d38c1-a408-4a43-95bb-7109bc54da62/graceful-termination/0.log"